-- Logs begin at Wed 2022-05-18 15:55:22 UTC, end at Wed 2022-05-18 17:34:02 UTC. -- May 18 16:49:34.385092 dv-cinder-795785-11-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 18 16:49:34.393710 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 18 16:49:34.395708 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 18 16:49:34 2022] *** May 18 16:49:34.395708 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 18 16:49:34.395708 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 18 16:49:34.395708 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: nodename: dv-cinder-795785-11-iscsi May 18 16:49:34.395708 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: machine: x86_64 May 18 16:49:34.395708 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: clock source: unix May 18 16:49:34.395708 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: pcre jit disabled May 18 16:49:34.395708 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: detected number of CPU cores: 4 May 18 16:49:34.395708 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: current working directory: / May 18 16:49:34.395708 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: detected binary path: /usr/bin/uwsgi-core May 18 16:49:34.395708 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: your processes number limit is 47680 May 18 16:49:34.396420 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: your memory page size is 4096 bytes May 18 16:49:34.396420 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: detected max file descriptor number: 2048 May 18 16:49:34.396420 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: lock engine: pthread robust mutexes May 18 16:49:34.396420 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: thunder lock: enabled May 18 16:49:34.396420 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 18 16:49:34.396420 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 18 16:49:34.441643 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: Python main interpreter initialized at 0x55e6a35789c0 May 18 16:49:34.441643 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: python threads support enabled May 18 16:49:34.441643 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: your server socket listen backlog is limited to 100 connections May 18 16:49:34.441643 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: your mercy for graceful operations on workers is 90 seconds May 18 16:49:34.442060 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: mapped 403077 bytes (393 KB) for 2 cores May 18 16:49:34.442138 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: *** Operational MODE: preforking *** May 18 16:49:34.442383 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: *** uWSGI is running in multiple interpreter mode *** May 18 16:49:34.442383 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: spawned uWSGI master process (pid: 80340) May 18 16:49:34.442604 dv-cinder-795785-11-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 18 16:49:34.443185 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: spawned uWSGI worker 1 (pid: 80344, cores: 1) May 18 16:49:34.444295 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: spawned uWSGI worker 2 (pid: 80345, cores: 1) May 18 16:49:34.444295 dv-cinder-795785-11-iscsi devstack@keystone.service[80340]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 18 16:49:40.370453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 16:49:40.370453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: from cryptography.utils import int_from_bytes May 18 16:49:40.371211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 16:49:40.371211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: from cryptography.utils import int_from_bytes May 18 16:49:40.421696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 16:49:40.421939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 16:49:40.422084 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] command line args: [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 16:49:40.422343 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 16:49:40.422517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ================================================================================ {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 16:49:40.422768 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] admin_token = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.423011 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] config_dir = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.423193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.423374 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] config_source = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.423550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] debug = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.423746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.424115 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.424289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.424414 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 16:49:40.424414 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: from cryptography.utils import int_from_bytes May 18 16:49:40.425108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.425207 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 16:49:40.425207 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: from cryptography.utils import int_from_bytes May 18 16:49:40.425378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.425378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.425378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] log_config_append = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.425378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.425805 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] log_dir = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.425805 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] log_file = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.425999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.426120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.426445 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.426608 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.426768 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.426914 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.427166 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.427407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.427638 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.427868 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.428100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.428332 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.428578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.428820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.429094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.429705 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.429884 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] publish_errors = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.430107 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.430340 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.430518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.430765 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.430998 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.431233 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] standard_threads = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.431471 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.431710 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.431889 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.432094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] use_journal = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.432226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] use_json = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.432405 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] use_stderr = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.432561 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] use_syslog = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.432794 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.433053 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.433288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.433547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.433815 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.434067 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.434301 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.434550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.434788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.435032 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.435278 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.435529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.435763 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.436007 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.436241 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.436485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.436730 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.436962 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.437214 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.437468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.437736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.437975 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.438227 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.438486 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.438737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.438985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.439215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.439442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.439668 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.439902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.440149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.440404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.440612 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.440839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.441081 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.441326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.441564 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.441834 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.442066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.442296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.442530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.442762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.442990 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.443217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.443442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.443678 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.443921 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.444144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.444377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.444607 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.444840 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.445388 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.445388 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.445894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.445894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.446144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.446285 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.446512 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.446746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.446973 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.447222 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.447458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.447833 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.448065 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.448324 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.448556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.448783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.449018 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.449253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.449524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.449763 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.450023 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.450272 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.450504 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.450742 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.450984 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.451230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.451508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.451814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.452119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.452422 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.452724 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.453022 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.453315 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.453614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.453968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.454274 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.454828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.455128 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.455432 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.455737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.456036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.456329 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.456612 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.456903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.457202 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.457490 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.457817 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.458136 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.458439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.458750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.459050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.459377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.459710 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.460011 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.460313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.external = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.461190 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.461605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.461940 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.462234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.password = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.462531 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] auth.token = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.462833 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.463133 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.463436 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.463718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.464030 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.464339 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.464627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.464915 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.465220 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.465527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.465892 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.466247 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.466561 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.466858 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.467179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.467497 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.467792 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.468105 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.468515 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.468831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.469158 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.469465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.469828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.470134 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.470433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.470741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.471051 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.471345 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.471664 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.472045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.472411 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.472817 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.473206 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.473570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.473977 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.474318 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.474657 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.474994 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.475322 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.475468 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 16:49:40.475663 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 16:49:40.475811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.475930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] command line args: [] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 16:49:40.476118 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 16:49:40.476311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.477065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ================================================================================ {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 16:49:40.477236 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.477522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] admin_token = **** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.477865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.478037 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.478170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] config_dir = [] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.478248 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.478375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] config_source = [] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.478491 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.478612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] debug = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.478776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.478945 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.479075 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.479193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.479319 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.479449 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.479620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.479753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.479925 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] list_limit = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.480016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.480110 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] log_config_append = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.480291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.480417 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.480541 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] log_dir = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.480671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] log_file = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.480821 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.480945 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.481068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.481193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.481338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.481458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.481593 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.481767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.481925 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.481925 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.482216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.482359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.482508 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.482641 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.482774 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.482906 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.483032 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.483176 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.483337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.483470 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.483602 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.483811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.483953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.484099 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.484231 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.484561 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.484700 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.484832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] publish_errors = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.484974 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.485103 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.485233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.485364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.485491 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.485781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.485918 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.486060 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.486060 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] standard_threads = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.486296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.486425 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.486570 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.486695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.486823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.486951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] use_journal = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.487076 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] use_json = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.487203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.487346 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] use_stderr = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.487346 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] use_syslog = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.487580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.487710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:49:40.487838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.487964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.488115 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.488321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.488480 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.488594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.488773 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.488897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.489043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.489171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.489304 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.489527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.489683 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.490524 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.491434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.491522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.491522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.491654 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.491829 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.491829 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.492565 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.492655 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.492720 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.492817 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.492921 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.492989 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.493049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.493120 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.493120 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.493226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.493226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.493335 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.493529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.493638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.493793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.493907 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.494061 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.494228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.494358 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.494584 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.494721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.494839 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.494956 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.495081 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.495320 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.495398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.495559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.495657 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.495803 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.496021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.496109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.496302 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.496388 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.496540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.496702 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.496790 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.497019 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.497106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.497274 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.497374 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.497518 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.497745 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.497836 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.498023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.498110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.498281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.498427 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.498588 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.498755 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.498896 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.499033 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.499214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.499356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.499493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.499654 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.499795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.499929 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.500103 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.500243 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.500376 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.500547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.500687 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.500819 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.500993 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.501133 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.501291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.501425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.501567 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.501800 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.501959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.502116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.502275 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.502411 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.502541 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.502724 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.502883 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.503017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.503160 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.503292 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.503422 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.503551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.503794 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.503926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.504057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.504202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.504371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.504517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.504660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.504800 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.504940 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.505071 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.505240 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.505453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.505644 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.505859 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.505992 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.506117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.506250 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.506435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.506590 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.506724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.506905 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.507042 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.507173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.507335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.507486 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.508205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.508514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.508777 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.508974 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.509186 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.509342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.509474 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.509601 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.509758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.509965 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.510100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.510250 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.510443 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.510584 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.510717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.510879 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.511027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.511173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.511327 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.511464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.511625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.511756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.511887 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.512098 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.512234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.512364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.512557 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.512692 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.512822 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.513012 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.513151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.513294 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.513449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.513587 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.513776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.513907 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.514038 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.514196 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.514329 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.514461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.514710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.514849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.514979 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.515136 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] role.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.515272 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] auth.external = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.515402 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.515577 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] role.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.515718 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.515903 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.516036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.516165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] auth.password = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.516360 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] auth.token = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.516510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.516650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.516822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.516971 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.517102 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.517264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.517417 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.517547 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.517716 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.517851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.518025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.518157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.518310 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] credential.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.518517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.518651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.518781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.518993 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.519140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.519284 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.519440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.519575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.519706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.519862 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.519997 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.520211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.520347 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.520478 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.520699 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.520836 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.520967 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.521141 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.521278 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.521480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.521615 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.521800 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.522000 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.522244 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] federation.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.522381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.522525 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.522656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.522786 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.522959 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.523921 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.524074 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.524252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.524596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.524736 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.524891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.525021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.525154 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.525392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.525530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.525697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.525852 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.525985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.526158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.526289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.526421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.526647 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.526799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.526931 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.527086 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.527223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.527354 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.527507 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.527735 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.527871 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.528010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.528142 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.528273 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.528400 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.528544 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.528747 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.528883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.529013 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.529205 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.529354 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.529499 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.529627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.529850 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.529981 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.530107 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.530237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.530441 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.530579 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.530709 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.530871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] token.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.531008 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.531172 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.531318 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.531434 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.531637 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.531876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.532119 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.532261 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.532409 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.532594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.532729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.532861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.533152 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.533297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.533445 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.533576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.533813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.533949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.534082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.534304 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.534567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.534702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.534832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.534984 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.535120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.535250 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.535430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.535568 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.535702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.535962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.536102 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.536232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.536378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.536491 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.536623 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.536848 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.536989 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.537122 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.537320 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.537455 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.537586 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.537828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.537964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.538093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.538300 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.538437 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.538568 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.538695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.538869 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.539206 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.540225 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.540496 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.540756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.541324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.541444 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.541593 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.541865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.541969 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.connection = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.542109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.542351 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.542437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.542598 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.542804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.542894 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.543061 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.543230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.543461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.543650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.543772 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.543966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.544088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.544220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.544461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.544588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.544694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.544913 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.545064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.545169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.545329 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.545453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.545631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.545803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.545920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.546355 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.546355 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.546660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.546796 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.546949 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.547085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.547221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.547356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.547485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.547619 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.547763 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.547947 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.548087 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.548220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.548380 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.548517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.548707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.548868 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.549000 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.549185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] resource.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.549321 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.549452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.549648 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.549836 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.549965 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.550091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.550223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.550391 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 16:49:40.550548 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.550675 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.550889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.551133 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.551375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.551617 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] role.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.551870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] role.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.552104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.552360 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.552613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.552867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.553117 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.553366 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.553616 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.553894 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.554146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.554410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.555158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.556117 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.556384 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.556640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.557079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.557321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.557577 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.557861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.558117 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.558376 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.558615 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.558876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.559136 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.559379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.559622 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.559857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.560094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.560351 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.560609 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.560861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.561115 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.561356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.561590 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.561857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] token.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.562099 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.562353 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.562607 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.562870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.563124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.563366 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.563617 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.563867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.564121 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.564362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.564607 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.564847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.565099 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.565353 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.565587 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.565863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.566180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.566446 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.connection = **** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.566694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.566948 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.567192 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.567438 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.567676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.567922 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.568164 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.568405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.568637 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.568879 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.569129 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.569374 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.569629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.569903 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.570963 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.571633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.571903 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.572153 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:49:40.572330 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 16:49:40.592279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.592517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.592746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.599827 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.600055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.600287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.602701 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.612335 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.633271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.633494 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.635122 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.635360 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.690387 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.691351 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.745848 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.746103 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.749567 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.749822 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.818336 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.818566 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.818798 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.819020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.819240 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.819455 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.822277 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.822510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.822733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.822954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.823182 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.823393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.846526 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.846739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.846828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.846962 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.847056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.847185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.847276 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.847405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.847491 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.847626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.847716 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.847842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.847939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.848055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.860728 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.861141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.875491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.876204 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.876204 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.876204 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.876664 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.876848 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.876978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.877116 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.877238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.877361 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.877361 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.877361 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.877725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.877841 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 18 16:49:40.895613 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.895791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 18 16:49:40.896011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.896127 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.896209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 18 16:49:40.896286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 18 16:49:40.896517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.896610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.896734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 18 16:49:40.896830 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.897009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.897106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.897259 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.897351 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.897517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.901055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.909150 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.909441 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.909738 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.910026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.912222 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.912511 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.912786 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.913069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.918345 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:40.921718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:40.922010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.922138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:40.922427 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.922717 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.923001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.923263 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.923532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.923804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.924076 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.924363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.925524 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:40.925830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.926119 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.926406 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.926692 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.926955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.927223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.927505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.927776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.928051 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.928324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.952135 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.953813 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:40.954102 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.956871 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.958569 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:40.958853 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.959698 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:40.959979 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.960257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.965531 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:40.965846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.966130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.968384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:40.968681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.973343 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:40.973633 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.973750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:40.973941 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.974037 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.974226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.974505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.974777 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.975046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.975313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.979241 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:40.979529 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.979817 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.980101 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.980378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.980656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.980934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.981203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.995218 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:40.995512 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.000181 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.001193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.001490 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.003909 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.004207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.006123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.010053 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.011167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.011474 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.013872 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.016477 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.017576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.017909 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.018195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.018480 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.018834 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.019145 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.020237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.024623 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.024925 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.025217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.025504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.025815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.026151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.038896 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.039191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.039577 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.039849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.046208 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.046509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.046781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.047051 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.047866 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.049613 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.049913 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.052977 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.053255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.053545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.053860 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.054141 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.056234 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.058063 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.058342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.061458 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.061774 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.062151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.062401 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.062796 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.068239 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.068534 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.068822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.069103 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.069386 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.069687 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.070093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.077737 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.078036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.078331 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.078614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.078896 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.079173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.079449 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.089613 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.092951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.096306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.097922 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.099586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.099871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.100156 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.100328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.105086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.108651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.108827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.110321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.111707 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.112005 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.112444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.112732 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.118215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.118751 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.119264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.119757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.126268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.128091 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.131451 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.131746 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.132034 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.132317 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.132582 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.133083 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.133415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.141593 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.141924 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.142209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.142490 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.142601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.142770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.142907 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.143047 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.143178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.143325 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.143583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.143859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.144129 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.144408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.144669 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.146318 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.146521 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.152699 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 18 16:49:41.153017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.153270 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.153557 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.153865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.154144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.154431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.154713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.154986 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.155257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.155671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.155947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.156218 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.156495 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 18 16:49:41.196336 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e6a35789c0 pid: 80344 (default app) May 18 16:49:41.200065 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66994b68-3962-43a6-87d6-e3288d496e2c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:41.200359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66994b68-3962-43a6-87d6-e3288d496e2c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:41.200638 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66994b68-3962-43a6-87d6-e3288d496e2c None None] PATH_INFO: `/v3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:41.205295 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Wed May 18 16:49:41 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:49:41.205496 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e6a35789c0 pid: 80345 (default app) May 18 16:49:49.386362 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60ee07-71a3-401b-a183-03eb241da9b2 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:49.386918 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60ee07-71a3-401b-a183-03eb241da9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:49.386918 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60ee07-71a3-401b-a183-03eb241da9b2 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:49.388173 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:49:49.395573 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0687f-4851-44f9-ab00-08c58ece40f0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:49.396010 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0687f-4851-44f9-ab00-08c58ece40f0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:49.396181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0687f-4851-44f9-ab00-08c58ece40f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:49.464882 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: INFO dbcounter [None req-54b0687f-4851-44f9-ab00-08c58ece40f0 None None] Registered counter for database keystone May 18 16:49:49.487765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG oslo_db.sqlalchemy.engines [None req-54b0687f-4851-44f9-ab00-08c58ece40f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 16:49:49.495301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writer thread running {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 16:49:49.680986 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG passlib.handlers.bcrypt [None req-54b0687f-4851-44f9-ab00-08c58ece40f0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80345) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 18 16:49:49.681510 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG passlib.handlers.bcrypt [None req-54b0687f-4851-44f9-ab00-08c58ece40f0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80345) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 18 16:49:49.738835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-54b0687f-4851-44f9-ab00-08c58ece40f0 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:49:49.740468 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-54b0687f-4851-44f9-ab00-08c58ece40f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:49:49.870878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1/3] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:49:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 18 16:49:50.020949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60ee07-71a3-401b-a183-03eb241da9b2 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:49:50.091199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: INFO dbcounter [None req-fa60ee07-71a3-401b-a183-03eb241da9b2 None None] Registered counter for database keystone May 18 16:49:50.110917 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG oslo_db.sqlalchemy.engines [None req-fa60ee07-71a3-401b-a183-03eb241da9b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 16:49:50.117668 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writer thread running {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 16:49:50.237093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60ee07-71a3-401b-a183-03eb241da9b2 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:49:50.241301 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76489c9-fc64-47e1-a61d-97903e2a9fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:49:50.242703 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76489c9-fc64-47e1-a61d-97903e2a9fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:50.243094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76489c9-fc64-47e1-a61d-97903e2a9fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:50.243374 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76489c9-fc64-47e1-a61d-97903e2a9fc5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:50.251681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76489c9-fc64-47e1-a61d-97903e2a9fc5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:49:50.303246 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e76489c9-fc64-47e1-a61d-97903e2a9fc5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 18 16:49:50.303499 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76489c9-fc64-47e1-a61d-97903e2a9fc5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:49:50.314566 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 3/4] 10.222.0.49 () {58 vars in 1324 bytes} [Wed May 18 16:49:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 16:49:50.321641 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0687f-4851-44f9-ab00-08c58ece40f0 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:49:50.336359 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0687f-4851-44f9-ab00-08c58ece40f0 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:49:50.340833 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f264c7-85c0-48f9-9805-1c0acf34356a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:49:50.341991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f264c7-85c0-48f9-9805-1c0acf34356a admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:50.342275 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f264c7-85c0-48f9-9805-1c0acf34356a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:50.342555 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f264c7-85c0-48f9-9805-1c0acf34356a admin admin] PATH_INFO: `/v3/projects/a76edbb694024faba6c3d4a9e9057ee3` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:50.344166 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f264c7-85c0-48f9-9805-1c0acf34356a admin admin] RBAC: Authorizing `identity:get_project(project_id=a76edbb694024faba6c3d4a9e9057ee3)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:49:50.396854 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e1f264c7-85c0-48f9-9805-1c0acf34356a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 18 16:49:50.397452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f264c7-85c0-48f9-9805-1c0acf34356a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:49:50.401848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 2/5] 10.222.0.49 () {56 vars in 1207 bytes} [Wed May 18 16:49:50 2022] GET /identity/v3/projects/a76edbb694024faba6c3d4a9e9057ee3 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:49:52.649069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d70943-6a14-4d93-a04b-54c2f7cce2b4 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:52.649611 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d70943-6a14-4d93-a04b-54c2f7cce2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:52.649611 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d70943-6a14-4d93-a04b-54c2f7cce2b4 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:52.653742 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 4/6] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:49:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:49:52.659358 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654dc8f-4dc2-496a-8411-bb05bafb2257 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:52.659758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654dc8f-4dc2-496a-8411-bb05bafb2257 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:52.659921 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654dc8f-4dc2-496a-8411-bb05bafb2257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:52.679620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2654dc8f-4dc2-496a-8411-bb05bafb2257 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:49:52.681177 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2654dc8f-4dc2-496a-8411-bb05bafb2257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:49:52.689169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 3/7] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:49:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 18 16:49:52.712217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d70943-6a14-4d93-a04b-54c2f7cce2b4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:49:52.724284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d70943-6a14-4d93-a04b-54c2f7cce2b4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:49:52.728515 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db111ee3-17d6-4bdf-8e8e-c995199a4ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:49:52.729141 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db111ee3-17d6-4bdf-8e8e-c995199a4ede admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:52.729428 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db111ee3-17d6-4bdf-8e8e-c995199a4ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:52.729738 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db111ee3-17d6-4bdf-8e8e-c995199a4ede admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:52.737367 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db111ee3-17d6-4bdf-8e8e-c995199a4ede admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:49:52.739160 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db111ee3-17d6-4bdf-8e8e-c995199a4ede admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:49:52.748430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 5/8] 10.222.0.49 () {58 vars in 1324 bytes} [Wed May 18 16:49:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 18 16:49:52.754058 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654dc8f-4dc2-496a-8411-bb05bafb2257 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:49:52.763921 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654dc8f-4dc2-496a-8411-bb05bafb2257 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:49:52.768428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a2377-7141-4193-ad02-0691f8e854b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:49:52.769295 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a2377-7141-4193-ad02-0691f8e854b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:52.769583 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a2377-7141-4193-ad02-0691f8e854b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:52.769891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a2377-7141-4193-ad02-0691f8e854b5 admin admin] PATH_INFO: `/v3/users/4f9da66f38394711b45d0352bd9b4158` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:52.771288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a2377-7141-4193-ad02-0691f8e854b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=4f9da66f38394711b45d0352bd9b4158)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:49:52.773174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a2377-7141-4193-ad02-0691f8e854b5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:49:52.774781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 4/9] 10.222.0.49 () {56 vars in 1198 bytes} [Wed May 18 16:49:52 2022] GET /identity/v3/users/4f9da66f38394711b45d0352bd9b4158 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:49:55.063432 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eccba-82b2-4542-87b4-fa13ce3a095c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:55.063954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eccba-82b2-4542-87b4-fa13ce3a095c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:55.063954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eccba-82b2-4542-87b4-fa13ce3a095c None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:55.065329 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:49:55.071502 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa278b-90ed-4a0f-bea6-6d680ac53fe2 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:55.072776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa278b-90ed-4a0f-bea6-6d680ac53fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:55.073056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa278b-90ed-4a0f-bea6-6d680ac53fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:55.091238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a5fa278b-90ed-4a0f-bea6-6d680ac53fe2 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:49:55.091908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc366a4-0b13-4c79-9791-690a83d60ca0 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:55.092198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc366a4-0b13-4c79-9791-690a83d60ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:55.092433 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a5fa278b-90ed-4a0f-bea6-6d680ac53fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:49:55.092521 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc366a4-0b13-4c79-9791-690a83d60ca0 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:55.093841 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 7/11] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:49:55.099068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b1f3b-1aa4-41bf-88b7-56b40e8203c9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:55.099359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b1f3b-1aa4-41bf-88b7-56b40e8203c9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:55.099643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b1f3b-1aa4-41bf-88b7-56b40e8203c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:55.139714 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG passlib.handlers.bcrypt [None req-782b1f3b-1aa4-41bf-88b7-56b40e8203c9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80344) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 18 16:49:55.140132 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG passlib.handlers.bcrypt [None req-782b1f3b-1aa4-41bf-88b7-56b40e8203c9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80344) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 18 16:49:55.190980 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-782b1f3b-1aa4-41bf-88b7-56b40e8203c9 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:49:55.192604 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-782b1f3b-1aa4-41bf-88b7-56b40e8203c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:49:55.193831 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 5/12] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:49:55.217578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa278b-90ed-4a0f-bea6-6d680ac53fe2 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:49:55.242608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:49:55.303546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 8/13] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:49:55.331451 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b1f3b-1aa4-41bf-88b7-56b40e8203c9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:49:55.348604 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa278b-90ed-4a0f-bea6-6d680ac53fe2 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:49:55.395647 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3689a6-1e7f-4802-9605-6704f7d53820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:49:55.396487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3689a6-1e7f-4802-9605-6704f7d53820 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:55.396775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3689a6-1e7f-4802-9605-6704f7d53820 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:55.397066 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3689a6-1e7f-4802-9605-6704f7d53820 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:55.413803 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3689a6-1e7f-4802-9605-6704f7d53820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:49:55.427315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-fc3689a6-1e7f-4802-9605-6704f7d53820 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:49:55.427315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:49:55.427315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:49:55.427315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:49:55.427315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:49:55.427315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:49:55.427315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:49:55.427315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:49:55.427315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:49:55.427315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:49:55.427315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:49:55.427315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:49:55.427315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:49:55.427315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:49:55.427315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:49:55.427315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:49:55.429286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:49:55.429286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:49:55.429286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:49:55.429286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:49:55.429286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:49:55.429286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:49:55.429286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:49:55.429286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:49:55.429286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:49:55.429286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:49:55.429286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:49:55.429286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:49:55.429286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:49:55.429286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:49:55.429286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:49:55.429286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:49:55.435291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:49:55.435291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:49:55.435291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:49:55.435291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:49:55.435291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:49:55.435291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:49:55.435291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:49:55.435291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:49:55.435291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:49:55.435291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:49:55.435291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:49:55.435291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:49:55.435291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 6/14] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:49:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:49:55.445218 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3689a6-1e7f-4802-9605-6704f7d53820 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:49:55.562108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b1f3b-1aa4-41bf-88b7-56b40e8203c9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:49:55.565793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:49:55.619538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73801a0a-24dc-4d2b-b23b-6590550b3f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:49:55.620401 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73801a0a-24dc-4d2b-b23b-6590550b3f95 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:55.620701 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73801a0a-24dc-4d2b-b23b-6590550b3f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:55.620980 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73801a0a-24dc-4d2b-b23b-6590550b3f95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:55.651031 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:49:55.672758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3689a6-1e7f-4802-9605-6704f7d53820 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:49:55.707654 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73801a0a-24dc-4d2b-b23b-6590550b3f95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:49:55.710505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73801a0a-24dc-4d2b-b23b-6590550b3f95 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:49:55.714096 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed00a3-cfd5-4110-a680-d6f452ae8838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:49:55.714775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed00a3-cfd5-4110-a680-d6f452ae8838 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:55.715066 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed00a3-cfd5-4110-a680-d6f452ae8838 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:55.715752 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed00a3-cfd5-4110-a680-d6f452ae8838 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:55.716528 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed00a3-cfd5-4110-a680-d6f452ae8838 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:49:55.716838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed00a3-cfd5-4110-a680-d6f452ae8838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:49:55.718278 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed00a3-cfd5-4110-a680-d6f452ae8838 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:49:55.731663 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 7/15] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:49:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:49:55.737227 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed00a3-cfd5-4110-a680-d6f452ae8838 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:49:55.821974 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 9/16] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:49:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 16:49:55.828103 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73801a0a-24dc-4d2b-b23b-6590550b3f95 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:49:55.832293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:49:55.849797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed00a3-cfd5-4110-a680-d6f452ae8838 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:49:55.889482 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a71d9-4cc5-4f62-bcbb-4ecd8cfd0a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:49:55.890336 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a71d9-4cc5-4f62-bcbb-4ecd8cfd0a37 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:55.890598 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a71d9-4cc5-4f62-bcbb-4ecd8cfd0a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:55.890880 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a71d9-4cc5-4f62-bcbb-4ecd8cfd0a37 None admin] PATH_INFO: `/v3/users/4f9da66f38394711b45d0352bd9b4158` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:55.892236 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a71d9-4cc5-4f62-bcbb-4ecd8cfd0a37 None admin] RBAC: Authorizing `identity:get_user(user_id=4f9da66f38394711b45d0352bd9b4158)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:49:55.893776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a71d9-4cc5-4f62-bcbb-4ecd8cfd0a37 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:49:55.895509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 8/17] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:49:55 2022] GET /identity/v3/users/4f9da66f38394711b45d0352bd9b4158 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:49:55.901126 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a71d9-4cc5-4f62-bcbb-4ecd8cfd0a37 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:49:55.916989 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:49:55.944043 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73801a0a-24dc-4d2b-b23b-6590550b3f95 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:49:55.979349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3db830-ee51-41c6-a44b-11365236eb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:49:55.980150 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3db830-ee51-41c6-a44b-11365236eb25 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:55.980426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3db830-ee51-41c6-a44b-11365236eb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:55.980696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3db830-ee51-41c6-a44b-11365236eb25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:56.003739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3db830-ee51-41c6-a44b-11365236eb25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:49:56.005813 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3db830-ee51-41c6-a44b-11365236eb25 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:49:56.020341 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a71d9-4cc5-4f62-bcbb-4ecd8cfd0a37 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:49:56.030312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-4e3db830-ee51-41c6-a44b-11365236eb25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:49:56.030312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:49:56.030312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:49:56.030312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:49:56.030312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:49:56.030312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:49:56.030312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:49:56.030312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:49:56.030312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:49:56.030312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:49:56.030312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:49:56.030312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:49:56.030312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:49:56.030312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:49:56.030312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:49:56.031195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:49:56.031195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:49:56.031195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:49:56.031195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:49:56.031195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:49:56.031195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:49:56.031195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:49:56.031195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:49:56.031195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:49:56.031195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:49:56.031195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:49:56.031195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:49:56.031195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:49:56.031195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:49:56.031195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:49:56.031195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:49:56.031195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:49:56.032179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:49:56.032179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:49:56.032179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:49:56.032179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:49:56.032179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 10/18] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:49:56.037449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3db830-ee51-41c6-a44b-11365236eb25 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:49:56.073433 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeba2d8-c0b3-4c2c-b1d5-6ef27b529ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:49:56.074392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba2d8-c0b3-4c2c-b1d5-6ef27b529ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:56.074677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba2d8-c0b3-4c2c-b1d5-6ef27b529ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:56.074949 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba2d8-c0b3-4c2c-b1d5-6ef27b529ef2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:56.076467 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeba2d8-c0b3-4c2c-b1d5-6ef27b529ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:49:56.077973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeba2d8-c0b3-4c2c-b1d5-6ef27b529ef2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:49:56.079976 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 9/19] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:49:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:49:56.086160 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeba2d8-c0b3-4c2c-b1d5-6ef27b529ef2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:49:56.116207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:49:56.175929 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3db830-ee51-41c6-a44b-11365236eb25 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:49:56.187037 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:49:56.209101 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeba2d8-c0b3-4c2c-b1d5-6ef27b529ef2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:49:56.212382 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca4897-7978-4bdd-bd39-04e3e67053b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:49:56.213156 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca4897-7978-4bdd-bd39-04e3e67053b7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:56.213444 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca4897-7978-4bdd-bd39-04e3e67053b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:56.213759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca4897-7978-4bdd-bd39-04e3e67053b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:56.214595 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca4897-7978-4bdd-bd39-04e3e67053b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:49:56.214902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca4897-7978-4bdd-bd39-04e3e67053b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:49:56.216488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca4897-7978-4bdd-bd39-04e3e67053b7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:49:56.236569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:49:56.248448 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d727be1-4cd7-4e52-a475-71396b07742e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:49:56.249134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d727be1-4cd7-4e52-a475-71396b07742e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:56.249418 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d727be1-4cd7-4e52-a475-71396b07742e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:56.249731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d727be1-4cd7-4e52-a475-71396b07742e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:56.250606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d727be1-4cd7-4e52-a475-71396b07742e None admin] RBAC: Adding query filter params (role.id=b3f3f4910bf646699f30b749edeef422, scope.domain.id=default, user.id=4f9da66f38394711b45d0352bd9b4158) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:49:56.250918 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d727be1-4cd7-4e52-a475-71396b07742e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:49:56.252443 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d727be1-4cd7-4e52-a475-71396b07742e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:49:56.260540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1322 bytes} [Wed May 18 16:49:56 2022] GET /identity/v3/role_assignments?user.id=4f9da66f38394711b45d0352bd9b4158&scope.domain.id=default&role.id=b3f3f4910bf646699f30b749edeef422 => generated 233 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:49:58.805948 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3062e3-5f49-49ca-ae91-93f87180629f None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:58.806463 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3062e3-5f49-49ca-ae91-93f87180629f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:58.806535 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3062e3-5f49-49ca-ae91-93f87180629f None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:58.807896 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:49:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:49:58.813534 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acdfca-709a-47c7-9b5f-eb78d8b54d64 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:58.813995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acdfca-709a-47c7-9b5f-eb78d8b54d64 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:58.814205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acdfca-709a-47c7-9b5f-eb78d8b54d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:58.836179 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c5acdfca-709a-47c7-9b5f-eb78d8b54d64 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:49:58.837588 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c5acdfca-709a-47c7-9b5f-eb78d8b54d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:49:58.939895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 11/23] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:49:58.975143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3062e3-5f49-49ca-ae91-93f87180629f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:49:59.102528 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a13e1b-cf70-457c-ba34-fe680b5a09bf None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:59.103722 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a13e1b-cf70-457c-ba34-fe680b5a09bf None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:59.104009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a13e1b-cf70-457c-ba34-fe680b5a09bf None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:59.105576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 12/24] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:49:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:49:59.111351 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0521941-e9fe-403d-b98e-79eae8f7d0a3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:59.111646 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0521941-e9fe-403d-b98e-79eae8f7d0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:59.111932 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0521941-e9fe-403d-b98e-79eae8f7d0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:59.145747 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a0521941-e9fe-403d-b98e-79eae8f7d0a3 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:49:59.146977 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a0521941-e9fe-403d-b98e-79eae8f7d0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:49:59.173001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3062e3-5f49-49ca-ae91-93f87180629f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:49:59.209553 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:49:59.231113 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113613b-c5ab-45d3-a249-02c5c8259462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:49:59.231893 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113613b-c5ab-45d3-a249-02c5c8259462 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:59.232207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113613b-c5ab-45d3-a249-02c5c8259462 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:59.232559 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113613b-c5ab-45d3-a249-02c5c8259462 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:59.233405 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113613b-c5ab-45d3-a249-02c5c8259462 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:49:59.234882 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113613b-c5ab-45d3-a249-02c5c8259462 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:49:59.351854 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 13/25] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:49:59.352996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e204154-f6c0-4f54-920b-70e08780ddc7 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:59.353293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e204154-f6c0-4f54-920b-70e08780ddc7 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:59.353573 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e204154-f6c0-4f54-920b-70e08780ddc7 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:59.355042 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 14/26] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:49:59.363257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f4ce6-b8fe-40d8-b694-e62dd07b2f1e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:59.363539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f4ce6-b8fe-40d8-b694-e62dd07b2f1e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:59.363826 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f4ce6-b8fe-40d8-b694-e62dd07b2f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:59.384664 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:49:59.395777 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 13/27] 10.222.0.49 () {60 vars in 1131 bytes} [Wed May 18 16:49:58 2022] POST /identity/v3/roles => generated 219 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:49:59.397062 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113613b-c5ab-45d3-a249-02c5c8259462 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:49:59.403719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-046f4ce6-b8fe-40d8-b694-e62dd07b2f1e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:49:59.405180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-046f4ce6-b8fe-40d8-b694-e62dd07b2f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:49:59.526952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113613b-c5ab-45d3-a249-02c5c8259462 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:49:59.572192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccc01a-0cf8-4ac4-b38c-73416852b58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:49:59.573061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccc01a-0cf8-4ac4-b38c-73416852b58c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:59.573351 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccc01a-0cf8-4ac4-b38c-73416852b58c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:59.573941 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccc01a-0cf8-4ac4-b38c-73416852b58c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:59.589488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccc01a-0cf8-4ac4-b38c-73416852b58c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:49:59.592130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 15/28] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:49:59.598991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e1ccc01a-0cf8-4ac4-b38c-73416852b58c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:49:59.598991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:49:59.598991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:49:59.598991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:49:59.598991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:49:59.598991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:49:59.598991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:49:59.598991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:49:59.598991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:49:59.598991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:49:59.598991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:49:59.598991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:49:59.598991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:49:59.598991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:49:59.598991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:49:59.598991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:49:59.599899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:49:59.599899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:49:59.599899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:49:59.599899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:49:59.599899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:49:59.599899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:49:59.599899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:49:59.599899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:49:59.599899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:49:59.599899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:49:59.599899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:49:59.599899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:49:59.599899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:49:59.599899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:49:59.599899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:49:59.599899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:49:59.600637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:49:59.600637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:49:59.600637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:49:59.600637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:49:59.600637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:49:59.600637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:49:59.600637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:49:59.600637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:49:59.600637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:49:59.600637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:49:59.600637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:49:59.600637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:49:59.601286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 14/29] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:49:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:49:59.606547 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f4ce6-b8fe-40d8-b694-e62dd07b2f1e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:49:59.607122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc95c3-33ec-49fd-813f-75df93980a37 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:59.607418 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc95c3-33ec-49fd-813f-75df93980a37 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:59.607709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc95c3-33ec-49fd-813f-75df93980a37 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:59.609253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 15/30] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:49:59.617058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e52659-e959-4b3f-b9c9-bf9d4686e884 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:59.617356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e52659-e959-4b3f-b9c9-bf9d4686e884 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:59.617626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e52659-e959-4b3f-b9c9-bf9d4686e884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:59.639327 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-40e52659-e959-4b3f-b9c9-bf9d4686e884 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:49:59.641141 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-40e52659-e959-4b3f-b9c9-bf9d4686e884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:49:59.677300 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:49:59.735116 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 16/31] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:49:59.736075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e52659-e959-4b3f-b9c9-bf9d4686e884 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:49:59.809924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f4ce6-b8fe-40d8-b694-e62dd07b2f1e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:49:59.855057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027d253-c4cc-4e0e-b562-71c5b197dabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:49:59.855817 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027d253-c4cc-4e0e-b562-71c5b197dabf None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:59.856011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027d253-c4cc-4e0e-b562-71c5b197dabf None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:59.856300 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027d253-c4cc-4e0e-b562-71c5b197dabf None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:59.857122 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027d253-c4cc-4e0e-b562-71c5b197dabf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:49:59.857379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027d253-c4cc-4e0e-b562-71c5b197dabf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:49:59.858830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027d253-c4cc-4e0e-b562-71c5b197dabf None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:49:59.860372 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:49:59.872249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 16/32] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:49:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:49:59.877585 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027d253-c4cc-4e0e-b562-71c5b197dabf None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:49:59.879930 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e52659-e959-4b3f-b9c9-bf9d4686e884 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:49:59.919608 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5b9c9-6c9f-477b-a080-004ec92722d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:49:59.920413 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5b9c9-6c9f-477b-a080-004ec92722d2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:49:59.920751 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5b9c9-6c9f-477b-a080-004ec92722d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:49:59.921076 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5b9c9-6c9f-477b-a080-004ec92722d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:49:59.931900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5b9c9-6c9f-477b-a080-004ec92722d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:49:59.933648 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5b9c9-6c9f-477b-a080-004ec92722d2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:49:59.952627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-48f5b9c9-6c9f-477b-a080-004ec92722d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:49:59.952627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:49:59.952627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:49:59.952627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:49:59.952627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:49:59.952627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:49:59.952627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:49:59.952627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:49:59.952627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:49:59.952627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:49:59.952627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:49:59.952627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:49:59.952627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:49:59.952627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:49:59.952627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:49:59.953467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:49:59.953467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:49:59.953467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:49:59.953467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:49:59.953467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:49:59.953467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:49:59.953467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:49:59.953467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:49:59.953467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:49:59.953467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:49:59.953467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:49:59.953467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:49:59.953467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:49:59.953467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:49:59.953467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:49:59.953467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:49:59.953467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:49:59.954297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:49:59.954297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:49:59.954297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:49:59.954297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:49:59.954297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 17/33] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:49:59.955234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5b9c9-6c9f-477b-a080-004ec92722d2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:49:59.996897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027d253-c4cc-4e0e-b562-71c5b197dabf None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:00.014586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:00.033607 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9afdc1-3780-4b26-bc20-467955213635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:00.034330 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9afdc1-3780-4b26-bc20-467955213635 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:00.034617 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9afdc1-3780-4b26-bc20-467955213635 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:00.034896 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9afdc1-3780-4b26-bc20-467955213635 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:00.035689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9afdc1-3780-4b26-bc20-467955213635 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:00.037086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9afdc1-3780-4b26-bc20-467955213635 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:00.084887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5b9c9-6c9f-477b-a080-004ec92722d2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:00.125544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d4fea-3c5d-459c-94f3-b60417112355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:00.126742 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d4fea-3c5d-459c-94f3-b60417112355 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:00.127164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d4fea-3c5d-459c-94f3-b60417112355 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:00.127625 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d4fea-3c5d-459c-94f3-b60417112355 None admin] PATH_INFO: `/v3/users/4f9da66f38394711b45d0352bd9b4158` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:00.129504 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d4fea-3c5d-459c-94f3-b60417112355 None admin] RBAC: Authorizing `identity:get_user(user_id=4f9da66f38394711b45d0352bd9b4158)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:00.131119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d4fea-3c5d-459c-94f3-b60417112355 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:00.133481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 18/34] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:49:59 2022] GET /identity/v3/users/4f9da66f38394711b45d0352bd9b4158 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:00.134442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d4fea-3c5d-459c-94f3-b60417112355 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:00.175402 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 17/35] 10.222.0.49 () {60 vars in 1131 bytes} [Wed May 18 16:49:59 2022] POST /identity/v3/roles => generated 225 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:50:00.176522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9afdc1-3780-4b26-bc20-467955213635 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:00.246255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:00.251964 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:00.267677 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d4fea-3c5d-459c-94f3-b60417112355 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:00.305921 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9afdc1-3780-4b26-bc20-467955213635 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:00.308156 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd08e4-c5da-4d81-9736-915fc99f6edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:00.310242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd08e4-c5da-4d81-9736-915fc99f6edb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:00.310242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd08e4-c5da-4d81-9736-915fc99f6edb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:00.310242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd08e4-c5da-4d81-9736-915fc99f6edb None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:00.310969 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd08e4-c5da-4d81-9736-915fc99f6edb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:00.311279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd08e4-c5da-4d81-9736-915fc99f6edb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:00.312700 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd08e4-c5da-4d81-9736-915fc99f6edb None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:00.330904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 19/36] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:00.338897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd08e4-c5da-4d81-9736-915fc99f6edb None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:00.350409 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f0ad5-ca56-40f2-81e2-0a1ffcb7ac20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:00.352049 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f0ad5-ca56-40f2-81e2-0a1ffcb7ac20 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:00.352486 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f0ad5-ca56-40f2-81e2-0a1ffcb7ac20 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:00.352915 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f0ad5-ca56-40f2-81e2-0a1ffcb7ac20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:00.354441 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f0ad5-ca56-40f2-81e2-0a1ffcb7ac20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:00.356186 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f0ad5-ca56-40f2-81e2-0a1ffcb7ac20 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:00.362869 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 18/37] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:50:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:00.364516 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f0ad5-ca56-40f2-81e2-0a1ffcb7ac20 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:00.509392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd08e4-c5da-4d81-9736-915fc99f6edb None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:00.518113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f0ad5-ca56-40f2-81e2-0a1ffcb7ac20 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:00.548824 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:00.563847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f85a0f-f354-42f0-834b-185b6a0397b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:00.564309 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f85a0f-f354-42f0-834b-185b6a0397b8 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:00.564699 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f85a0f-f354-42f0-834b-185b6a0397b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:00.564982 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f85a0f-f354-42f0-834b-185b6a0397b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:00.565132 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a12f8e-88f2-4117-abfd-d219a9783c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:00.568162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f85a0f-f354-42f0-834b-185b6a0397b8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:00.568280 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a12f8e-88f2-4117-abfd-d219a9783c13 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:00.568280 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a12f8e-88f2-4117-abfd-d219a9783c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:00.568280 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a12f8e-88f2-4117-abfd-d219a9783c13 None admin] PATH_INFO: `/v3/domains/default/users/4f9da66f38394711b45d0352bd9b4158/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:00.568457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f85a0f-f354-42f0-834b-185b6a0397b8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:00.568712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a12f8e-88f2-4117-abfd-d219a9783c13 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4f9da66f38394711b45d0352bd9b4158, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:00.570748 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a12f8e-88f2-4117-abfd-d219a9783c13 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:00.593731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 19/38] 10.222.0.49 () {58 vars in 1361 bytes} [Wed May 18 16:50:00 2022] PUT /identity/v3/domains/default/users/4f9da66f38394711b45d0352bd9b4158/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:50:00.594288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136557cd-7e94-469a-91e0-3b7b1222bca4 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:00.594583 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136557cd-7e94-469a-91e0-3b7b1222bca4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:00.594883 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136557cd-7e94-469a-91e0-3b7b1222bca4 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:00.596412 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 20/39] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:00.598976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:00.602199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7301e-4515-49f8-9a8c-203bbdfed9bf None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:00.602461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7301e-4515-49f8-9a8c-203bbdfed9bf None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:00.602742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7301e-4515-49f8-9a8c-203bbdfed9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:00.614574 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 20/40] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 18 16:50:00 2022] POST /identity/v3/projects => generated 301 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:50:00.625194 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2fe7301e-4515-49f8-9a8c-203bbdfed9bf None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:00.627043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2fe7301e-4515-49f8-9a8c-203bbdfed9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:00.729389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 21/41] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:50:00.757827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f85a0f-f354-42f0-834b-185b6a0397b8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:00.881206 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f85a0f-f354-42f0-834b-185b6a0397b8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:00.921353 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938220d-0a5b-4952-b4ce-45ea3511540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:00.922314 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938220d-0a5b-4952-b4ce-45ea3511540e None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:00.922737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938220d-0a5b-4952-b4ce-45ea3511540e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:00.923151 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938220d-0a5b-4952-b4ce-45ea3511540e None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:00.924063 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938220d-0a5b-4952-b4ce-45ea3511540e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:00.925578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3938220d-0a5b-4952-b4ce-45ea3511540e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:00.942105 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 21/42] 10.222.0.49 () {60 vars in 1131 bytes} [Wed May 18 16:50:00 2022] POST /identity/v3/roles => generated 223 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:50:00.975247 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0caea96-b0db-4f47-ab9f-c62d17903122 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:00.975785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0caea96-b0db-4f47-ab9f-c62d17903122 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:00.975896 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0caea96-b0db-4f47-ab9f-c62d17903122 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:00.977953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 22/43] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:00.983566 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c843dc-98bc-4423-9109-dfedea2183a1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:00.983864 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c843dc-98bc-4423-9109-dfedea2183a1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:00.984136 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c843dc-98bc-4423-9109-dfedea2183a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:01.003251 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c5c843dc-98bc-4423-9109-dfedea2183a1 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:01.004475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c5c843dc-98bc-4423-9109-dfedea2183a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:01.077955 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:01.095530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 22/44] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:01.119827 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0caea96-b0db-4f47-ab9f-c62d17903122 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:01.232976 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0caea96-b0db-4f47-ab9f-c62d17903122 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:01.247357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:01.269022 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a167a0-d471-4bf7-951c-8f68d5e2d40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:01.269855 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a167a0-d471-4bf7-951c-8f68d5e2d40e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:01.270149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a167a0-d471-4bf7-951c-8f68d5e2d40e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:01.270434 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a167a0-d471-4bf7-951c-8f68d5e2d40e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:01.271633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a167a0-d471-4bf7-951c-8f68d5e2d40e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:01.273638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a167a0-d471-4bf7-951c-8f68d5e2d40e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:01.275309 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 23/45] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:50:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:01.280922 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c843dc-98bc-4423-9109-dfedea2183a1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:01.381369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c843dc-98bc-4423-9109-dfedea2183a1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:01.418514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bf2b6-1d21-45a9-b530-2037b95bddb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:01.419176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bf2b6-1d21-45a9-b530-2037b95bddb3 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:01.419489 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bf2b6-1d21-45a9-b530-2037b95bddb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:01.419766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bf2b6-1d21-45a9-b530-2037b95bddb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:01.420468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bf2b6-1d21-45a9-b530-2037b95bddb3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:01.421965 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bf2b6-1d21-45a9-b530-2037b95bddb3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:01.448226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 23/46] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 18 16:50:01 2022] POST /identity/v3/projects => generated 312 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:50:02.968064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f903b-adad-4dec-b831-3da69779ed90 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:02.968576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f903b-adad-4dec-b831-3da69779ed90 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:02.968686 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f903b-adad-4dec-b831-3da69779ed90 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:02.970040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 24/47] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:02.975684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41989c85-5574-4f2d-adc4-bc2595313b57 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:02.976141 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41989c85-5574-4f2d-adc4-bc2595313b57 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:02.976284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41989c85-5574-4f2d-adc4-bc2595313b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:02.996366 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-41989c85-5574-4f2d-adc4-bc2595313b57 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:02.997579 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-41989c85-5574-4f2d-adc4-bc2595313b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:03.036352 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:03.078159 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 24/48] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:03.102911 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f903b-adad-4dec-b831-3da69779ed90 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:03.223579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f903b-adad-4dec-b831-3da69779ed90 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:03.258957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5357c5-d8bc-4766-94d8-ce539b0a5aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:03.259765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5357c5-d8bc-4766-94d8-ce539b0a5aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:03.260055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5357c5-d8bc-4766-94d8-ce539b0a5aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:03.260336 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5357c5-d8bc-4766-94d8-ce539b0a5aa3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:03.270708 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5357c5-d8bc-4766-94d8-ce539b0a5aa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:03.278870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-7a5357c5-d8bc-4766-94d8-ce539b0a5aa3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:50:03.278870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:03.278870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:03.278870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:03.278870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:03.278870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:03.278870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:03.278870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:03.278870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:03.278870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:03.278870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:03.278870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:03.278870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:03.278870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:03.278870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:03.278870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:03.279731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:03.279731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:03.279731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:03.279731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:03.279731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:03.279731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:03.279731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:03.279731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:03.279731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:03.279731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:03.279731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:03.279731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:03.279731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:03.279731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:03.279731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:03.279731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:03.280469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:03.280469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:03.280469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:03.280469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:03.280469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:03.280469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:03.280469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:03.280469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:03.280469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:03.280469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:03.280469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:50:03.280469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:03.280469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 25/49] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:50:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:03.286001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41989c85-5574-4f2d-adc4-bc2595313b57 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:03.394641 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41989c85-5574-4f2d-adc4-bc2595313b57 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:03.439496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842ed01-f583-4902-a41c-f0e661457134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:03.440173 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842ed01-f583-4902-a41c-f0e661457134 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:03.440460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842ed01-f583-4902-a41c-f0e661457134 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:03.440741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842ed01-f583-4902-a41c-f0e661457134 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:03.441508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842ed01-f583-4902-a41c-f0e661457134 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:03.441852 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842ed01-f583-4902-a41c-f0e661457134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:03.443261 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842ed01-f583-4902-a41c-f0e661457134 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:03.455828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 25/50] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:03.461776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5357c5-d8bc-4766-94d8-ce539b0a5aa3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:03.507919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:03.574345 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5357c5-d8bc-4766-94d8-ce539b0a5aa3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:03.608791 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d4259-4a9d-43be-8373-4cb3c968a70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:03.609713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d4259-4a9d-43be-8373-4cb3c968a70a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:03.610156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d4259-4a9d-43be-8373-4cb3c968a70a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:03.610288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d4259-4a9d-43be-8373-4cb3c968a70a None admin] PATH_INFO: `/v3/users/4f9da66f38394711b45d0352bd9b4158` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:03.611476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d4259-4a9d-43be-8373-4cb3c968a70a None admin] RBAC: Authorizing `identity:get_user(user_id=4f9da66f38394711b45d0352bd9b4158)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:03.612931 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d4259-4a9d-43be-8373-4cb3c968a70a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:03.614631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 26/51] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:03 2022] GET /identity/v3/users/4f9da66f38394711b45d0352bd9b4158 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:03.620181 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842ed01-f583-4902-a41c-f0e661457134 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:03.656878 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:03.731211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842ed01-f583-4902-a41c-f0e661457134 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:03.738651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f86c8b-6235-48d6-9182-072c274f297b None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:03.739119 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f86c8b-6235-48d6-9182-072c274f297b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:03.739538 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f86c8b-6235-48d6-9182-072c274f297b None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:03.741144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 27/52] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:50:03.749415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f89a6-3bb0-4b62-a33a-ad0286ffa992 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:03.749908 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f89a6-3bb0-4b62-a33a-ad0286ffa992 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:03.750383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f89a6-3bb0-4b62-a33a-ad0286ffa992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:03.769731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a60f89a6-3bb0-4b62-a33a-ad0286ffa992 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:03.770966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a60f89a6-3bb0-4b62-a33a-ad0286ffa992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:03.771487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b0370-a72a-4707-bcd9-1ba5922b9c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:03.773497 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b0370-a72a-4707-bcd9-1ba5922b9c68 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:03.774200 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b0370-a72a-4707-bcd9-1ba5922b9c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:03.774708 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b0370-a72a-4707-bcd9-1ba5922b9c68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:03.776800 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b0370-a72a-4707-bcd9-1ba5922b9c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:03.779456 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b0370-a72a-4707-bcd9-1ba5922b9c68 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:03.782649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:50:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:03.788444 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b0370-a72a-4707-bcd9-1ba5922b9c68 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:03.843672 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 28/54] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:50:03.866897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f89a6-3bb0-4b62-a33a-ad0286ffa992 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:03.893277 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:03.896840 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b0370-a72a-4707-bcd9-1ba5922b9c68 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:03.911550 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:03.935495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419477f-41db-4d81-92a9-e1885d8adb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:03.936163 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419477f-41db-4d81-92a9-e1885d8adb87 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:03.936452 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419477f-41db-4d81-92a9-e1885d8adb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:03.936739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419477f-41db-4d81-92a9-e1885d8adb87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:03.937590 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419477f-41db-4d81-92a9-e1885d8adb87 None admin] RBAC: Adding query filter params (role.id=b3f3f4910bf646699f30b749edeef422, scope.domain.id=default, user.id=4f9da66f38394711b45d0352bd9b4158) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:03.937941 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419477f-41db-4d81-92a9-e1885d8adb87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:03.939405 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419477f-41db-4d81-92a9-e1885d8adb87 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:03.949760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1322 bytes} [Wed May 18 16:50:03 2022] GET /identity/v3/role_assignments?user.id=4f9da66f38394711b45d0352bd9b4158&scope.domain.id=default&role.id=b3f3f4910bf646699f30b749edeef422 => generated 530 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:03.975972 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f89a6-3bb0-4b62-a33a-ad0286ffa992 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:04.016002 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b8172-1c7a-4efb-bbba-82d0f1faf752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:04.016838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b8172-1c7a-4efb-bbba-82d0f1faf752 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:04.017131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b8172-1c7a-4efb-bbba-82d0f1faf752 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:04.017417 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b8172-1c7a-4efb-bbba-82d0f1faf752 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:04.018819 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b8172-1c7a-4efb-bbba-82d0f1faf752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:04.020429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b8172-1c7a-4efb-bbba-82d0f1faf752 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:04.022233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 29/56] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:50:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:04.028272 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419477f-41db-4d81-92a9-e1885d8adb87 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:04.143382 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419477f-41db-4d81-92a9-e1885d8adb87 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:04.180402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d535a-de0d-422a-87a0-89e56f5489dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:04.181072 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d535a-de0d-422a-87a0-89e56f5489dc None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:04.181361 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d535a-de0d-422a-87a0-89e56f5489dc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:04.181642 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d535a-de0d-422a-87a0-89e56f5489dc None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:04.182423 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d535a-de0d-422a-87a0-89e56f5489dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:04.183903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d535a-de0d-422a-87a0-89e56f5489dc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:04.211171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 28/57] 10.222.0.49 () {60 vars in 1140 bytes} [Wed May 18 16:50:04 2022] POST /identity/v3/projects => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 16:50:06.468242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1b710-09fe-4b22-8477-5dfe42f76cb3 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:06.468789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1b710-09fe-4b22-8477-5dfe42f76cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:06.468789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1b710-09fe-4b22-8477-5dfe42f76cb3 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:06.470249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 30/58] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:06.476057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d178f9-c569-41eb-b2c6-6b674bfb022c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:06.476527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d178f9-c569-41eb-b2c6-6b674bfb022c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:06.476613 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d178f9-c569-41eb-b2c6-6b674bfb022c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:06.494439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f8d178f9-c569-41eb-b2c6-6b674bfb022c None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:06.495639 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f8d178f9-c569-41eb-b2c6-6b674bfb022c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:06.506567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:06.564411 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 29/59] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:06.589546 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1b710-09fe-4b22-8477-5dfe42f76cb3 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:06.689832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1b710-09fe-4b22-8477-5dfe42f76cb3 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:06.700037 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:06.725840 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ef772-f936-4ff8-b0a3-12cb1554df0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:06.726605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ef772-f936-4ff8-b0a3-12cb1554df0e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:06.726896 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ef772-f936-4ff8-b0a3-12cb1554df0e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:06.727175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ef772-f936-4ff8-b0a3-12cb1554df0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:06.728355 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ef772-f936-4ff8-b0a3-12cb1554df0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:06.729851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ef772-f936-4ff8-b0a3-12cb1554df0e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:06.731512 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 31/60] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:50:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:06.737009 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d178f9-c569-41eb-b2c6-6b674bfb022c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:06.842433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d178f9-c569-41eb-b2c6-6b674bfb022c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:06.877839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3593d32-c987-4119-babb-54832286e803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:06.878518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3593d32-c987-4119-babb-54832286e803 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:06.878806 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3593d32-c987-4119-babb-54832286e803 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:06.879091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3593d32-c987-4119-babb-54832286e803 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:06.879811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3593d32-c987-4119-babb-54832286e803 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:06.881282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3593d32-c987-4119-babb-54832286e803 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:06.910154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 30/61] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 18 16:50:06 2022] POST /identity/v3/users => generated 275 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:50:10.439296 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850fb3b-c0e3-47d9-ad04-fcc01c179f6b None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:10.440349 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850fb3b-c0e3-47d9-ad04-fcc01c179f6b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:10.440842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850fb3b-c0e3-47d9-ad04-fcc01c179f6b None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:10.442829 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 32/62] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:10.448685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8302825-0ccc-4ad5-b00a-45d110aff458 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:10.449600 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8302825-0ccc-4ad5-b00a-45d110aff458 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:10.450139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8302825-0ccc-4ad5-b00a-45d110aff458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:10.455829 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:10.477179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a8302825-0ccc-4ad5-b00a-45d110aff458 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:10.478466 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a8302825-0ccc-4ad5-b00a-45d110aff458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:10.551486 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47077d60-7a3e-4ac4-99c5-1d9ec6ff3ad3 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:10.552135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47077d60-7a3e-4ac4-99c5-1d9ec6ff3ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:10.552618 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47077d60-7a3e-4ac4-99c5-1d9ec6ff3ad3 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:10.554943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 33/63] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:50:10.561106 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599c486-9c93-41e3-9695-d366a59f6ed3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:10.561777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599c486-9c93-41e3-9695-d366a59f6ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:10.562263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599c486-9c93-41e3-9695-d366a59f6ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:10.591078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 31/64] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:10.614796 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5599c486-9c93-41e3-9695-d366a59f6ed3 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:10.617009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5599c486-9c93-41e3-9695-d366a59f6ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:10.617467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8302825-0ccc-4ad5-b00a-45d110aff458 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:10.731105 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8302825-0ccc-4ad5-b00a-45d110aff458 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:10.766820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:10.771286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cac5ae-389c-4e7c-9828-dcb806d2444b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:10.772960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cac5ae-389c-4e7c-9828-dcb806d2444b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:10.773402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cac5ae-389c-4e7c-9828-dcb806d2444b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:10.773895 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cac5ae-389c-4e7c-9828-dcb806d2444b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:10.785712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 34/65] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:50:10.787291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcb857-56a4-4c37-b304-2c397cdae010 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:10.787766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcb857-56a4-4c37-b304-2c397cdae010 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:10.788742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dcb857-56a4-4c37-b304-2c397cdae010 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:10.789030 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cac5ae-389c-4e7c-9828-dcb806d2444b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:10.790747 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 35/66] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:10.801385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a2cac5ae-389c-4e7c-9828-dcb806d2444b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:50:10.801385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:10.801385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:10.801385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:10.801385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:10.801385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:10.801385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:10.801385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:10.801385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:10.801385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:10.801385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:10.801385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:10.801385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:10.801385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:10.801385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:10.801385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:10.802524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:10.802524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:10.802524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:10.802524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:10.802524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:10.802524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:10.802524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:10.802524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:10.802524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:10.802524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:10.802524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:10.802524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:10.802524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:10.802524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:10.802524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:10.802524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:10.803475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:10.803475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:10.803475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:10.803475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:10.803475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:10.803475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:10.803475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:10.803475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:10.803475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:10.803475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:10.803475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:50:10.803475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:10.804174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107856fd-f30b-4821-8623-59c110dd870b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:10.804174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107856fd-f30b-4821-8623-59c110dd870b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:10.804174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107856fd-f30b-4821-8623-59c110dd870b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:10.806141 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 32/67] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:50:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:50:10.812282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cac5ae-389c-4e7c-9828-dcb806d2444b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:10.829000 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-107856fd-f30b-4821-8623-59c110dd870b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:10.831458 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-107856fd-f30b-4821-8623-59c110dd870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:10.927884 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 36/68] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:10.929846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107856fd-f30b-4821-8623-59c110dd870b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:10.935112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cac5ae-389c-4e7c-9828-dcb806d2444b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:10.976187 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1395fe-7b15-47fe-b959-b491f44dd7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:10.977289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1395fe-7b15-47fe-b959-b491f44dd7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:10.977754 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1395fe-7b15-47fe-b959-b491f44dd7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:10.978178 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1395fe-7b15-47fe-b959-b491f44dd7f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:10.981177 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:10.992942 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1395fe-7b15-47fe-b959-b491f44dd7f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:11.001635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-7c1395fe-7b15-47fe-b959-b491f44dd7f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:11.001635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:11.001635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:11.001635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:11.001635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:11.001635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:11.001635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:11.001635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:11.001635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:11.001635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:11.001635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:11.001635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:11.001635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:11.001635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:11.001635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:11.001635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:11.002592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:11.002592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:11.002592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:11.002592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:11.002592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:11.002592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:11.002592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:11.002592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:11.002592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:11.002592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:11.002592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:11.002592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:11.002592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:11.002592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:11.002592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:11.002592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:11.003369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:11.003369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:11.003369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:11.003369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:11.003369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:11.003369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:11.003369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:11.003369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:11.003369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:11.003369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:11.003369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:11.003369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:11.006464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 33/69] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:50:11.008002 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1395fe-7b15-47fe-b959-b491f44dd7f7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:11.075283 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107856fd-f30b-4821-8623-59c110dd870b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:11.076699 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:11.121341 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7584d-1c6a-4120-b8a7-3ad005aafce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:11.122074 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7584d-1c6a-4120-b8a7-3ad005aafce8 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:11.122374 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7584d-1c6a-4120-b8a7-3ad005aafce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:11.122665 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7584d-1c6a-4120-b8a7-3ad005aafce8 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:11.123422 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7584d-1c6a-4120-b8a7-3ad005aafce8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:11.123736 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7584d-1c6a-4120-b8a7-3ad005aafce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:11.125180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7584d-1c6a-4120-b8a7-3ad005aafce8 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:11.137714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 37/70] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:11.137714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7584d-1c6a-4120-b8a7-3ad005aafce8 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:11.148040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1395fe-7b15-47fe-b959-b491f44dd7f7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:11.185623 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a030d-78f7-4de6-8f95-f81152b0e2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:11.186719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a030d-78f7-4de6-8f95-f81152b0e2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:11.187007 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a030d-78f7-4de6-8f95-f81152b0e2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:11.187289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a030d-78f7-4de6-8f95-f81152b0e2e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:11.200278 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a030d-78f7-4de6-8f95-f81152b0e2e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:11.208771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-6e7a030d-78f7-4de6-8f95-f81152b0e2e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:11.208771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:11.208771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:11.208771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:11.208771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:11.208771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:11.208771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:11.208771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:11.208771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:11.208771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:11.208771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:11.208771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:11.208771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:11.208771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:11.208771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:11.208771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:11.211762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:11.211762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:11.211762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:11.211762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:11.211762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:11.211762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:11.211762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:11.211762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:11.211762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:11.211762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:11.211762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:11.211762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:11.211762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:11.211762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:11.211762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:11.211762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:11.217902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:11.217902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:11.217902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:11.217902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:11.217902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:11.217902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:11.217902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:11.217902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:11.217902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:11.217902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:11.217902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:11.217902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:11.217902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 34/71] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:50:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:11.217902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466b169-0182-4673-8500-2aa0ef4eee40 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:11.218820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466b169-0182-4673-8500-2aa0ef4eee40 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:11.218820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466b169-0182-4673-8500-2aa0ef4eee40 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:11.218820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 35/72] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:11.218820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466b169-0182-4673-8500-2aa0ef4eee40 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:11.256447 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:11.261508 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7584d-1c6a-4120-b8a7-3ad005aafce8 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:11.296165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49730bb9-6f54-4a89-9451-183fd4a13ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:11.296845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49730bb9-6f54-4a89-9451-183fd4a13ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:11.297249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49730bb9-6f54-4a89-9451-183fd4a13ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:11.297542 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49730bb9-6f54-4a89-9451-183fd4a13ce0 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:11.298333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49730bb9-6f54-4a89-9451-183fd4a13ce0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:11.298645 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49730bb9-6f54-4a89-9451-183fd4a13ce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:11.300040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49730bb9-6f54-4a89-9451-183fd4a13ce0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:11.309041 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 38/73] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:11.309889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49730bb9-6f54-4a89-9451-183fd4a13ce0 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:11.330046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466b169-0182-4673-8500-2aa0ef4eee40 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:11.343398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:11.365545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ba03e-5625-491f-9eaa-8e98b783e313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:11.367362 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ba03e-5625-491f-9eaa-8e98b783e313 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:11.367658 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ba03e-5625-491f-9eaa-8e98b783e313 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:11.367940 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ba03e-5625-491f-9eaa-8e98b783e313 None admin] PATH_INFO: `/v3/users/4f9da66f38394711b45d0352bd9b4158` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:11.369223 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ba03e-5625-491f-9eaa-8e98b783e313 None admin] RBAC: Authorizing `identity:get_user(user_id=4f9da66f38394711b45d0352bd9b4158)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:11.370738 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ba03e-5625-491f-9eaa-8e98b783e313 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:11.372557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 36/74] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:11 2022] GET /identity/v3/users/4f9da66f38394711b45d0352bd9b4158 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:11.373707 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4f0e0-ecf7-4601-8a3e-43af289f9260 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:11.374001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4f0e0-ecf7-4601-8a3e-43af289f9260 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:11.374285 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4f0e0-ecf7-4601-8a3e-43af289f9260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:11.391091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-82f4f0e0-ecf7-4601-8a3e-43af289f9260 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:11.392320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-82f4f0e0-ecf7-4601-8a3e-43af289f9260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:11.417009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49730bb9-6f54-4a89-9451-183fd4a13ce0 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:11.451891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e2e38-b9f1-4a77-8175-ec03b4048da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:11.452607 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e2e38-b9f1-4a77-8175-ec03b4048da3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:11.452924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e2e38-b9f1-4a77-8175-ec03b4048da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:11.453198 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e2e38-b9f1-4a77-8175-ec03b4048da3 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:11.454042 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e2e38-b9f1-4a77-8175-ec03b4048da3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:11.454359 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e2e38-b9f1-4a77-8175-ec03b4048da3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:11.455996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e2e38-b9f1-4a77-8175-ec03b4048da3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:11.464542 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 37/75] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:11.469424 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 39/76] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:50:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:11.469502 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7912062-e898-469f-95c2-f7609c46db35 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:11.469598 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e2e38-b9f1-4a77-8175-ec03b4048da3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:11.469697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7912062-e898-469f-95c2-f7609c46db35 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:11.469697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7912062-e898-469f-95c2-f7609c46db35 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:11.469697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 38/77] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:11.469697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7912062-e898-469f-95c2-f7609c46db35 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:11.503636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:11.586279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7912062-e898-469f-95c2-f7609c46db35 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:11.586556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e2e38-b9f1-4a77-8175-ec03b4048da3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:11.596828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:11.620899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e8b12-570e-4b79-a34d-a3d1f9456ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:11.621224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6306b7-0824-4a62-9ee0-c40faa8bebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:11.621542 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e8b12-570e-4b79-a34d-a3d1f9456ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:11.621859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e8b12-570e-4b79-a34d-a3d1f9456ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:11.622139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e8b12-570e-4b79-a34d-a3d1f9456ec8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:11.622246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6306b7-0824-4a62-9ee0-c40faa8bebbc None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:11.622423 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6306b7-0824-4a62-9ee0-c40faa8bebbc None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:11.622708 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6306b7-0824-4a62-9ee0-c40faa8bebbc None admin] PATH_INFO: `/v3/users/24330ac4626a45eab74e07e162c2297b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:11.636966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6306b7-0824-4a62-9ee0-c40faa8bebbc None admin] RBAC: Authorizing `identity:get_user(user_id=24330ac4626a45eab74e07e162c2297b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:11.638477 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6306b7-0824-4a62-9ee0-c40faa8bebbc None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:11.640198 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 40/78] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:11 2022] GET /identity/v3/users/24330ac4626a45eab74e07e162c2297b => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:11.640960 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6306b7-0824-4a62-9ee0-c40faa8bebbc None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:11.689580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e8b12-570e-4b79-a34d-a3d1f9456ec8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:11.691093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e8b12-570e-4b79-a34d-a3d1f9456ec8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:11.726007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:11.747073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6306b7-0824-4a62-9ee0-c40faa8bebbc None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:11.781007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c85f00-9488-41f8-afc3-f176466bc2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:11.781922 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c85f00-9488-41f8-afc3-f176466bc2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:11.782212 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c85f00-9488-41f8-afc3-f176466bc2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:11.782494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c85f00-9488-41f8-afc3-f176466bc2a3 None admin] PATH_INFO: `/v3/users/24330ac4626a45eab74e07e162c2297b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:11.783707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c85f00-9488-41f8-afc3-f176466bc2a3 None admin] RBAC: Authorizing `identity:get_user(user_id=24330ac4626a45eab74e07e162c2297b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:11.785184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c85f00-9488-41f8-afc3-f176466bc2a3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:11.786874 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 41/79] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:11 2022] GET /identity/v3/users/24330ac4626a45eab74e07e162c2297b => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:11.788517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441192e5-d66f-4bf2-b1a9-24657ce1bd0e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:11.789009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441192e5-d66f-4bf2-b1a9-24657ce1bd0e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:11.789332 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441192e5-d66f-4bf2-b1a9-24657ce1bd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:11.795331 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 39/80] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:11.796181 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e8b12-570e-4b79-a34d-a3d1f9456ec8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:11.806536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-441192e5-d66f-4bf2-b1a9-24657ce1bd0e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:11.807770 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-441192e5-d66f-4bf2-b1a9-24657ce1bd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:11.811925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:11.877747 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 42/81] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:11.878960 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441192e5-d66f-4bf2-b1a9-24657ce1bd0e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:11.918126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e8b12-570e-4b79-a34d-a3d1f9456ec8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:11.952984 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f926b-2c99-429f-8f07-a7f4feb2b49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:11.953833 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f926b-2c99-429f-8f07-a7f4feb2b49c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:11.954124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f926b-2c99-429f-8f07-a7f4feb2b49c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:11.954400 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f926b-2c99-429f-8f07-a7f4feb2b49c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:11.955840 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f926b-2c99-429f-8f07-a7f4feb2b49c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:11.957308 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f926b-2c99-429f-8f07-a7f4feb2b49c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:11.957882 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:11.958987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 40/82] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:50:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:11.959784 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f926b-2c99-429f-8f07-a7f4feb2b49c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:11.981057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441192e5-d66f-4bf2-b1a9-24657ce1bd0e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:12.016175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d340bb-cfe7-4754-b937-6fdfb5017364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:12.016860 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d340bb-cfe7-4754-b937-6fdfb5017364 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:12.017148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d340bb-cfe7-4754-b937-6fdfb5017364 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:12.017425 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d340bb-cfe7-4754-b937-6fdfb5017364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:12.041507 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:12.067723 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f926b-2c99-429f-8f07-a7f4feb2b49c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:12.090610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d340bb-cfe7-4754-b937-6fdfb5017364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:12.092098 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d340bb-cfe7-4754-b937-6fdfb5017364 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:12.104403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c8ba1-54f0-470d-970e-13a23f84899d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:12.105065 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c8ba1-54f0-470d-970e-13a23f84899d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:12.105352 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c8ba1-54f0-470d-970e-13a23f84899d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:12.105634 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c8ba1-54f0-470d-970e-13a23f84899d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:12.170413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:12.176342 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c8ba1-54f0-470d-970e-13a23f84899d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:12.177866 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c8ba1-54f0-470d-970e-13a23f84899d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:12.193538 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 43/83] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:12.194492 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d340bb-cfe7-4754-b937-6fdfb5017364 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:12.260149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:12.283823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 41/84] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:12.284989 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c8ba1-54f0-470d-970e-13a23f84899d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:12.297571 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d340bb-cfe7-4754-b937-6fdfb5017364 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:12.334040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c63cf-6fe1-4c0e-b772-aa26a6c68cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:12.335450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c63cf-6fe1-4c0e-b772-aa26a6c68cbd None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:12.335862 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c63cf-6fe1-4c0e-b772-aa26a6c68cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:12.336143 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c63cf-6fe1-4c0e-b772-aa26a6c68cbd None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:12.337370 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c63cf-6fe1-4c0e-b772-aa26a6c68cbd None admin] RBAC: Authorizing `identity:get_project(project_id=e2c925ab39e142be8182f673b844dc7a)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:12.338866 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c63cf-6fe1-4c0e-b772-aa26a6c68cbd None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:12.340780 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 44/85] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:12 2022] GET /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:12.341319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c63cf-6fe1-4c0e-b772-aa26a6c68cbd None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:12.388611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:12.390659 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c8ba1-54f0-470d-970e-13a23f84899d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:12.427570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1ec99-1829-44d0-976a-976c665e2de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:12.428305 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1ec99-1829-44d0-976a-976c665e2de3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:12.428566 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1ec99-1829-44d0-976a-976c665e2de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:12.429378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1ec99-1829-44d0-976a-976c665e2de3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:12.441005 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1ec99-1829-44d0-976a-976c665e2de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:12.443904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c63cf-6fe1-4c0e-b772-aa26a6c68cbd None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:12.449867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-c6d1ec99-1829-44d0-976a-976c665e2de3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:12.449867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:12.449867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:12.449867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:12.449867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:12.449867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:12.449867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:12.449867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:12.449867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:12.449867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:12.449867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:12.449867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:12.449867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:12.449867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:12.449867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:12.449867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:12.450902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:12.450902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:12.450902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:12.450902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:12.450902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:12.450902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:12.450902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:12.450902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:12.450902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:12.450902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:12.450902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:12.450902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:12.450902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:12.450902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:12.450902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:12.450902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:12.451712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:12.451712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:12.451712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:12.451712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:12.451712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:12.451712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:12.451712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:12.451712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:12.451712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:12.451712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:12.451712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:12.451712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:12.451712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 42/86] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:12.452352 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1ec99-1829-44d0-976a-976c665e2de3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:12.481849 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3f6b0-a70b-48fa-a3e6-8747d04c728b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:12.482528 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3f6b0-a70b-48fa-a3e6-8747d04c728b None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:12.482810 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3f6b0-a70b-48fa-a3e6-8747d04c728b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:12.483086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3f6b0-a70b-48fa-a3e6-8747d04c728b None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:12.483796 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3f6b0-a70b-48fa-a3e6-8747d04c728b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:12.485268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3f6b0-a70b-48fa-a3e6-8747d04c728b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:12.494702 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:12.512987 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 45/87] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 18 16:50:12 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:50:12.518780 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3f6b0-a70b-48fa-a3e6-8747d04c728b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:12.566930 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1ec99-1829-44d0-976a-976c665e2de3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:12.614213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696e3bb-fd4a-468e-9212-7993a56eddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:12.615154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696e3bb-fd4a-468e-9212-7993a56eddb7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:12.615441 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696e3bb-fd4a-468e-9212-7993a56eddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:12.615719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696e3bb-fd4a-468e-9212-7993a56eddb7 None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:12.617795 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696e3bb-fd4a-468e-9212-7993a56eddb7 None admin] RBAC: Authorizing `identity:get_project(project_id=e2c925ab39e142be8182f673b844dc7a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:12.619382 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696e3bb-fd4a-468e-9212-7993a56eddb7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:12.626329 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 43/88] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:12 2022] GET /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:12.626329 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696e3bb-fd4a-468e-9212-7993a56eddb7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:12.644842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3f6b0-a70b-48fa-a3e6-8747d04c728b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:12.647028 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:12.689872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbcc27-fa87-417a-aee2-f8184bf63eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:12.690647 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbcc27-fa87-417a-aee2-f8184bf63eab None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:12.690935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbcc27-fa87-417a-aee2-f8184bf63eab None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:12.691222 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbcc27-fa87-417a-aee2-f8184bf63eab None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:12.692474 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbcc27-fa87-417a-aee2-f8184bf63eab None admin] RBAC: Authorizing `identity:get_project(project_id=e2c925ab39e142be8182f673b844dc7a)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:12.694003 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbcc27-fa87-417a-aee2-f8184bf63eab None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:12.701284 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 46/89] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:12 2022] GET /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:12.701284 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbcc27-fa87-417a-aee2-f8184bf63eab None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:12.762338 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696e3bb-fd4a-468e-9212-7993a56eddb7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:12.769902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:12.809170 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c8d09-9231-4da8-9bee-286038f6f72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:12.810127 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c8d09-9231-4da8-9bee-286038f6f72f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:12.810552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c8d09-9231-4da8-9bee-286038f6f72f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:12.811778 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c8d09-9231-4da8-9bee-286038f6f72f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:12.811983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c8d09-9231-4da8-9bee-286038f6f72f None admin] RBAC: Adding query filter params (role.id=b3f3f4910bf646699f30b749edeef422, scope.project.id=e2c925ab39e142be8182f673b844dc7a, user.id=4f9da66f38394711b45d0352bd9b4158) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:12.812302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c8d09-9231-4da8-9bee-286038f6f72f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:12.813910 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c8d09-9231-4da8-9bee-286038f6f72f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:12.821474 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 44/90] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:50:12 2022] GET /identity/v3/role_assignments?user.id=4f9da66f38394711b45d0352bd9b4158&scope.project.id=e2c925ab39e142be8182f673b844dc7a&role.id=b3f3f4910bf646699f30b749edeef422 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:12.822242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c8d09-9231-4da8-9bee-286038f6f72f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:12.830076 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbcc27-fa87-417a-aee2-f8184bf63eab None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:12.884700 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0cb98-0773-4444-9b6c-24db696e1c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:12.885506 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0cb98-0773-4444-9b6c-24db696e1c27 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:12.885899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0cb98-0773-4444-9b6c-24db696e1c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:12.886186 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0cb98-0773-4444-9b6c-24db696e1c27 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:12.887027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0cb98-0773-4444-9b6c-24db696e1c27 None admin] RBAC: Adding query filter params (name=member) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:12.887346 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0cb98-0773-4444-9b6c-24db696e1c27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:12.888848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0cb98-0773-4444-9b6c-24db696e1c27 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:12.901332 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 47/91] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:12.902096 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0cb98-0773-4444-9b6c-24db696e1c27 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:12.942714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:12.993696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c8d09-9231-4da8-9bee-286038f6f72f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:13.064077 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0cb98-0773-4444-9b6c-24db696e1c27 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:13.077420 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f106d-b980-4bca-b29f-892c4006daf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:13.078139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f106d-b980-4bca-b29f-892c4006daf0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:13.078434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f106d-b980-4bca-b29f-892c4006daf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:13.078717 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f106d-b980-4bca-b29f-892c4006daf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:13.079591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f106d-b980-4bca-b29f-892c4006daf0 None admin] RBAC: Adding query filter params (role.id=bfec786c9ea74c4aaecf243a866539af, scope.project.id=e2c925ab39e142be8182f673b844dc7a, user.id=24330ac4626a45eab74e07e162c2297b) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:13.080158 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f106d-b980-4bca-b29f-892c4006daf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:13.081682 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f106d-b980-4bca-b29f-892c4006daf0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:13.091938 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 45/92] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:50:12 2022] GET /identity/v3/role_assignments?user.id=24330ac4626a45eab74e07e162c2297b&scope.project.id=e2c925ab39e142be8182f673b844dc7a&role.id=bfec786c9ea74c4aaecf243a866539af => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:13.092792 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f106d-b980-4bca-b29f-892c4006daf0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:13.124450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876f712-f239-4d53-b09f-a65252dfbce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:13.125585 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876f712-f239-4d53-b09f-a65252dfbce7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:13.126121 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876f712-f239-4d53-b09f-a65252dfbce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:13.126622 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876f712-f239-4d53-b09f-a65252dfbce7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:13.127755 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876f712-f239-4d53-b09f-a65252dfbce7 None admin] RBAC: Adding query filter params (role.id=7a9281e8b95a43c58cf4d0c272dd1469, scope.project.id=e2c925ab39e142be8182f673b844dc7a, user.id=24330ac4626a45eab74e07e162c2297b) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:13.128338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876f712-f239-4d53-b09f-a65252dfbce7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:13.130649 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876f712-f239-4d53-b09f-a65252dfbce7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:13.139874 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 48/93] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:50:12 2022] GET /identity/v3/role_assignments?user.id=24330ac4626a45eab74e07e162c2297b&scope.project.id=e2c925ab39e142be8182f673b844dc7a&role.id=7a9281e8b95a43c58cf4d0c272dd1469 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:13.193127 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:13.302256 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f106d-b980-4bca-b29f-892c4006daf0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:13.352072 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4fc96-d1cf-4682-8d02-8da2d6f4569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:13.352957 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4fc96-d1cf-4682-8d02-8da2d6f4569b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:13.353242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4fc96-d1cf-4682-8d02-8da2d6f4569b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:13.353519 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4fc96-d1cf-4682-8d02-8da2d6f4569b None admin] PATH_INFO: `/v3/users/24330ac4626a45eab74e07e162c2297b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:13.354901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4fc96-d1cf-4682-8d02-8da2d6f4569b None admin] RBAC: Authorizing `identity:get_user(user_id=24330ac4626a45eab74e07e162c2297b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:13.356410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4fc96-d1cf-4682-8d02-8da2d6f4569b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:13.358492 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 46/94] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:13 2022] GET /identity/v3/users/24330ac4626a45eab74e07e162c2297b => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:13.364435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876f712-f239-4d53-b09f-a65252dfbce7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:13.511547 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:13.524962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876f712-f239-4d53-b09f-a65252dfbce7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:13.571196 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b8c87-2252-439b-a8f1-180525a808a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:13.572258 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b8c87-2252-439b-a8f1-180525a808a4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:13.572801 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b8c87-2252-439b-a8f1-180525a808a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:13.573276 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b8c87-2252-439b-a8f1-180525a808a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:13.656289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b8c87-2252-439b-a8f1-180525a808a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:13.658160 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b8c87-2252-439b-a8f1-180525a808a4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:13.773925 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:13.781533 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 49/95] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:13.797188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4fc96-d1cf-4682-8d02-8da2d6f4569b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:13.941065 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4fc96-d1cf-4682-8d02-8da2d6f4569b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:13.942686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:13.976957 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e63cd9-4dbc-4dfa-a2c0-0439b02981c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:13.977861 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e63cd9-4dbc-4dfa-a2c0-0439b02981c4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:13.978144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e63cd9-4dbc-4dfa-a2c0-0439b02981c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:13.978418 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e63cd9-4dbc-4dfa-a2c0-0439b02981c4 None admin] PATH_INFO: `/v3/projects/9e9a36dc66ae40f2873bd38352db91a1` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:13.979716 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e63cd9-4dbc-4dfa-a2c0-0439b02981c4 None admin] RBAC: Authorizing `identity:get_project(project_id=9e9a36dc66ae40f2873bd38352db91a1)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:13.981256 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e63cd9-4dbc-4dfa-a2c0-0439b02981c4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:13.983082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 47/96] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:13 2022] GET /identity/v3/projects/9e9a36dc66ae40f2873bd38352db91a1 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:13.988838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b8c87-2252-439b-a8f1-180525a808a4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:14.132665 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b8c87-2252-439b-a8f1-180525a808a4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:14.181837 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b1f0d-d2c2-4034-aef7-b94ec154af61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:14.182519 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b1f0d-d2c2-4034-aef7-b94ec154af61 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:14.182839 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b1f0d-d2c2-4034-aef7-b94ec154af61 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:14.183124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b1f0d-d2c2-4034-aef7-b94ec154af61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:14.183988 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b1f0d-d2c2-4034-aef7-b94ec154af61 None admin] RBAC: Adding query filter params (role.id=bfec786c9ea74c4aaecf243a866539af, scope.project.id=9e9a36dc66ae40f2873bd38352db91a1, user.id=24330ac4626a45eab74e07e162c2297b) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:14.184300 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b1f0d-d2c2-4034-aef7-b94ec154af61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:14.185806 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b1f0d-d2c2-4034-aef7-b94ec154af61 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:14.198539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 50/97] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:50:13 2022] GET /identity/v3/role_assignments?user.id=24330ac4626a45eab74e07e162c2297b&scope.project.id=9e9a36dc66ae40f2873bd38352db91a1&role.id=bfec786c9ea74c4aaecf243a866539af => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:15.489193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9f739-89a6-4006-a877-679faf7f6671 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:15.489718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9f739-89a6-4006-a877-679faf7f6671 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:15.489825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9f739-89a6-4006-a877-679faf7f6671 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:15.492413 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 48/98] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:15.498478 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9f4b3-78a7-455e-858e-96189a8b7d59 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:15.499456 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9f4b3-78a7-455e-858e-96189a8b7d59 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:15.499954 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9f4b3-78a7-455e-858e-96189a8b7d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:15.521986 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-65e9f4b3-78a7-455e-858e-96189a8b7d59 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:15.524372 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-65e9f4b3-78a7-455e-858e-96189a8b7d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:15.598708 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:15.611308 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 51/99] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:15.634860 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9f739-89a6-4006-a877-679faf7f6671 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:15.758226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9f739-89a6-4006-a877-679faf7f6671 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:15.804275 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c48564-276c-4933-a2e3-55aa646e0f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:15.805604 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c48564-276c-4933-a2e3-55aa646e0f80 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:15.806040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c48564-276c-4933-a2e3-55aa646e0f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:15.806211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c48564-276c-4933-a2e3-55aa646e0f80 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:15.826240 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c48564-276c-4933-a2e3-55aa646e0f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:15.834691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-02c48564-276c-4933-a2e3-55aa646e0f80 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 16:50:15.834691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:15.834691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:15.834691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:15.834691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:15.834691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:15.834691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:15.834691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:15.834691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:15.834691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:15.834691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:15.834691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:15.834691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:15.834691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:15.834691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:15.834691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:15.836430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:15.836430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:15.836430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:15.836430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:15.836430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:15.836430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:15.836430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:15.836430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:15.836430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:15.836430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:15.836430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:15.836430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:15.836430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:15.836430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:15.836430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:15.836430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:15.837191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:15.837191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:15.837191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:15.837191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:15.837191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:15.837191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:15.837191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:15.837191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:15.837191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:15.837191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:15.837191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 16:50:15.837191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:15.837191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 49/100] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:15.842714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9f4b3-78a7-455e-858e-96189a8b7d59 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:15.954008 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9f4b3-78a7-455e-858e-96189a8b7d59 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:15.990891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae474db2-33e7-442d-b08b-451424d48bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:15.992458 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae474db2-33e7-442d-b08b-451424d48bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:15.992950 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae474db2-33e7-442d-b08b-451424d48bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:15.993544 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae474db2-33e7-442d-b08b-451424d48bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:15.994557 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae474db2-33e7-442d-b08b-451424d48bc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:15.995071 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae474db2-33e7-442d-b08b-451424d48bc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:15.996773 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae474db2-33e7-442d-b08b-451424d48bc9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:16.006337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 52/101] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:16.019290 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c48564-276c-4933-a2e3-55aa646e0f80 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:16.063264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:16.157099 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c48564-276c-4933-a2e3-55aa646e0f80 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:16.196479 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c5e88-24c5-4477-aaba-2014d40c27e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:16.197371 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c5e88-24c5-4477-aaba-2014d40c27e6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:16.197678 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c5e88-24c5-4477-aaba-2014d40c27e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:16.197971 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c5e88-24c5-4477-aaba-2014d40c27e6 None admin] PATH_INFO: `/v3/users/16a622eb94a74768b5839c715ea92fe9` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:16.215835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c5e88-24c5-4477-aaba-2014d40c27e6 None admin] RBAC: Authorizing `identity:get_user(user_id=16a622eb94a74768b5839c715ea92fe9)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:16.217346 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c5e88-24c5-4477-aaba-2014d40c27e6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:16.219205 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 50/102] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:16 2022] GET /identity/v3/users/16a622eb94a74768b5839c715ea92fe9 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:16.224928 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae474db2-33e7-442d-b08b-451424d48bc9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:16.237304 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49c4ea-1edf-474d-b813-a83bc9d62df5 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:16.237603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49c4ea-1edf-474d-b813-a83bc9d62df5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:16.237900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49c4ea-1edf-474d-b813-a83bc9d62df5 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:16.239301 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 51/103] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:16.245390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a5ef9-9e21-402c-9435-44904ba5702b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:16.245695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a5ef9-9e21-402c-9435-44904ba5702b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:16.245985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a5ef9-9e21-402c-9435-44904ba5702b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:16.286970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-216a5ef9-9e21-402c-9435-44904ba5702b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:16.288755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-216a5ef9-9e21-402c-9435-44904ba5702b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:16.342093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:16.370356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae474db2-33e7-442d-b08b-451424d48bc9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:16.411652 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c38c2-d4c6-4815-827f-460801a2a41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:16.412368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c38c2-d4c6-4815-827f-460801a2a41c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:16.412697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c38c2-d4c6-4815-827f-460801a2a41c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:16.413032 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c38c2-d4c6-4815-827f-460801a2a41c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:16.488482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 52/104] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:16.525962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c38c2-d4c6-4815-827f-460801a2a41c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:16.528122 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c38c2-d4c6-4815-827f-460801a2a41c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:16.545863 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a5ef9-9e21-402c-9435-44904ba5702b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:16.605676 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:16.634513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:16.725237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a5ef9-9e21-402c-9435-44904ba5702b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:16.744616 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 53/105] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:16.746380 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a972f85-4a89-4107-a628-e962bdfc09d6 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:16.746887 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a972f85-4a89-4107-a628-e962bdfc09d6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:16.747358 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a972f85-4a89-4107-a628-e962bdfc09d6 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:16.749003 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 54/106] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:16.754899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a50c2-f7f6-4f96-a5d4-488cf22d3a56 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:16.755506 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a50c2-f7f6-4f96-a5d4-488cf22d3a56 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:16.755978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a50c2-f7f6-4f96-a5d4-488cf22d3a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:16.781434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908bc76-ea47-4be4-b337-b5476fa56b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:16.782286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908bc76-ea47-4be4-b337-b5476fa56b7e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:16.782573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908bc76-ea47-4be4-b337-b5476fa56b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:16.782851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908bc76-ea47-4be4-b337-b5476fa56b7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:16.784096 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908bc76-ea47-4be4-b337-b5476fa56b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:16.785562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908bc76-ea47-4be4-b337-b5476fa56b7e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:16.786719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-7c5a50c2-f7f6-4f96-a5d4-488cf22d3a56 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:16.787228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 53/107] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:50:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:16.788694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7c5a50c2-f7f6-4f96-a5d4-488cf22d3a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:16.792891 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908bc76-ea47-4be4-b337-b5476fa56b7e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:16.886018 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:16.902015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908bc76-ea47-4be4-b337-b5476fa56b7e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:16.920521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 55/108] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:16.923680 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e40c9c-bada-42ee-8c0c-6dacc9b0b841 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:16.924528 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e40c9c-bada-42ee-8c0c-6dacc9b0b841 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:16.925404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e40c9c-bada-42ee-8c0c-6dacc9b0b841 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:16.928748 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 56/109] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:16.930293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e40c9c-bada-42ee-8c0c-6dacc9b0b841 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:16.939881 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a735c-7b47-4927-9535-5b1f40cdea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:16.940808 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a735c-7b47-4927-9535-5b1f40cdea4d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:16.941096 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a735c-7b47-4927-9535-5b1f40cdea4d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:16.941379 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a735c-7b47-4927-9535-5b1f40cdea4d None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:16.942653 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a735c-7b47-4927-9535-5b1f40cdea4d None admin] RBAC: Authorizing `identity:get_project(project_id=e2c925ab39e142be8182f673b844dc7a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:16.944160 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a735c-7b47-4927-9535-5b1f40cdea4d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:16.949788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 54/110] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:16 2022] GET /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:16.951173 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df0751-b6a0-41d7-a553-9294a80e8601 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:16.951472 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df0751-b6a0-41d7-a553-9294a80e8601 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:16.951755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df0751-b6a0-41d7-a553-9294a80e8601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:16.971210 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-16df0751-b6a0-41d7-a553-9294a80e8601 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:16.972404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-16df0751-b6a0-41d7-a553-9294a80e8601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:17.045714 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 55/111] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:17.047132 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e2ce2-9905-4551-818e-c9f354c6bda5 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:17.047425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e2ce2-9905-4551-818e-c9f354c6bda5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:17.047707 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e2ce2-9905-4551-818e-c9f354c6bda5 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:17.049192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 56/112] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:17.050484 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e2ce2-9905-4551-818e-c9f354c6bda5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:17.089032 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:17.110658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e40c9c-bada-42ee-8c0c-6dacc9b0b841 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:17.148540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606dd03-adda-47dc-99b4-004c5519a5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:17.149134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606dd03-adda-47dc-99b4-004c5519a5c5 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:17.149423 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606dd03-adda-47dc-99b4-004c5519a5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:17.149735 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606dd03-adda-47dc-99b4-004c5519a5c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:17.150455 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606dd03-adda-47dc-99b4-004c5519a5c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:17.151935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606dd03-adda-47dc-99b4-004c5519a5c5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:17.161608 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:17.185998 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e2ce2-9905-4551-818e-c9f354c6bda5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:17.199739 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 57/113] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 18 16:50:16 2022] POST /identity/v3/projects => generated 302 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:50:17.199739 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606dd03-adda-47dc-99b4-004c5519a5c5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:17.239991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d7cc2-49af-4044-a401-4308ff61841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:17.241242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d7cc2-49af-4044-a401-4308ff61841a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:17.241242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d7cc2-49af-4044-a401-4308ff61841a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:17.241928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d7cc2-49af-4044-a401-4308ff61841a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:17.243148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d7cc2-49af-4044-a401-4308ff61841a None admin] RBAC: Adding query filter params (role.id=d00df1ddfa594cc084ad85d6d8f45791, scope.project.id=e2c925ab39e142be8182f673b844dc7a, user.id=16a622eb94a74768b5839c715ea92fe9) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:17.243640 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d7cc2-49af-4044-a401-4308ff61841a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:17.245416 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d7cc2-49af-4044-a401-4308ff61841a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:17.252518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 57/114] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:50:17 2022] GET /identity/v3/role_assignments?user.id=16a622eb94a74768b5839c715ea92fe9&scope.project.id=e2c925ab39e142be8182f673b844dc7a&role.id=d00df1ddfa594cc084ad85d6d8f45791 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:17.253941 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99041676-06b5-49da-99d7-4bb77178ef35 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:17.254528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99041676-06b5-49da-99d7-4bb77178ef35 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:17.255108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99041676-06b5-49da-99d7-4bb77178ef35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:17.276712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-99041676-06b5-49da-99d7-4bb77178ef35 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:17.278100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-99041676-06b5-49da-99d7-4bb77178ef35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:17.374117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 58/115] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:17.374117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99041676-06b5-49da-99d7-4bb77178ef35 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:17.385383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606dd03-adda-47dc-99b4-004c5519a5c5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:17.459484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0344c-3ca2-460e-b702-adf647c4521d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:17.460686 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0344c-3ca2-460e-b702-adf647c4521d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:17.461192 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0344c-3ca2-460e-b702-adf647c4521d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:17.461650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0344c-3ca2-460e-b702-adf647c4521d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:17.467801 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:17.471798 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:17.488492 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0344c-3ca2-460e-b702-adf647c4521d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:17.501186 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99041676-06b5-49da-99d7-4bb77178ef35 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:17.506601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-36f0344c-3ca2-460e-b702-adf647c4521d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:50:17.506601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:17.506601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:17.506601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:17.506601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:17.506601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:17.506601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:17.506601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:17.506601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:17.506601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:17.506601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:17.506601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:17.506601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:17.506601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:17.506601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:17.506601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:17.508245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:17.508245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:17.508245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:17.508245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:17.508245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:17.508245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:17.508245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:17.508245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:17.508245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:17.508245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:17.508245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:17.508245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:17.508245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:17.508245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:17.508245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:17.508245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:17.509083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:17.509083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:17.509083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:17.509083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:17.509083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:17.509083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:17.509083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:17.509083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:17.509083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:17.509083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:17.509083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:50:17.509083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:17.516911 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 58/116] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:50:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:17.518391 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0344c-3ca2-460e-b702-adf647c4521d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:17.545387 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33363b8-33b8-447f-8bdb-ecf0e01bf0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:17.546323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33363b8-33b8-447f-8bdb-ecf0e01bf0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:17.546912 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33363b8-33b8-447f-8bdb-ecf0e01bf0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:17.546912 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33363b8-33b8-447f-8bdb-ecf0e01bf0a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:17.569230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33363b8-33b8-447f-8bdb-ecf0e01bf0a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:17.569230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-f33363b8-33b8-447f-8bdb-ecf0e01bf0a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:17.569230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:17.569230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:17.569230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:17.569230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:17.569230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:17.569230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:17.569230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:17.569230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:17.569230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:17.569230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:17.569230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:17.569230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:17.570118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:17.570118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:17.570118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:17.570118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:17.570118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:17.570118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:17.570118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:17.570118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:17.570118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:17.570118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:17.570118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:17.570118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:17.570118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:17.570118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:17.570118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:17.570118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:17.570118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:17.570923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:17.570923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:17.570923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:17.570923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:17.570923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:17.570923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:17.570923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:17.570923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:17.570923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:17.570923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:17.570923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:17.570923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:17.570923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:17.570923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:17.570923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 59/117] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:17.572326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33363b8-33b8-447f-8bdb-ecf0e01bf0a1 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:17.691044 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0344c-3ca2-460e-b702-adf647c4521d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:17.703880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33363b8-33b8-447f-8bdb-ecf0e01bf0a1 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:17.744497 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e2bd9-a75b-4a79-a60a-988b4e25098c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:17.745097 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e2bd9-a75b-4a79-a60a-988b4e25098c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:17.745385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e2bd9-a75b-4a79-a60a-988b4e25098c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:17.745682 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e2bd9-a75b-4a79-a60a-988b4e25098c None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:17.746009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc462f-bf63-4586-a65c-8666a71f4f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:17.746471 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e2bd9-a75b-4a79-a60a-988b4e25098c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:17.746782 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e2bd9-a75b-4a79-a60a-988b4e25098c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:17.747475 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc462f-bf63-4586-a65c-8666a71f4f66 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:17.747993 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc462f-bf63-4586-a65c-8666a71f4f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:17.748184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e2bd9-a75b-4a79-a60a-988b4e25098c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:17.748656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc462f-bf63-4586-a65c-8666a71f4f66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:17.754904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:17.760133 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 60/118] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:17.761409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e2bd9-a75b-4a79-a60a-988b4e25098c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:17.769823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc462f-bf63-4586-a65c-8666a71f4f66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:17.781761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-0bdc462f-bf63-4586-a65c-8666a71f4f66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:17.781761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:17.781761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:17.781761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:17.781761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:17.781761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:17.781761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:17.781761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:17.781761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:17.781761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:17.781761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:17.781761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:17.781761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:17.781761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:17.781761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:17.781761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:17.782689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:17.782689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:17.782689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:17.782689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:17.782689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:17.782689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:17.782689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:17.782689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:17.782689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:17.782689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:17.782689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:17.782689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:17.782689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:17.782689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:17.782689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:17.782689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:17.783442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:17.783442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:17.783442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:17.783442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:17.783442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:17.783442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:17.783442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:17.783442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:17.783442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:17.783442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:17.783442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:17.783442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:17.791665 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 59/119] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:50:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:17.791665 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc462f-bf63-4586-a65c-8666a71f4f66 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:17.871372 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:17.923973 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e2bd9-a75b-4a79-a60a-988b4e25098c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:17.930399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc462f-bf63-4586-a65c-8666a71f4f66 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:17.967095 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca1a93-26b6-45be-915b-146210e5902f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:17.967784 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca1a93-26b6-45be-915b-146210e5902f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:17.968072 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca1a93-26b6-45be-915b-146210e5902f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:17.968356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca1a93-26b6-45be-915b-146210e5902f None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:17.969139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca1a93-26b6-45be-915b-146210e5902f None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:17.969453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca1a93-26b6-45be-915b-146210e5902f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:17.970921 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca1a93-26b6-45be-915b-146210e5902f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:17.976910 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187eed15-3fc7-44c0-9e50-d05089a07d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:17.977828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187eed15-3fc7-44c0-9e50-d05089a07d8d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:17.978123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187eed15-3fc7-44c0-9e50-d05089a07d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:17.978408 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187eed15-3fc7-44c0-9e50-d05089a07d8d None admin] PATH_INFO: `/v3/users/4f9da66f38394711b45d0352bd9b4158` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:17.979658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187eed15-3fc7-44c0-9e50-d05089a07d8d None admin] RBAC: Authorizing `identity:get_user(user_id=4f9da66f38394711b45d0352bd9b4158)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:17.980599 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 61/120] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:17.981451 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca1a93-26b6-45be-915b-146210e5902f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:17.982578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187eed15-3fc7-44c0-9e50-d05089a07d8d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:17.984302 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 60/121] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:17 2022] GET /identity/v3/users/4f9da66f38394711b45d0352bd9b4158 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:17.985548 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f393e7-9451-4713-8e8a-87ebc6b0b640 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:17.985875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f393e7-9451-4713-8e8a-87ebc6b0b640 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:17.986162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f393e7-9451-4713-8e8a-87ebc6b0b640 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:17.987411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 61/122] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:17.994170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f393e7-9451-4713-8e8a-87ebc6b0b640 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:18.078029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:18.109179 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f393e7-9451-4713-8e8a-87ebc6b0b640 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:18.124991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca1a93-26b6-45be-915b-146210e5902f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:18.133888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:18.147086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983be33-d829-4d90-bb95-c44c70d61ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:18.148499 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983be33-d829-4d90-bb95-c44c70d61ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:18.148930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983be33-d829-4d90-bb95-c44c70d61ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:18.149210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983be33-d829-4d90-bb95-c44c70d61ad9 None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:18.150535 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983be33-d829-4d90-bb95-c44c70d61ad9 None admin] RBAC: Authorizing `identity:get_project(project_id=e2c925ab39e142be8182f673b844dc7a)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:18.152002 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983be33-d829-4d90-bb95-c44c70d61ad9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:18.153726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 62/123] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:17 2022] GET /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:18.154511 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983be33-d829-4d90-bb95-c44c70d61ad9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:18.166870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39fcc2-3abf-4ad0-bb85-de7e16352b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:18.168147 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39fcc2-3abf-4ad0-bb85-de7e16352b4c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:18.168781 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39fcc2-3abf-4ad0-bb85-de7e16352b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:18.169469 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39fcc2-3abf-4ad0-bb85-de7e16352b4c None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:18.170681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39fcc2-3abf-4ad0-bb85-de7e16352b4c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:18.171216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39fcc2-3abf-4ad0-bb85-de7e16352b4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:18.172928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39fcc2-3abf-4ad0-bb85-de7e16352b4c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:18.187994 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 62/124] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:50:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:18.189805 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193997fc-1f20-48b6-a691-6ea3917f30bc None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:18.190326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193997fc-1f20-48b6-a691-6ea3917f30bc None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:18.190842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193997fc-1f20-48b6-a691-6ea3917f30bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:18.209282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-193997fc-1f20-48b6-a691-6ea3917f30bc None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:18.211556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-193997fc-1f20-48b6-a691-6ea3917f30bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:18.279061 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983be33-d829-4d90-bb95-c44c70d61ad9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:18.285253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 63/125] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:18.286611 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193997fc-1f20-48b6-a691-6ea3917f30bc None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:18.322385 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3afff-f662-4196-998a-a178d5d0071a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:18.323375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3afff-f662-4196-998a-a178d5d0071a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:18.323663 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3afff-f662-4196-998a-a178d5d0071a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:18.323942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3afff-f662-4196-998a-a178d5d0071a None admin] PATH_INFO: `/v3/users/24330ac4626a45eab74e07e162c2297b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:18.326079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3afff-f662-4196-998a-a178d5d0071a None admin] RBAC: Authorizing `identity:get_user(user_id=24330ac4626a45eab74e07e162c2297b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:18.327584 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3afff-f662-4196-998a-a178d5d0071a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:18.329298 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 63/126] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:18 2022] GET /identity/v3/users/24330ac4626a45eab74e07e162c2297b => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:18.330346 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3afff-f662-4196-998a-a178d5d0071a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:18.351829 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:18.403238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:18.426931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193997fc-1f20-48b6-a691-6ea3917f30bc None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:18.453002 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3afff-f662-4196-998a-a178d5d0071a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:18.474421 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0531e9-db25-40ed-846a-14ff485bc2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:18.475439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0531e9-db25-40ed-846a-14ff485bc2da None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:18.476219 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0531e9-db25-40ed-846a-14ff485bc2da None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:18.476503 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0531e9-db25-40ed-846a-14ff485bc2da None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a/users/4f9da66f38394711b45d0352bd9b4158/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:18.479408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0531e9-db25-40ed-846a-14ff485bc2da None admin] RBAC: Authorizing `identity:create_grant(project_id=e2c925ab39e142be8182f673b844dc7a, user_id=4f9da66f38394711b45d0352bd9b4158, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:18.480864 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0531e9-db25-40ed-846a-14ff485bc2da None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:18.499915 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051a8a3-75cd-4d3e-8576-42a5b04b60d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:18.500133 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 64/127] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:50:18 2022] PUT /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a/users/4f9da66f38394711b45d0352bd9b4158/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:50:18.501127 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0531e9-db25-40ed-846a-14ff485bc2da None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:18.501574 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051a8a3-75cd-4d3e-8576-42a5b04b60d3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:18.502124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051a8a3-75cd-4d3e-8576-42a5b04b60d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:18.502652 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051a8a3-75cd-4d3e-8576-42a5b04b60d3 None admin] PATH_INFO: `/v3/users/24330ac4626a45eab74e07e162c2297b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:18.504624 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051a8a3-75cd-4d3e-8576-42a5b04b60d3 None admin] RBAC: Authorizing `identity:get_user(user_id=24330ac4626a45eab74e07e162c2297b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:18.513408 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051a8a3-75cd-4d3e-8576-42a5b04b60d3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:18.515433 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 64/128] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:18 2022] GET /identity/v3/users/24330ac4626a45eab74e07e162c2297b => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:18.520672 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051a8a3-75cd-4d3e-8576-42a5b04b60d3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:18.713101 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051a8a3-75cd-4d3e-8576-42a5b04b60d3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:18.715737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0531e9-db25-40ed-846a-14ff485bc2da None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:18.738063 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:18.750045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:18.754360 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f8c0f-9516-4373-bb34-63345bdd20f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:18.755513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f8c0f-9516-4373-bb34-63345bdd20f7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:18.756060 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f8c0f-9516-4373-bb34-63345bdd20f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:18.756426 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f8c0f-9516-4373-bb34-63345bdd20f7 None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:18.759466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f8c0f-9516-4373-bb34-63345bdd20f7 None admin] RBAC: Authorizing `identity:get_project(project_id=e2c925ab39e142be8182f673b844dc7a)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:18.761735 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f8c0f-9516-4373-bb34-63345bdd20f7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:18.763944 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 65/129] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:18 2022] GET /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:18.765620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcefc2-7619-4aba-a14d-921a2d53fa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:18.766488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcefc2-7619-4aba-a14d-921a2d53fa8b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:18.766774 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcefc2-7619-4aba-a14d-921a2d53fa8b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:18.767051 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcefc2-7619-4aba-a14d-921a2d53fa8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:18.768143 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f8c0f-9516-4373-bb34-63345bdd20f7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:18.794875 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcefc2-7619-4aba-a14d-921a2d53fa8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:18.804746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a9fcefc2-7619-4aba-a14d-921a2d53fa8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:18.804746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:18.804746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:18.804746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:18.804746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:18.804746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:18.804746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:18.804746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:18.804746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:18.804746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:18.804746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:18.804746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:18.804746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:18.804746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:18.804746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:18.804746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:18.805679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:18.805679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:18.805679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:18.805679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:18.805679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:18.805679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:18.805679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:18.805679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:18.805679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:18.805679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:18.805679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:18.805679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:18.805679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:18.805679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:18.805679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:18.805679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:18.806475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:18.806475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:18.806475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:18.806475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:18.806475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:18.806475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:18.806475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:18.806475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:18.806475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:18.806475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:18.806475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:18.806475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:18.814890 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 65/130] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:18.815618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcefc2-7619-4aba-a14d-921a2d53fa8b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:18.933183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcefc2-7619-4aba-a14d-921a2d53fa8b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:18.935759 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f8c0f-9516-4373-bb34-63345bdd20f7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:18.973132 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcfb10-9f00-44d0-b153-c6a27b6d7ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:18.973960 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcfb10-9f00-44d0-b153-c6a27b6d7ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:18.974249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcfb10-9f00-44d0-b153-c6a27b6d7ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:18.974524 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcfb10-9f00-44d0-b153-c6a27b6d7ef7 None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:18.975833 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcfb10-9f00-44d0-b153-c6a27b6d7ef7 None admin] RBAC: Authorizing `identity:get_project(project_id=e2c925ab39e142be8182f673b844dc7a)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:18.977287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcfb10-9f00-44d0-b153-c6a27b6d7ef7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:18.979027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 66/131] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:18 2022] GET /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:18.984502 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcfb10-9f00-44d0-b153-c6a27b6d7ef7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:18.996414 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86d314-c8f5-464c-a752-f62541cf4ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:18.997379 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86d314-c8f5-464c-a752-f62541cf4ffd None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:18.997693 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86d314-c8f5-464c-a752-f62541cf4ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:18.997976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86d314-c8f5-464c-a752-f62541cf4ffd None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a/users/24330ac4626a45eab74e07e162c2297b/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:19.003046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86d314-c8f5-464c-a752-f62541cf4ffd None admin] RBAC: Authorizing `identity:create_grant(project_id=e2c925ab39e142be8182f673b844dc7a, user_id=24330ac4626a45eab74e07e162c2297b, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:19.004539 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86d314-c8f5-464c-a752-f62541cf4ffd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:19.031872 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 66/132] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:50:18 2022] PUT /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a/users/24330ac4626a45eab74e07e162c2297b/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:50:19.032541 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86d314-c8f5-464c-a752-f62541cf4ffd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:19.057587 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:19.108045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcfb10-9f00-44d0-b153-c6a27b6d7ef7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:19.122062 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:19.162931 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad4a2c-ab1f-4c6a-b9f5-b11707bc942a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:19.164631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad4a2c-ab1f-4c6a-b9f5-b11707bc942a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:19.164934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad4a2c-ab1f-4c6a-b9f5-b11707bc942a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:19.165222 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad4a2c-ab1f-4c6a-b9f5-b11707bc942a None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:19.169693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad4a2c-ab1f-4c6a-b9f5-b11707bc942a None admin] RBAC: Adding query filter params (name=member) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:19.169693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad4a2c-ab1f-4c6a-b9f5-b11707bc942a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:19.169693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad4a2c-ab1f-4c6a-b9f5-b11707bc942a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:19.189543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 67/133] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:19.196319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad4a2c-ab1f-4c6a-b9f5-b11707bc942a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:19.256495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86d314-c8f5-464c-a752-f62541cf4ffd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:19.297908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fba9e6-118e-4b37-b8c5-ba024088321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:19.298814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fba9e6-118e-4b37-b8c5-ba024088321a None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:19.299100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fba9e6-118e-4b37-b8c5-ba024088321a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:19.299378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fba9e6-118e-4b37-b8c5-ba024088321a None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a/users/24330ac4626a45eab74e07e162c2297b/roles/7a9281e8b95a43c58cf4d0c272dd1469` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:19.310744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fba9e6-118e-4b37-b8c5-ba024088321a None admin] RBAC: Authorizing `identity:create_grant(project_id=e2c925ab39e142be8182f673b844dc7a, user_id=24330ac4626a45eab74e07e162c2297b, role_id=7a9281e8b95a43c58cf4d0c272dd1469)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:19.312328 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fba9e6-118e-4b37-b8c5-ba024088321a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:19.347774 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 67/134] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:50:19 2022] PUT /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a/users/24330ac4626a45eab74e07e162c2297b/roles/7a9281e8b95a43c58cf4d0c272dd1469 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:50:19.390160 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad4a2c-ab1f-4c6a-b9f5-b11707bc942a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:19.425840 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:19.439779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b150420-6eae-463f-9015-09c66991de25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:19.440688 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b150420-6eae-463f-9015-09c66991de25 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:19.440978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b150420-6eae-463f-9015-09c66991de25 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:19.441255 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b150420-6eae-463f-9015-09c66991de25 None admin] PATH_INFO: `/v3/users/24330ac4626a45eab74e07e162c2297b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:19.442556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b150420-6eae-463f-9015-09c66991de25 None admin] RBAC: Authorizing `identity:get_user(user_id=24330ac4626a45eab74e07e162c2297b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:19.444667 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b150420-6eae-463f-9015-09c66991de25 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:19.446757 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 68/135] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:19 2022] GET /identity/v3/users/24330ac4626a45eab74e07e162c2297b => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:19.452255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fba9e6-118e-4b37-b8c5-ba024088321a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:19.624151 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:19.634916 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fba9e6-118e-4b37-b8c5-ba024088321a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:19.696523 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304c3b5-cc68-44ba-befa-c8eb7e96a466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:19.697406 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304c3b5-cc68-44ba-befa-c8eb7e96a466 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:19.697711 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304c3b5-cc68-44ba-befa-c8eb7e96a466 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:19.697996 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304c3b5-cc68-44ba-befa-c8eb7e96a466 None admin] PATH_INFO: `/v3/projects/9e9a36dc66ae40f2873bd38352db91a1` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:19.702454 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304c3b5-cc68-44ba-befa-c8eb7e96a466 None admin] RBAC: Authorizing `identity:get_project(project_id=9e9a36dc66ae40f2873bd38352db91a1)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:19.703948 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304c3b5-cc68-44ba-befa-c8eb7e96a466 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:19.706326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 68/136] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:19 2022] GET /identity/v3/projects/9e9a36dc66ae40f2873bd38352db91a1 => generated 312 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:19.712837 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b150420-6eae-463f-9015-09c66991de25 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:19.850272 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b150420-6eae-463f-9015-09c66991de25 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:19.903579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813e210-9679-466c-93ba-661b5046b5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:19.904550 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813e210-9679-466c-93ba-661b5046b5e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:19.904840 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813e210-9679-466c-93ba-661b5046b5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:19.905122 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813e210-9679-466c-93ba-661b5046b5e8 None admin] PATH_INFO: `/v3/projects/9e9a36dc66ae40f2873bd38352db91a1/users/24330ac4626a45eab74e07e162c2297b/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:19.907188 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813e210-9679-466c-93ba-661b5046b5e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e9a36dc66ae40f2873bd38352db91a1, user_id=24330ac4626a45eab74e07e162c2297b, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:19.908664 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813e210-9679-466c-93ba-661b5046b5e8 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:19.928124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 69/137] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:50:19 2022] PUT /identity/v3/projects/9e9a36dc66ae40f2873bd38352db91a1/users/24330ac4626a45eab74e07e162c2297b/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:50:20.389964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba1bca-1189-45d6-9d28-6aa45b37d603 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:20.390479 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba1bca-1189-45d6-9d28-6aa45b37d603 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:20.390587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba1bca-1189-45d6-9d28-6aa45b37d603 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:20.392191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 69/138] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:20.399399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9143c7-c8dc-42a6-896b-507a98d35331 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:20.400004 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9143c7-c8dc-42a6-896b-507a98d35331 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:20.400509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9143c7-c8dc-42a6-896b-507a98d35331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:20.420754 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-db9143c7-c8dc-42a6-896b-507a98d35331 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:20.422370 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-db9143c7-c8dc-42a6-896b-507a98d35331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:20.484391 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:20.509938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 70/139] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:50:20.553398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba1bca-1189-45d6-9d28-6aa45b37d603 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:20.739366 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba1bca-1189-45d6-9d28-6aa45b37d603 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:20.808018 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff62f0-bfcb-47bf-bb1f-ebb416a9bc3a None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:20.808819 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff62f0-bfcb-47bf-bb1f-ebb416a9bc3a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:20.809320 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff62f0-bfcb-47bf-bb1f-ebb416a9bc3a None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:20.810956 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 71/140] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:20.817112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e947b44-7f20-4ce8-b5e0-9d3d6ec86b1e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:20.817715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e947b44-7f20-4ce8-b5e0-9d3d6ec86b1e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:20.818291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e947b44-7f20-4ce8-b5e0-9d3d6ec86b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:20.818654 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a602c16-1a45-4551-897a-14aee9e4a88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:20.820154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a602c16-1a45-4551-897a-14aee9e4a88c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:20.820440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a602c16-1a45-4551-897a-14aee9e4a88c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:20.820755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a602c16-1a45-4551-897a-14aee9e4a88c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:20.849734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-0e947b44-7f20-4ce8-b5e0-9d3d6ec86b1e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:20.852380 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0e947b44-7f20-4ce8-b5e0-9d3d6ec86b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:20.867420 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a602c16-1a45-4551-897a-14aee9e4a88c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:20.871123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-3a602c16-1a45-4551-897a-14aee9e4a88c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 16:50:20.871123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:20.871123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:20.871123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:20.871123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:20.871123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:20.871123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:20.871123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:20.871123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:20.871123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:20.871123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:20.871123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:20.871123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:20.871123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:20.871123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:20.871123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:20.871987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:20.871987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:20.871987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:20.871987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:20.871987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:20.871987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:20.871987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:20.871987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:20.871987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:20.871987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:20.871987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:20.871987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:20.871987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:20.871987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:20.871987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:20.871987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:20.872747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:20.872747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:20.872747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:20.872747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:20.872747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:20.872747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:20.872747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:20.872747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:20.872747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:20.872747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:20.872747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 16:50:20.872747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:20.872747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 70/141] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:20.894164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a602c16-1a45-4551-897a-14aee9e4a88c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:20.948480 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:20.983617 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 72/142] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:21.029606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e947b44-7f20-4ce8-b5e0-9d3d6ec86b1e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:21.128672 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a602c16-1a45-4551-897a-14aee9e4a88c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:21.213837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d5e96-72f8-4785-8588-1567dadf36d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:21.215062 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d5e96-72f8-4785-8588-1567dadf36d4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:21.215575 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d5e96-72f8-4785-8588-1567dadf36d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:21.216234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d5e96-72f8-4785-8588-1567dadf36d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:21.217211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d5e96-72f8-4785-8588-1567dadf36d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:21.218680 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d5e96-72f8-4785-8588-1567dadf36d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:21.220313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d5e96-72f8-4785-8588-1567dadf36d4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:21.230949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 71/143] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:21.237478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d5e96-72f8-4785-8588-1567dadf36d4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:21.283420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e947b44-7f20-4ce8-b5e0-9d3d6ec86b1e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:21.312973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:21.367064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b6b39-a48a-40f0-be97-651ea39f300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:21.367948 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b6b39-a48a-40f0-be97-651ea39f300c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:21.368235 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b6b39-a48a-40f0-be97-651ea39f300c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:21.368565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b6b39-a48a-40f0-be97-651ea39f300c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:21.369796 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:21.373015 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b6b39-a48a-40f0-be97-651ea39f300c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:21.374560 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b6b39-a48a-40f0-be97-651ea39f300c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:21.376223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 73/144] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:50:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:21.382681 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b6b39-a48a-40f0-be97-651ea39f300c None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:21.392755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d5e96-72f8-4785-8588-1567dadf36d4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:21.479859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfc515-61ea-4146-b19e-62d3627efc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:21.480752 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfc515-61ea-4146-b19e-62d3627efc33 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:21.481037 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfc515-61ea-4146-b19e-62d3627efc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:21.481315 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfc515-61ea-4146-b19e-62d3627efc33 None admin] PATH_INFO: `/v3/users/16a622eb94a74768b5839c715ea92fe9` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:21.486467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfc515-61ea-4146-b19e-62d3627efc33 None admin] RBAC: Authorizing `identity:get_user(user_id=16a622eb94a74768b5839c715ea92fe9)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:21.487964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfc515-61ea-4146-b19e-62d3627efc33 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:21.490123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 72/145] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:21 2022] GET /identity/v3/users/16a622eb94a74768b5839c715ea92fe9 => generated 289 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:21.498963 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfc515-61ea-4146-b19e-62d3627efc33 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:21.545923 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b6b39-a48a-40f0-be97-651ea39f300c None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:21.587265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37c915-92a1-4062-b476-2d1350f8b836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:21.588356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37c915-92a1-4062-b476-2d1350f8b836 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:21.588888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37c915-92a1-4062-b476-2d1350f8b836 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:21.589388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37c915-92a1-4062-b476-2d1350f8b836 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:21.590351 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37c915-92a1-4062-b476-2d1350f8b836 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:21.592086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37c915-92a1-4062-b476-2d1350f8b836 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:21.618377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 74/146] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 18 16:50:21 2022] POST /identity/v3/users => generated 283 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 16:50:21.666828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfc515-61ea-4146-b19e-62d3627efc33 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:21.722058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120fa6e-342a-4692-ae2b-21a13acf2a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:21.723305 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120fa6e-342a-4692-ae2b-21a13acf2a49 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:21.723787 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120fa6e-342a-4692-ae2b-21a13acf2a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:21.724258 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120fa6e-342a-4692-ae2b-21a13acf2a49 None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:21.725832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120fa6e-342a-4692-ae2b-21a13acf2a49 None admin] RBAC: Authorizing `identity:get_project(project_id=e2c925ab39e142be8182f673b844dc7a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:21.727662 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120fa6e-342a-4692-ae2b-21a13acf2a49 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:21.729919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 73/147] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:21 2022] GET /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:21.736086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37c915-92a1-4062-b476-2d1350f8b836 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:21.802986 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:21.893794 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37c915-92a1-4062-b476-2d1350f8b836 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:21.933452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed4365-b701-4c5d-9c44-a147839ccb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:21.934725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed4365-b701-4c5d-9c44-a147839ccb9c None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:21.935209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed4365-b701-4c5d-9c44-a147839ccb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:21.935714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed4365-b701-4c5d-9c44-a147839ccb9c None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a/users/16a622eb94a74768b5839c715ea92fe9/roles/d00df1ddfa594cc084ad85d6d8f45791` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:21.937955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed4365-b701-4c5d-9c44-a147839ccb9c None admin] RBAC: Authorizing `identity:create_grant(project_id=e2c925ab39e142be8182f673b844dc7a, user_id=16a622eb94a74768b5839c715ea92fe9, role_id=d00df1ddfa594cc084ad85d6d8f45791)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:21.939932 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed4365-b701-4c5d-9c44-a147839ccb9c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:21.961310 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 75/148] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:50:21 2022] PUT /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a/users/16a622eb94a74768b5839c715ea92fe9/roles/d00df1ddfa594cc084ad85d6d8f45791 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:50:22.180551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc6d7f-d7ef-4d24-a0f2-dc330037f084 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:22.181192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc6d7f-d7ef-4d24-a0f2-dc330037f084 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:22.181739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc6d7f-d7ef-4d24-a0f2-dc330037f084 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:22.183777 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 74/149] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:22.189261 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1507142-a342-4bbc-9ad6-81d436db2b20 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:22.189843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1507142-a342-4bbc-9ad6-81d436db2b20 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:22.190328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1507142-a342-4bbc-9ad6-81d436db2b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:22.211326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d1507142-a342-4bbc-9ad6-81d436db2b20 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:22.212915 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d1507142-a342-4bbc-9ad6-81d436db2b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:22.303586 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 76/150] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:22.331759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc6d7f-d7ef-4d24-a0f2-dc330037f084 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:22.358738 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:22.468521 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc6d7f-d7ef-4d24-a0f2-dc330037f084 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:22.512525 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428e8a7-dc95-401c-b9c2-f644dfd771ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:22.513823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428e8a7-dc95-401c-b9c2-f644dfd771ff None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:22.514333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428e8a7-dc95-401c-b9c2-f644dfd771ff None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:22.514831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428e8a7-dc95-401c-b9c2-f644dfd771ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:22.527548 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428e8a7-dc95-401c-b9c2-f644dfd771ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:22.538804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-3428e8a7-dc95-401c-b9c2-f644dfd771ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:50:22.538804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:22.538804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:22.538804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:22.538804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:22.538804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:22.538804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:22.538804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:22.538804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:22.538804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:22.538804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:22.538804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:22.538804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:22.538804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:22.538804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:22.538804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:22.539712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:22.539712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:22.539712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:22.539712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:22.539712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:22.539712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:22.539712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:22.539712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:22.539712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:22.539712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:22.539712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:22.539712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:22.539712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:22.539712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:22.539712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:22.539712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:22.540487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:22.540487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:22.540487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:22.540487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:22.540487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:22.540487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:22.540487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:22.540487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:22.540487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:22.540487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:22.540487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:50:22.540487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:22.543367 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 75/151] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:50:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:22.548881 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1507142-a342-4bbc-9ad6-81d436db2b20 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:22.583207 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:22.630844 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59395817-5c9c-4d62-83f9-e600fea5863c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:22.631484 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59395817-5c9c-4d62-83f9-e600fea5863c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:22.632485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59395817-5c9c-4d62-83f9-e600fea5863c None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:22.634210 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 76/152] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:22.639816 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1caf63-4b1e-429d-a20f-3c1760560f0c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:22.640384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1caf63-4b1e-429d-a20f-3c1760560f0c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:22.640876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1caf63-4b1e-429d-a20f-3c1760560f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:22.665300 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3a1caf63-4b1e-429d-a20f-3c1760560f0c None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:22.667488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3a1caf63-4b1e-429d-a20f-3c1760560f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:22.714370 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1507142-a342-4bbc-9ad6-81d436db2b20 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:22.794851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd9920-e16d-4bdb-8da5-14fa8d34a557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:22.795560 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd9920-e16d-4bdb-8da5-14fa8d34a557 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:22.795850 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd9920-e16d-4bdb-8da5-14fa8d34a557 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:22.796133 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd9920-e16d-4bdb-8da5-14fa8d34a557 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:22.796914 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd9920-e16d-4bdb-8da5-14fa8d34a557 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:22.797225 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd9920-e16d-4bdb-8da5-14fa8d34a557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:22.798694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd9920-e16d-4bdb-8da5-14fa8d34a557 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:22.812112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 77/153] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:50:22.814686 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 77/154] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:22.820217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1caf63-4b1e-429d-a20f-3c1760560f0c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:22.834119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:22.901487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd9920-e16d-4bdb-8da5-14fa8d34a557 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:22.963505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1caf63-4b1e-429d-a20f-3c1760560f0c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:23.012064 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99c965-c4e9-4f86-9b24-888dbacd512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:23.012956 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99c965-c4e9-4f86-9b24-888dbacd512e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:23.013244 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99c965-c4e9-4f86-9b24-888dbacd512e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:23.013521 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99c965-c4e9-4f86-9b24-888dbacd512e None admin] PATH_INFO: `/v3/users/4f9da66f38394711b45d0352bd9b4158` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:23.015622 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99c965-c4e9-4f86-9b24-888dbacd512e None admin] RBAC: Authorizing `identity:get_user(user_id=4f9da66f38394711b45d0352bd9b4158)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:23.017095 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99c965-c4e9-4f86-9b24-888dbacd512e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:23.019028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 78/155] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:22 2022] GET /identity/v3/users/4f9da66f38394711b45d0352bd9b4158 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:23.024761 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99c965-c4e9-4f86-9b24-888dbacd512e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:23.064646 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:23.083310 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd9920-e16d-4bdb-8da5-14fa8d34a557 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:23.142137 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:23.142310 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76933225-45f6-4088-99de-387911325394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:23.143777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76933225-45f6-4088-99de-387911325394 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:23.144167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76933225-45f6-4088-99de-387911325394 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:23.144761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76933225-45f6-4088-99de-387911325394 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:23.168138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76933225-45f6-4088-99de-387911325394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:23.184678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-76933225-45f6-4088-99de-387911325394 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:23.184678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:23.184678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:23.184678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:23.184678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:23.184678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:23.184678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:23.184678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:23.184678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:23.184678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:23.184678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:23.184678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:23.184678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:23.184678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:23.184678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:23.184678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:23.185858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:23.185858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:23.185858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:23.185858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:23.185858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:23.185858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:23.185858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:23.185858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:23.185858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:23.185858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:23.185858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:23.185858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:23.185858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:23.185858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:23.185858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:23.185858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:23.186724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:23.186724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:23.186724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:23.186724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:23.186724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:23.186724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:23.186724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:23.186724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:23.186724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:23.186724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:23.186724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:23.186724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:23.186724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 78/156] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:50:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:50:23.188159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0e2b9-2393-4026-9c8d-dcd4701884b8 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:23.188159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0e2b9-2393-4026-9c8d-dcd4701884b8 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:23.188159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0e2b9-2393-4026-9c8d-dcd4701884b8 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:23.198171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99c965-c4e9-4f86-9b24-888dbacd512e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:23.203320 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 79/157] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:23 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:23.210859 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb94b9b-1ed2-4fef-8543-c4033697606a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:23.211171 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb94b9b-1ed2-4fef-8543-c4033697606a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:23.211408 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb94b9b-1ed2-4fef-8543-c4033697606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:23.233180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-acb94b9b-1ed2-4fef-8543-c4033697606a None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:23.234441 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-acb94b9b-1ed2-4fef-8543-c4033697606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:23.261896 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff6cf18-0321-4282-aa29-954a525a7b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:23.263011 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6cf18-0321-4282-aa29-954a525a7b24 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:23.263618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6cf18-0321-4282-aa29-954a525a7b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:23.264052 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff6cf18-0321-4282-aa29-954a525a7b24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:23.336193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 80/158] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:50:23.337144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb94b9b-1ed2-4fef-8543-c4033697606a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:23.409247 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6cf18-0321-4282-aa29-954a525a7b24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:23.410973 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff6cf18-0321-4282-aa29-954a525a7b24 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:23.458880 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:23.486657 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb94b9b-1ed2-4fef-8543-c4033697606a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:23.530780 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e9c63-a0ac-41be-8f5c-2f15ee05447b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:23.531833 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e9c63-a0ac-41be-8f5c-2f15ee05447b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:23.532612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e9c63-a0ac-41be-8f5c-2f15ee05447b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:23.533100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e9c63-a0ac-41be-8f5c-2f15ee05447b None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:23.534350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e9c63-a0ac-41be-8f5c-2f15ee05447b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:23.534954 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e9c63-a0ac-41be-8f5c-2f15ee05447b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:23.537005 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e9c63-a0ac-41be-8f5c-2f15ee05447b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:23.550384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:23.552397 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 81/159] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:50:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:23.553779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e9c63-a0ac-41be-8f5c-2f15ee05447b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:23.602053 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 79/160] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:23.603281 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bd4e3-c7bb-4e4b-8094-0c66bbd60fe9 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:23.603643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bd4e3-c7bb-4e4b-8094-0c66bbd60fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:23.603937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127bd4e3-c7bb-4e4b-8094-0c66bbd60fe9 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:23.605961 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 80/161] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:23.614683 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bd4e3-c7bb-4e4b-8094-0c66bbd60fe9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:23.686112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e9c63-a0ac-41be-8f5c-2f15ee05447b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:23.732173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005b453-feb2-45a5-94a5-c188afa8cd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:23.733342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005b453-feb2-45a5-94a5-c188afa8cd1a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:23.733872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005b453-feb2-45a5-94a5-c188afa8cd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:23.734412 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005b453-feb2-45a5-94a5-c188afa8cd1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:23.745061 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:23.748826 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005b453-feb2-45a5-94a5-c188afa8cd1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:23.759848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-a005b453-feb2-45a5-94a5-c188afa8cd1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:23.759848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:23.759848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:23.759848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:23.759848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:23.759848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:23.759848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:23.759848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:23.759848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:23.759848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:23.759848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:23.759848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:23.759848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:23.759848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:23.759848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:23.759848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:23.760753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:23.760753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:23.760753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:23.760753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:23.760753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:23.760753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:23.760753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:23.760753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:23.760753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:23.760753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:23.760753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:23.760753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:23.760753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:23.760753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:23.760753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:23.760753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:23.761575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:23.761575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:23.761575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:23.761575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:23.761575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:23.761575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:23.761575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:23.761575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:23.761575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:23.761575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:23.761575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:23.761575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:23.765050 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 82/162] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:23.771929 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d594082-4400-44c2-b3db-05381c75e688 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:23.772557 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d594082-4400-44c2-b3db-05381c75e688 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:23.773959 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d594082-4400-44c2-b3db-05381c75e688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:23.795258 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-1d594082-4400-44c2-b3db-05381c75e688 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:23.796790 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1d594082-4400-44c2-b3db-05381c75e688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:23.834404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127bd4e3-c7bb-4e4b-8094-0c66bbd60fe9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:23.889976 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 83/163] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:23.892170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d594082-4400-44c2-b3db-05381c75e688 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:23.907405 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cb888-87e4-42f0-82f8-e7c88deb020a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:23.908284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cb888-87e4-42f0-82f8-e7c88deb020a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:23.908565 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cb888-87e4-42f0-82f8-e7c88deb020a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:23.908841 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cb888-87e4-42f0-82f8-e7c88deb020a None admin] PATH_INFO: `/v3/users/24330ac4626a45eab74e07e162c2297b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:23.911768 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cb888-87e4-42f0-82f8-e7c88deb020a None admin] RBAC: Authorizing `identity:get_user(user_id=24330ac4626a45eab74e07e162c2297b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:23.917372 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cb888-87e4-42f0-82f8-e7c88deb020a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:23.917372 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 81/164] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:23 2022] GET /identity/v3/users/24330ac4626a45eab74e07e162c2297b => generated 275 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:23.917372 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cb888-87e4-42f0-82f8-e7c88deb020a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:24.042311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:24.138876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d594082-4400-44c2-b3db-05381c75e688 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:24.183867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cb888-87e4-42f0-82f8-e7c88deb020a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:24.200352 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:24.207442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede3203-5872-4807-a1b3-fbb0cf54fafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:24.208320 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede3203-5872-4807-a1b3-fbb0cf54fafb None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:24.208607 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede3203-5872-4807-a1b3-fbb0cf54fafb None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:24.208887 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede3203-5872-4807-a1b3-fbb0cf54fafb None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:24.211416 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede3203-5872-4807-a1b3-fbb0cf54fafb None admin] RBAC: Authorizing `identity:get_project(project_id=e2c925ab39e142be8182f673b844dc7a)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:24.212935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede3203-5872-4807-a1b3-fbb0cf54fafb None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:24.214746 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 84/165] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:23 2022] GET /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a => generated 298 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:24.215542 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede3203-5872-4807-a1b3-fbb0cf54fafb None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:24.271456 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81e7fd-1689-4300-9103-1cfa9929906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:24.273062 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81e7fd-1689-4300-9103-1cfa9929906b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:24.273418 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81e7fd-1689-4300-9103-1cfa9929906b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:24.273736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81e7fd-1689-4300-9103-1cfa9929906b None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:24.274617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81e7fd-1689-4300-9103-1cfa9929906b None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:24.274933 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81e7fd-1689-4300-9103-1cfa9929906b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:24.276462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81e7fd-1689-4300-9103-1cfa9929906b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:24.293650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 82/166] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:24.294477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81e7fd-1689-4300-9103-1cfa9929906b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:24.334484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede3203-5872-4807-a1b3-fbb0cf54fafb None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:24.375871 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d7b2c-a4f2-40f0-9edd-90a79cc703a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:24.376547 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d7b2c-a4f2-40f0-9edd-90a79cc703a2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:24.376832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d7b2c-a4f2-40f0-9edd-90a79cc703a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:24.377112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d7b2c-a4f2-40f0-9edd-90a79cc703a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:24.450276 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:24.465246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d7b2c-a4f2-40f0-9edd-90a79cc703a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:24.466793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d7b2c-a4f2-40f0-9edd-90a79cc703a2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:24.516768 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81e7fd-1689-4300-9103-1cfa9929906b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:24.534603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:24.607631 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abff79d-9ad8-49cc-948f-94661a0dc1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:24.608573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abff79d-9ad8-49cc-948f-94661a0dc1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:24.608696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abff79d-9ad8-49cc-948f-94661a0dc1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:24.609045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abff79d-9ad8-49cc-948f-94661a0dc1b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:24.624743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 85/167] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:24.625604 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d7b2c-a4f2-40f0-9edd-90a79cc703a2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:24.638956 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abff79d-9ad8-49cc-948f-94661a0dc1b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:24.655999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-8abff79d-9ad8-49cc-948f-94661a0dc1b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:24.655999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:24.655999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:24.655999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:24.655999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:24.655999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:24.655999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:24.655999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:24.655999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:24.655999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:24.655999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:24.655999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:24.655999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:24.655999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:24.655999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:24.655999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:24.658087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:24.658087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:24.658087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:24.658087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:24.658087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:24.658087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:24.658087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:24.658087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:24.658087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:24.658087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:24.658087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:24.658087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:24.658087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:24.658087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:24.658087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:24.658087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:24.660193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:24.660193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:24.660193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:24.660193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:24.660193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:24.660193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:24.660193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:24.660193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:24.660193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:24.660193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:24.660193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:24.660193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:24.660193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 83/168] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:24.660193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abff79d-9ad8-49cc-948f-94661a0dc1b8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:24.796271 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:24.806156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d7b2c-a4f2-40f0-9edd-90a79cc703a2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:24.893732 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abff79d-9ad8-49cc-948f-94661a0dc1b8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:24.907383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22359ea0-a7d8-4117-a653-496f465d5b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:24.908052 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22359ea0-a7d8-4117-a653-496f465d5b25 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:24.908448 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22359ea0-a7d8-4117-a653-496f465d5b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:24.908606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22359ea0-a7d8-4117-a653-496f465d5b25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:24.909433 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22359ea0-a7d8-4117-a653-496f465d5b25 None admin] RBAC: Adding query filter params (role.id=b3f3f4910bf646699f30b749edeef422, scope.project.id=e2c925ab39e142be8182f673b844dc7a, user.id=4f9da66f38394711b45d0352bd9b4158) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:24.909772 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22359ea0-a7d8-4117-a653-496f465d5b25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:24.911224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22359ea0-a7d8-4117-a653-496f465d5b25 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:24.927660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 86/169] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:50:24 2022] GET /identity/v3/role_assignments?user.id=4f9da66f38394711b45d0352bd9b4158&scope.project.id=e2c925ab39e142be8182f673b844dc7a&role.id=b3f3f4910bf646699f30b749edeef422 => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:24.929026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22359ea0-a7d8-4117-a653-496f465d5b25 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:24.982582 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8d82b-9ec7-43ff-8b0c-9de37c5567dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:24.983497 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8d82b-9ec7-43ff-8b0c-9de37c5567dc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:24.983784 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8d82b-9ec7-43ff-8b0c-9de37c5567dc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:24.984065 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8d82b-9ec7-43ff-8b0c-9de37c5567dc None admin] PATH_INFO: `/v3/users/24330ac4626a45eab74e07e162c2297b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:24.985543 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8d82b-9ec7-43ff-8b0c-9de37c5567dc None admin] RBAC: Authorizing `identity:get_user(user_id=24330ac4626a45eab74e07e162c2297b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:24.987198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8d82b-9ec7-43ff-8b0c-9de37c5567dc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:24.989309 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 84/170] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:24 2022] GET /identity/v3/users/24330ac4626a45eab74e07e162c2297b => generated 275 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:24.989872 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8d82b-9ec7-43ff-8b0c-9de37c5567dc None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:25.111340 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:25.146237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22359ea0-a7d8-4117-a653-496f465d5b25 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:25.211567 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c655d-15db-43d5-a7a5-cbd3ab67c51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:25.212470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c655d-15db-43d5-a7a5-cbd3ab67c51e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:25.212751 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c655d-15db-43d5-a7a5-cbd3ab67c51e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:25.213024 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c655d-15db-43d5-a7a5-cbd3ab67c51e None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:25.218733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c655d-15db-43d5-a7a5-cbd3ab67c51e None admin] RBAC: Authorizing `identity:get_project(project_id=e2c925ab39e142be8182f673b844dc7a)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:25.220333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c655d-15db-43d5-a7a5-cbd3ab67c51e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:25.222635 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 87/171] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:24 2022] GET /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:25.223484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c655d-15db-43d5-a7a5-cbd3ab67c51e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:25.294966 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8d82b-9ec7-43ff-8b0c-9de37c5567dc None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:25.301580 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:25.366550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c6348-21bf-463f-9ac7-d01f0c8d311e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:25.367233 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c6348-21bf-463f-9ac7-d01f0c8d311e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:25.367514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c6348-21bf-463f-9ac7-d01f0c8d311e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:25.367787 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c6348-21bf-463f-9ac7-d01f0c8d311e None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:25.368548 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c6348-21bf-463f-9ac7-d01f0c8d311e None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:25.368848 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c6348-21bf-463f-9ac7-d01f0c8d311e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:25.370286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c6348-21bf-463f-9ac7-d01f0c8d311e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:25.385819 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 85/172] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:25.386685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c6348-21bf-463f-9ac7-d01f0c8d311e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:25.417803 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c655d-15db-43d5-a7a5-cbd3ab67c51e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:25.465253 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90505f6-836e-4f4b-9ae9-6adc60daf307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:25.465967 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90505f6-836e-4f4b-9ae9-6adc60daf307 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:25.466248 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90505f6-836e-4f4b-9ae9-6adc60daf307 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:25.466522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90505f6-836e-4f4b-9ae9-6adc60daf307 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:25.571369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90505f6-836e-4f4b-9ae9-6adc60daf307 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:25.573080 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90505f6-836e-4f4b-9ae9-6adc60daf307 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:25.591584 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:25.597411 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c6348-21bf-463f-9ac7-d01f0c8d311e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:25.632276 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:25.678989 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343649d-9b31-42d5-b293-a210db79420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:25.679664 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343649d-9b31-42d5-b293-a210db79420f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:25.680077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343649d-9b31-42d5-b293-a210db79420f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:25.680241 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343649d-9b31-42d5-b293-a210db79420f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:25.681164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343649d-9b31-42d5-b293-a210db79420f None admin] RBAC: Adding query filter params (role.id=7a9281e8b95a43c58cf4d0c272dd1469, scope.project.id=e2c925ab39e142be8182f673b844dc7a, user.id=24330ac4626a45eab74e07e162c2297b) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:25.681483 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343649d-9b31-42d5-b293-a210db79420f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:25.683245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343649d-9b31-42d5-b293-a210db79420f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:25.696256 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 86/173] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:50:25 2022] GET /identity/v3/role_assignments?user.id=24330ac4626a45eab74e07e162c2297b&scope.project.id=e2c925ab39e142be8182f673b844dc7a&role.id=7a9281e8b95a43c58cf4d0c272dd1469 => generated 608 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:25.697130 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343649d-9b31-42d5-b293-a210db79420f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:25.765418 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 88/174] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:25.773313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90505f6-836e-4f4b-9ae9-6adc60daf307 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:25.923946 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343649d-9b31-42d5-b293-a210db79420f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:25.947065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90505f6-836e-4f4b-9ae9-6adc60daf307 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:25.997167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:26.019561 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f9ecf-09ff-4e23-b561-b9c40dc1d497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:26.019924 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927a36d-5958-4c08-8fe2-36b74dad4b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:26.020462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f9ecf-09ff-4e23-b561-b9c40dc1d497 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:26.020637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927a36d-5958-4c08-8fe2-36b74dad4b49 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:26.020804 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f9ecf-09ff-4e23-b561-b9c40dc1d497 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:26.020957 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927a36d-5958-4c08-8fe2-36b74dad4b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:26.021096 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f9ecf-09ff-4e23-b561-b9c40dc1d497 None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:26.021234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927a36d-5958-4c08-8fe2-36b74dad4b49 None admin] PATH_INFO: `/v3/users/24330ac4626a45eab74e07e162c2297b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:26.026464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927a36d-5958-4c08-8fe2-36b74dad4b49 None admin] RBAC: Authorizing `identity:get_user(user_id=24330ac4626a45eab74e07e162c2297b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:26.027983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927a36d-5958-4c08-8fe2-36b74dad4b49 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:26.029951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 87/175] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:25 2022] GET /identity/v3/users/24330ac4626a45eab74e07e162c2297b => generated 275 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:26.030132 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f9ecf-09ff-4e23-b561-b9c40dc1d497 None admin] RBAC: Authorizing `identity:get_project(project_id=e2c925ab39e142be8182f673b844dc7a)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:26.031415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f9ecf-09ff-4e23-b561-b9c40dc1d497 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:26.033372 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 89/176] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:25 2022] GET /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:26.035010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927a36d-5958-4c08-8fe2-36b74dad4b49 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:26.040275 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f9ecf-09ff-4e23-b561-b9c40dc1d497 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:26.127652 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:26.230350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f9ecf-09ff-4e23-b561-b9c40dc1d497 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:26.280385 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a408ca4-e808-4e3e-83fa-5b4e56eaf14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:26.281646 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a408ca4-e808-4e3e-83fa-5b4e56eaf14d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:26.281988 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a408ca4-e808-4e3e-83fa-5b4e56eaf14d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:26.282271 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a408ca4-e808-4e3e-83fa-5b4e56eaf14d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:26.283125 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a408ca4-e808-4e3e-83fa-5b4e56eaf14d None admin] RBAC: Adding query filter params (role.id=bfec786c9ea74c4aaecf243a866539af, scope.project.id=e2c925ab39e142be8182f673b844dc7a, user.id=24330ac4626a45eab74e07e162c2297b) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:26.283439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a408ca4-e808-4e3e-83fa-5b4e56eaf14d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:26.285345 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a408ca4-e808-4e3e-83fa-5b4e56eaf14d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:26.294110 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 90/177] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:50:26 2022] GET /identity/v3/role_assignments?user.id=24330ac4626a45eab74e07e162c2297b&scope.project.id=e2c925ab39e142be8182f673b844dc7a&role.id=bfec786c9ea74c4aaecf243a866539af => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:26.295831 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b88fd-ec72-4443-bdd5-d0cfa855e14c None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:26.296121 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b88fd-ec72-4443-bdd5-d0cfa855e14c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:26.296400 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b88fd-ec72-4443-bdd5-d0cfa855e14c None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:26.297696 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 91/178] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:26.304484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc4157-e33b-48be-92a9-6dc5e0d86b2d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:26.304937 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc4157-e33b-48be-92a9-6dc5e0d86b2d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:26.305098 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc4157-e33b-48be-92a9-6dc5e0d86b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:26.319754 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927a36d-5958-4c08-8fe2-36b74dad4b49 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:26.324313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-46bc4157-e33b-48be-92a9-6dc5e0d86b2d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:26.325651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-46bc4157-e33b-48be-92a9-6dc5e0d86b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:26.393569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34cf09-01cf-47f0-b3f1-366aca84ea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:26.394263 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34cf09-01cf-47f0-b3f1-366aca84ea9e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:26.395576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34cf09-01cf-47f0-b3f1-366aca84ea9e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:26.395868 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34cf09-01cf-47f0-b3f1-366aca84ea9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:26.416922 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:26.435853 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 92/179] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:50:26.461673 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc4157-e33b-48be-92a9-6dc5e0d86b2d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:26.496822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34cf09-01cf-47f0-b3f1-366aca84ea9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:26.498466 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34cf09-01cf-47f0-b3f1-366aca84ea9e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:26.543614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:26.590877 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc4157-e33b-48be-92a9-6dc5e0d86b2d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:26.637746 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692d40c-d446-4517-a7b8-b85f8be583d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:26.638566 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692d40c-d446-4517-a7b8-b85f8be583d0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:26.638844 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692d40c-d446-4517-a7b8-b85f8be583d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:26.639115 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692d40c-d446-4517-a7b8-b85f8be583d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:26.639674 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 88/180] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:26.640738 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa2921-681e-4848-a8dd-cf4cb659c716 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:26.641100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa2921-681e-4848-a8dd-cf4cb659c716 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:26.641452 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa2921-681e-4848-a8dd-cf4cb659c716 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:26.642900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 89/181] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:26.646656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa2921-681e-4848-a8dd-cf4cb659c716 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:26.657430 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692d40c-d446-4517-a7b8-b85f8be583d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:26.665863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-4692d40c-d446-4517-a7b8-b85f8be583d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:50:26.665863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:26.665863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:26.665863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:26.665863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:26.665863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:26.665863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:26.665863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:26.665863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:26.665863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:26.665863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:26.665863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:26.665863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:26.665863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:26.665863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:26.665863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:26.667875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:26.667875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:26.667875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:26.667875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:26.667875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:26.667875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:26.667875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:26.667875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:26.667875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:26.667875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:26.667875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:26.667875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:26.667875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:26.667875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:26.667875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:26.667875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:26.669779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:26.669779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:26.669779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:26.669779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:26.669779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:26.669779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:26.669779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:26.669779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:26.669779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:26.669779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:26.669779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:50:26.669779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:26.669779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 93/182] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:50:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:26.669779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f50e65-a05e-4548-b03a-de3277838282 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:26.675151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f50e65-a05e-4548-b03a-de3277838282 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:26.675151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f50e65-a05e-4548-b03a-de3277838282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:26.695730 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b3f50e65-a05e-4548-b03a-de3277838282 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:26.696952 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b3f50e65-a05e-4548-b03a-de3277838282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:26.759325 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:26.785265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 94/183] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:26.785954 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f50e65-a05e-4548-b03a-de3277838282 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:26.790382 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa2921-681e-4848-a8dd-cf4cb659c716 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:26.854530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:26.864557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bad1eb-3c79-4755-9a84-57ca7b3362bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:26.867221 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bad1eb-3c79-4755-9a84-57ca7b3362bd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:26.867770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bad1eb-3c79-4755-9a84-57ca7b3362bd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:26.868176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bad1eb-3c79-4755-9a84-57ca7b3362bd None admin] PATH_INFO: `/v3/projects/9e9a36dc66ae40f2873bd38352db91a1` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:26.869648 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bad1eb-3c79-4755-9a84-57ca7b3362bd None admin] RBAC: Authorizing `identity:get_project(project_id=9e9a36dc66ae40f2873bd38352db91a1)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:26.871787 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bad1eb-3c79-4755-9a84-57ca7b3362bd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:26.877740 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 90/184] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:26 2022] GET /identity/v3/projects/9e9a36dc66ae40f2873bd38352db91a1 => generated 312 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:26.877740 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b87af-3c01-4e89-9376-3a4b047516c2 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:26.877740 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b87af-3c01-4e89-9376-3a4b047516c2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:26.877740 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b87af-3c01-4e89-9376-3a4b047516c2 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:26.880511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 91/185] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:26.881992 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b87af-3c01-4e89-9376-3a4b047516c2 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:26.928411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f50e65-a05e-4548-b03a-de3277838282 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:26.971172 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a396943-803e-4dc5-a803-43811f5a26f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:26.971955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a396943-803e-4dc5-a803-43811f5a26f4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:26.972295 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a396943-803e-4dc5-a803-43811f5a26f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:26.972631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a396943-803e-4dc5-a803-43811f5a26f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:26.973792 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a396943-803e-4dc5-a803-43811f5a26f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:26.973792 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a396943-803e-4dc5-a803-43811f5a26f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:26.975191 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a396943-803e-4dc5-a803-43811f5a26f4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:26.984205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 95/186] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:26.985307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a396943-803e-4dc5-a803-43811f5a26f4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:27.007875 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b87af-3c01-4e89-9376-3a4b047516c2 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:27.034686 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:27.056532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6db9c-e475-44ba-8563-25a6b20a4f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:27.057450 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6db9c-e475-44ba-8563-25a6b20a4f0d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:27.057707 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6db9c-e475-44ba-8563-25a6b20a4f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:27.057990 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6db9c-e475-44ba-8563-25a6b20a4f0d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:27.071177 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6db9c-e475-44ba-8563-25a6b20a4f0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:27.079120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-81a6db9c-e475-44ba-8563-25a6b20a4f0d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 16:50:27.079120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:27.079120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:27.079120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:27.079120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:27.079120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:27.079120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:27.079120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:27.079120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:27.079120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:27.079120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:27.079120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:27.079120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:27.079120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:27.079120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:27.079120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:27.080408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:27.080408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:27.080408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:27.080408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:27.080408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:27.080408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:27.080408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:27.080408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:27.080408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:27.080408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:27.080408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:27.080408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:27.080408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:27.080408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:27.080408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:27.080408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:27.081228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:27.081228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:27.081228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:27.081228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:27.081228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:27.081228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:27.081228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:27.081228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:27.081228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:27.081228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:27.081228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 16:50:27.081228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:27.081228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 92/187] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:27.083044 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fb38b-fb03-45ce-a7ea-e9f1756f89e4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:27.083329 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fb38b-fb03-45ce-a7ea-e9f1756f89e4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:27.083602 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369fb38b-fb03-45ce-a7ea-e9f1756f89e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:27.103019 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-369fb38b-fb03-45ce-a7ea-e9f1756f89e4 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:27.104214 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-369fb38b-fb03-45ce-a7ea-e9f1756f89e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:27.111519 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a396943-803e-4dc5-a803-43811f5a26f4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:27.147866 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb237e3b-50d3-4332-ba4c-c78c58e5c346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:27.149169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb237e3b-50d3-4332-ba4c-c78c58e5c346 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:27.149461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb237e3b-50d3-4332-ba4c-c78c58e5c346 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:27.149771 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb237e3b-50d3-4332-ba4c-c78c58e5c346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:27.150637 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb237e3b-50d3-4332-ba4c-c78c58e5c346 None admin] RBAC: Adding query filter params (role.id=bfec786c9ea74c4aaecf243a866539af, scope.project.id=9e9a36dc66ae40f2873bd38352db91a1, user.id=24330ac4626a45eab74e07e162c2297b) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:27.150953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb237e3b-50d3-4332-ba4c-c78c58e5c346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:27.152425 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb237e3b-50d3-4332-ba4c-c78c58e5c346 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:27.158806 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 96/188] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:50:26 2022] GET /identity/v3/role_assignments?user.id=24330ac4626a45eab74e07e162c2297b&scope.project.id=9e9a36dc66ae40f2873bd38352db91a1&role.id=bfec786c9ea74c4aaecf243a866539af => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:27.159615 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb237e3b-50d3-4332-ba4c-c78c58e5c346 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:27.161004 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:27.187043 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 93/189] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:27.187750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fb38b-fb03-45ce-a7ea-e9f1756f89e4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:27.304597 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb237e3b-50d3-4332-ba4c-c78c58e5c346 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:27.316414 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:27.318098 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369fb38b-fb03-45ce-a7ea-e9f1756f89e4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:27.348608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d724036-55e1-4d11-8fca-3c197e5392ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:27.349491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d724036-55e1-4d11-8fca-3c197e5392ac None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:27.349832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d724036-55e1-4d11-8fca-3c197e5392ac None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:27.351403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d724036-55e1-4d11-8fca-3c197e5392ac None admin] PATH_INFO: `/v3/users/4aa089d7c8da4a4f99db6184504cf48f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:27.365469 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327c73d-3330-4e92-9ddc-6167729b09c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:27.366000 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d724036-55e1-4d11-8fca-3c197e5392ac None admin] RBAC: Authorizing `identity:get_user(user_id=4aa089d7c8da4a4f99db6184504cf48f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:27.366230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327c73d-3330-4e92-9ddc-6167729b09c7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:27.366524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327c73d-3330-4e92-9ddc-6167729b09c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:27.366821 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327c73d-3330-4e92-9ddc-6167729b09c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:27.367536 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327c73d-3330-4e92-9ddc-6167729b09c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:27.367835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d724036-55e1-4d11-8fca-3c197e5392ac None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:27.367949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327c73d-3330-4e92-9ddc-6167729b09c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:27.369217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327c73d-3330-4e92-9ddc-6167729b09c7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:27.369607 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 97/190] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:27 2022] GET /identity/v3/users/4aa089d7c8da4a4f99db6184504cf48f => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:27.375236 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5190c-9097-4cbc-8379-90f5c740aa15 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:27.375584 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5190c-9097-4cbc-8379-90f5c740aa15 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:27.375873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5190c-9097-4cbc-8379-90f5c740aa15 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:27.378324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 98/191] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:27.378324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5190c-9097-4cbc-8379-90f5c740aa15 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:27.385478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 94/192] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:27.386677 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327c73d-3330-4e92-9ddc-6167729b09c7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:27.446393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:27.498546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327c73d-3330-4e92-9ddc-6167729b09c7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:27.499430 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5190c-9097-4cbc-8379-90f5c740aa15 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:27.533449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a4f69-0513-4b59-8501-1f1431027a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:27.534126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4f69-0513-4b59-8501-1f1431027a7e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:27.534409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4f69-0513-4b59-8501-1f1431027a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:27.534681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4f69-0513-4b59-8501-1f1431027a7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:27.536097 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911c2ea-ef1b-4c27-9ff0-0154fd391035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:27.536920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911c2ea-ef1b-4c27-9ff0-0154fd391035 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:27.537200 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911c2ea-ef1b-4c27-9ff0-0154fd391035 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:27.537483 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911c2ea-ef1b-4c27-9ff0-0154fd391035 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:27.539618 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911c2ea-ef1b-4c27-9ff0-0154fd391035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:27.541095 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3911c2ea-ef1b-4c27-9ff0-0154fd391035 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:27.542788 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 99/193] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:50:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:27.543981 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01283d-5ce2-4757-b9d4-53e1577d3efd None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:27.544269 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01283d-5ce2-4757-b9d4-53e1577d3efd None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:27.544550 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01283d-5ce2-4757-b9d4-53e1577d3efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:27.561560 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-0a01283d-5ce2-4757-b9d4-53e1577d3efd None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:27.562723 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0a01283d-5ce2-4757-b9d4-53e1577d3efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:27.591448 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:27.608685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a4f69-0513-4b59-8501-1f1431027a7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:27.610222 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a4f69-0513-4b59-8501-1f1431027a7e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:27.634017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 100/194] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:27.634871 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01283d-5ce2-4757-b9d4-53e1577d3efd None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:27.663134 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:27.718547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 95/195] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:27.719511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a4f69-0513-4b59-8501-1f1431027a7e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:27.749406 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01283d-5ce2-4757-b9d4-53e1577d3efd None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:27.787194 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863a6e6-03e3-45ea-a603-6b433c4d896c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:27.788567 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863a6e6-03e3-45ea-a603-6b433c4d896c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:27.788844 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863a6e6-03e3-45ea-a603-6b433c4d896c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:27.789112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863a6e6-03e3-45ea-a603-6b433c4d896c None admin] PATH_INFO: `/v3/users/16a622eb94a74768b5839c715ea92fe9` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:27.790427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863a6e6-03e3-45ea-a603-6b433c4d896c None admin] RBAC: Authorizing `identity:get_user(user_id=16a622eb94a74768b5839c715ea92fe9)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:27.791932 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863a6e6-03e3-45ea-a603-6b433c4d896c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:27.793676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 101/196] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:27 2022] GET /identity/v3/users/16a622eb94a74768b5839c715ea92fe9 => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:27.796771 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863a6e6-03e3-45ea-a603-6b433c4d896c None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:27.830167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a4f69-0513-4b59-8501-1f1431027a7e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:27.830777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:27.866868 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c36eb-e674-458e-b0ac-9962ddfe7053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:27.867549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c36eb-e674-458e-b0ac-9962ddfe7053 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:27.867822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c36eb-e674-458e-b0ac-9962ddfe7053 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:27.868098 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c36eb-e674-458e-b0ac-9962ddfe7053 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:27.868817 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c36eb-e674-458e-b0ac-9962ddfe7053 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:27.870303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c36eb-e674-458e-b0ac-9962ddfe7053 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:27.890297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 96/197] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 18 16:50:27 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:50:27.891217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c36eb-e674-458e-b0ac-9962ddfe7053 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:27.903028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:27.915803 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863a6e6-03e3-45ea-a603-6b433c4d896c None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:27.959396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e216bb-56f6-4274-a6ec-b608e6bd8e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:27.960686 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e216bb-56f6-4274-a6ec-b608e6bd8e27 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:27.960972 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e216bb-56f6-4274-a6ec-b608e6bd8e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:27.961256 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e216bb-56f6-4274-a6ec-b608e6bd8e27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:27.973935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e216bb-56f6-4274-a6ec-b608e6bd8e27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:27.983168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-c6e216bb-56f6-4274-a6ec-b608e6bd8e27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:27.983168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:27.983168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:27.983168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:27.983168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:27.983168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:27.983168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:27.983168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:27.983168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:27.983168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:27.983168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:27.983168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:27.983168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:27.983168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:27.983168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:27.983168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:27.984149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:27.984149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:27.984149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:27.984149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:27.984149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:27.984149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:27.984149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:27.984149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:27.984149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:27.984149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:27.984149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:27.984149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:27.984149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:27.984149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:27.984149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:27.984149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:27.984939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:27.984939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:27.984939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:27.984939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:27.984939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:27.984939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:27.984939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:27.984939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:27.984939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:27.984939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:27.984939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:27.984939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:27.984939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 102/198] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:50:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:27.985578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e216bb-56f6-4274-a6ec-b608e6bd8e27 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:28.029783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c36eb-e674-458e-b0ac-9962ddfe7053 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:28.089531 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c992e58-4633-47ad-abb1-aa185703a93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:28.090389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c992e58-4633-47ad-abb1-aa185703a93d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:28.090736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c992e58-4633-47ad-abb1-aa185703a93d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:28.090952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c992e58-4633-47ad-abb1-aa185703a93d None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:28.093065 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c992e58-4633-47ad-abb1-aa185703a93d None admin] RBAC: Authorizing `identity:get_project(project_id=451724484cdd482390defb722f90bb6c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:28.094856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c992e58-4633-47ad-abb1-aa185703a93d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:28.096476 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 97/199] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:27 2022] GET /identity/v3/projects/451724484cdd482390defb722f90bb6c => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:28.097102 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c992e58-4633-47ad-abb1-aa185703a93d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:28.102047 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:28.113028 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e216bb-56f6-4274-a6ec-b608e6bd8e27 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:28.154382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5165cb7-f2f1-4060-8529-32fc9ac4faaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:28.155142 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5165cb7-f2f1-4060-8529-32fc9ac4faaf None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:28.155503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5165cb7-f2f1-4060-8529-32fc9ac4faaf None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:28.155853 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5165cb7-f2f1-4060-8529-32fc9ac4faaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:28.210646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:28.246375 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c992e58-4633-47ad-abb1-aa185703a93d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:28.251182 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5165cb7-f2f1-4060-8529-32fc9ac4faaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:28.252685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5165cb7-f2f1-4060-8529-32fc9ac4faaf None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:28.294849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c55e4-add6-47cb-81ac-e3041127f0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:28.295447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c55e4-add6-47cb-81ac-e3041127f0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:28.295735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c55e4-add6-47cb-81ac-e3041127f0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:28.296013 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c55e4-add6-47cb-81ac-e3041127f0a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:28.296780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c55e4-add6-47cb-81ac-e3041127f0a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:28.297086 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c55e4-add6-47cb-81ac-e3041127f0a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:28.298698 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c55e4-add6-47cb-81ac-e3041127f0a8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:28.312695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 98/200] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:50:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:28.314089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c55e4-add6-47cb-81ac-e3041127f0a8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:28.381335 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:28.404426 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 103/201] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:28.404426 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5165cb7-f2f1-4060-8529-32fc9ac4faaf None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:28.452846 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c55e4-add6-47cb-81ac-e3041127f0a8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:28.489935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c72c95-ce6e-4235-83ad-11b67ad02585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:28.491676 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c72c95-ce6e-4235-83ad-11b67ad02585 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:28.492203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c72c95-ce6e-4235-83ad-11b67ad02585 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:28.492737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c72c95-ce6e-4235-83ad-11b67ad02585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:28.493834 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c72c95-ce6e-4235-83ad-11b67ad02585 None admin] RBAC: Adding query filter params (role.id=b3f3f4910bf646699f30b749edeef422, scope.project.id=451724484cdd482390defb722f90bb6c, user.id=4aa089d7c8da4a4f99db6184504cf48f) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:28.494381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c72c95-ce6e-4235-83ad-11b67ad02585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:28.496096 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c72c95-ce6e-4235-83ad-11b67ad02585 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:28.499651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:28.503765 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 99/202] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:50:28 2022] GET /identity/v3/role_assignments?user.id=4aa089d7c8da4a4f99db6184504cf48f&scope.project.id=451724484cdd482390defb722f90bb6c&role.id=b3f3f4910bf646699f30b749edeef422 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:28.505437 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c72c95-ce6e-4235-83ad-11b67ad02585 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:28.554845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5165cb7-f2f1-4060-8529-32fc9ac4faaf None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:28.598085 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df72b5-b763-484a-8235-fc287a4aaf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:28.598986 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df72b5-b763-484a-8235-fc287a4aaf95 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:28.599269 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df72b5-b763-484a-8235-fc287a4aaf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:28.599545 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df72b5-b763-484a-8235-fc287a4aaf95 None admin] PATH_INFO: `/v3/users/4aa089d7c8da4a4f99db6184504cf48f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:28.601391 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df72b5-b763-484a-8235-fc287a4aaf95 None admin] RBAC: Authorizing `identity:get_user(user_id=4aa089d7c8da4a4f99db6184504cf48f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:28.605683 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df72b5-b763-484a-8235-fc287a4aaf95 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:28.605909 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 104/203] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:28 2022] GET /identity/v3/users/4aa089d7c8da4a4f99db6184504cf48f => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:28.612660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df72b5-b763-484a-8235-fc287a4aaf95 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:28.733874 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c72c95-ce6e-4235-83ad-11b67ad02585 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:28.739402 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:28.787094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aef124-78f8-4def-8dff-e981610704db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:28.788009 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aef124-78f8-4def-8dff-e981610704db None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:28.788298 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aef124-78f8-4def-8dff-e981610704db None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:28.788573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aef124-78f8-4def-8dff-e981610704db None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:28.789690 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df72b5-b763-484a-8235-fc287a4aaf95 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:28.794601 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aef124-78f8-4def-8dff-e981610704db None admin] RBAC: Authorizing `identity:get_project(project_id=e2c925ab39e142be8182f673b844dc7a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:28.796103 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aef124-78f8-4def-8dff-e981610704db None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:28.798210 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 100/204] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:28 2022] GET /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:28.804524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aef124-78f8-4def-8dff-e981610704db None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:28.827333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1de27-7253-4870-be11-999b1281c7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:28.828022 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1de27-7253-4870-be11-999b1281c7bc None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:28.828320 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1de27-7253-4870-be11-999b1281c7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:28.828680 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1de27-7253-4870-be11-999b1281c7bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:28.888827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:28.904744 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1de27-7253-4870-be11-999b1281c7bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:28.906923 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1de27-7253-4870-be11-999b1281c7bc None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:28.952561 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aef124-78f8-4def-8dff-e981610704db None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:28.999310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ab682-a380-461f-a1e1-0b9627d5f9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:28.999906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ab682-a380-461f-a1e1-0b9627d5f9cd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:29.000201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ab682-a380-461f-a1e1-0b9627d5f9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:29.000546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ab682-a380-461f-a1e1-0b9627d5f9cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:29.001458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ab682-a380-461f-a1e1-0b9627d5f9cd None admin] RBAC: Adding query filter params (role.id=d00df1ddfa594cc084ad85d6d8f45791, scope.project.id=e2c925ab39e142be8182f673b844dc7a, user.id=16a622eb94a74768b5839c715ea92fe9) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:29.001804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ab682-a380-461f-a1e1-0b9627d5f9cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:29.003438 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ab682-a380-461f-a1e1-0b9627d5f9cd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:29.011328 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 101/205] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:50:28 2022] GET /identity/v3/role_assignments?user.id=16a622eb94a74768b5839c715ea92fe9&scope.project.id=e2c925ab39e142be8182f673b844dc7a&role.id=d00df1ddfa594cc084ad85d6d8f45791 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:29.024731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:29.103490 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 105/206] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 16:50:29.109614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ab682-a380-461f-a1e1-0b9627d5f9cd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:29.235322 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ab682-a380-461f-a1e1-0b9627d5f9cd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:29.276297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:29.282365 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538b06a-0538-431f-9c7a-fbde5590092e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:29.283547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538b06a-0538-431f-9c7a-fbde5590092e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:29.284035 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538b06a-0538-431f-9c7a-fbde5590092e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:29.284508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538b06a-0538-431f-9c7a-fbde5590092e None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:29.286023 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538b06a-0538-431f-9c7a-fbde5590092e None admin] RBAC: Authorizing `identity:get_project(project_id=451724484cdd482390defb722f90bb6c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:29.288242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538b06a-0538-431f-9c7a-fbde5590092e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:29.290216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 102/207] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:29 2022] GET /identity/v3/projects/451724484cdd482390defb722f90bb6c => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:29.297688 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1de27-7253-4870-be11-999b1281c7bc None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:29.423680 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1de27-7253-4870-be11-999b1281c7bc None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:29.463224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85d5ce-f46e-414f-b2c5-0f8076dd162e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:29.464287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85d5ce-f46e-414f-b2c5-0f8076dd162e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:29.464781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85d5ce-f46e-414f-b2c5-0f8076dd162e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:29.465271 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85d5ce-f46e-414f-b2c5-0f8076dd162e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:29.466360 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85d5ce-f46e-414f-b2c5-0f8076dd162e None admin] RBAC: Adding query filter params (role.id=7a9281e8b95a43c58cf4d0c272dd1469, scope.project.id=451724484cdd482390defb722f90bb6c, user.id=4aa089d7c8da4a4f99db6184504cf48f) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:29.466889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85d5ce-f46e-414f-b2c5-0f8076dd162e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:29.468546 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85d5ce-f46e-414f-b2c5-0f8076dd162e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:29.475502 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 106/208] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:50:29 2022] GET /identity/v3/role_assignments?user.id=4aa089d7c8da4a4f99db6184504cf48f&scope.project.id=451724484cdd482390defb722f90bb6c&role.id=7a9281e8b95a43c58cf4d0c272dd1469 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:30.544136 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549736a-8ec9-43ad-ba47-12be42639f44 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:30.544650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549736a-8ec9-43ad-ba47-12be42639f44 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:30.544756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549736a-8ec9-43ad-ba47-12be42639f44 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:30.546230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 103/209] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:30.551745 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c17e91-42cc-4919-8620-470ad714505b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:30.552630 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c17e91-42cc-4919-8620-470ad714505b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:30.553104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c17e91-42cc-4919-8620-470ad714505b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:30.571678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-25c17e91-42cc-4919-8620-470ad714505b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:30.573205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-25c17e91-42cc-4919-8620-470ad714505b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:30.595782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:30.604253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05fccf-ac69-4bda-b1c6-a7a634f6bc09 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:30.604545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05fccf-ac69-4bda-b1c6-a7a634f6bc09 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:30.604822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05fccf-ac69-4bda-b1c6-a7a634f6bc09 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:30.606845 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 104/210] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:30.612096 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472245f-0720-4edd-a4ff-ed42841db6b9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:30.612460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472245f-0720-4edd-a4ff-ed42841db6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:30.612746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472245f-0720-4edd-a4ff-ed42841db6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:30.633856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f472245f-0720-4edd-a4ff-ed42841db6b9 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:30.635093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f472245f-0720-4edd-a4ff-ed42841db6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:30.676099 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 107/211] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:50:30.697799 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c17e91-42cc-4919-8620-470ad714505b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:30.718823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 105/212] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:30.742805 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472245f-0720-4edd-a4ff-ed42841db6b9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:30.817945 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c17e91-42cc-4919-8620-470ad714505b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:30.846718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472245f-0720-4edd-a4ff-ed42841db6b9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:30.859705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2fb9c-2ea6-4eba-8a7a-b05f797da7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:30.860630 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2fb9c-2ea6-4eba-8a7a-b05f797da7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:30.860921 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2fb9c-2ea6-4eba-8a7a-b05f797da7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:30.861200 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2fb9c-2ea6-4eba-8a7a-b05f797da7d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:30.862485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2fb9c-2ea6-4eba-8a7a-b05f797da7d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:30.864274 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2fb9c-2ea6-4eba-8a7a-b05f797da7d5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:30.867379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 108/213] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:50:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:30.874934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2fb9c-2ea6-4eba-8a7a-b05f797da7d5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:30.882508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:30.889309 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f40370-c9a3-4596-a2fe-02e55760fc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:30.890246 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f40370-c9a3-4596-a2fe-02e55760fc2e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:30.890531 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f40370-c9a3-4596-a2fe-02e55760fc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:30.890810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f40370-c9a3-4596-a2fe-02e55760fc2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:30.904681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f40370-c9a3-4596-a2fe-02e55760fc2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:30.909378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:30.914176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-01f40370-c9a3-4596-a2fe-02e55760fc2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:30.914176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:30.914176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:30.914176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:30.914176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:30.914176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:30.914176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:30.914176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:30.914176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:30.914176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:30.914176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:30.914176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:30.914176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:30.914176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:30.914176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:30.914176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:30.915148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:30.915148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:30.915148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:30.915148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:30.915148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:30.915148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:30.915148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:30.915148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:30.915148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:30.915148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:30.915148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:30.915148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:30.915148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:30.915148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:30.915148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:30.915148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:30.915919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:30.915919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:30.915919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:30.915919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:30.915919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:30.915919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:30.915919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:30.915919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:30.915919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:30.915919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:30.915919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:30.915919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:30.915919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 106/214] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:50:30.922831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f40370-c9a3-4596-a2fe-02e55760fc2e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:31.030913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2fb9c-2ea6-4eba-8a7a-b05f797da7d5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:31.051435 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f40370-c9a3-4596-a2fe-02e55760fc2e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:31.081634 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b2000-f599-459d-bcda-dd89b0930db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:31.082684 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b2000-f599-459d-bcda-dd89b0930db6 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:31.082963 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b2000-f599-459d-bcda-dd89b0930db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:31.083232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b2000-f599-459d-bcda-dd89b0930db6 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:31.083959 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b2000-f599-459d-bcda-dd89b0930db6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:31.085816 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b2000-f599-459d-bcda-dd89b0930db6 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:31.097581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6fd1a-1342-468b-89be-71a8992d8083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:31.098407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6fd1a-1342-468b-89be-71a8992d8083 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:31.098715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6fd1a-1342-468b-89be-71a8992d8083 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:31.098989 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6fd1a-1342-468b-89be-71a8992d8083 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:31.099947 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6fd1a-1342-468b-89be-71a8992d8083 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:31.100425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6fd1a-1342-468b-89be-71a8992d8083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:31.102109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6fd1a-1342-468b-89be-71a8992d8083 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:31.108781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 109/215] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 18 16:50:30 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:50:31.110603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f233e5-7859-422a-b9e5-ec26ae53b2dc None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:31.110900 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f233e5-7859-422a-b9e5-ec26ae53b2dc None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:31.111188 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f233e5-7859-422a-b9e5-ec26ae53b2dc None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:31.112760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 110/216] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:31.113751 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 107/217] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:31.119196 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075ed4e-ea15-4b87-8ae7-5c9e542a5011 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:31.119516 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075ed4e-ea15-4b87-8ae7-5c9e542a5011 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:31.119763 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075ed4e-ea15-4b87-8ae7-5c9e542a5011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:31.123493 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6fd1a-1342-468b-89be-71a8992d8083 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:31.154237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4075ed4e-ea15-4b87-8ae7-5c9e542a5011 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:31.156687 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4075ed4e-ea15-4b87-8ae7-5c9e542a5011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:31.197961 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:31.251736 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 111/218] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:31.260256 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6fd1a-1342-468b-89be-71a8992d8083 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:31.275548 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075ed4e-ea15-4b87-8ae7-5c9e542a5011 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:31.287063 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:31.306179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980a083-a3e4-4a26-892d-e5b6e4ffd3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:31.307081 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980a083-a3e4-4a26-892d-e5b6e4ffd3fd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:31.307360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980a083-a3e4-4a26-892d-e5b6e4ffd3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:31.307635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980a083-a3e4-4a26-892d-e5b6e4ffd3fd None admin] PATH_INFO: `/v3/users/7c0848a0adf24681b66760a17129a901` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:31.328307 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980a083-a3e4-4a26-892d-e5b6e4ffd3fd None admin] RBAC: Authorizing `identity:get_user(user_id=7c0848a0adf24681b66760a17129a901)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:31.331121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5980a083-a3e4-4a26-892d-e5b6e4ffd3fd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:31.334104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 108/219] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:31 2022] GET /identity/v3/users/7c0848a0adf24681b66760a17129a901 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:31.340618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980a083-a3e4-4a26-892d-e5b6e4ffd3fd None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:31.420468 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075ed4e-ea15-4b87-8ae7-5c9e542a5011 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:31.470157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980a083-a3e4-4a26-892d-e5b6e4ffd3fd None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:31.471629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407ad33-4782-4569-9c0f-cdd9e2e5ccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:31.472867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407ad33-4782-4569-9c0f-cdd9e2e5ccb5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:31.474299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407ad33-4782-4569-9c0f-cdd9e2e5ccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:31.474641 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407ad33-4782-4569-9c0f-cdd9e2e5ccb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:31.488433 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407ad33-4782-4569-9c0f-cdd9e2e5ccb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:31.497389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:31.499930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-8407ad33-4782-4569-9c0f-cdd9e2e5ccb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:50:31.499930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:31.499930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:31.499930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:31.499930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:31.499930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:31.499930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:31.499930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:31.499930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:31.499930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:31.499930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:31.499930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:31.499930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:31.499930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:31.499930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:31.499930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:31.500966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:31.500966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:31.500966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:31.500966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:31.500966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:31.500966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:31.500966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:31.500966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:31.500966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:31.500966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:31.500966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:31.500966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:31.500966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:31.500966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:31.500966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:31.500966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:31.501857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:31.501857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:31.501857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:31.501857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:31.501857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:31.501857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:31.501857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:31.501857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:31.501857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:31.501857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:31.501857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:50:31.501857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:31.502459 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 112/220] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:50:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:50:31.510739 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407ad33-4782-4569-9c0f-cdd9e2e5ccb5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:31.530232 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88441596-362d-4966-836b-ecb10698cf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:31.530902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88441596-362d-4966-836b-ecb10698cf76 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:31.531180 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88441596-362d-4966-836b-ecb10698cf76 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:31.531460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88441596-362d-4966-836b-ecb10698cf76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:31.608296 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:31.639653 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88441596-362d-4966-836b-ecb10698cf76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:31.642728 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88441596-362d-4966-836b-ecb10698cf76 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:31.655707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407ad33-4782-4569-9c0f-cdd9e2e5ccb5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:31.708439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2e2a6-4136-497d-9d2e-3a97903238cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:31.710297 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2e2a6-4136-497d-9d2e-3a97903238cf None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:31.710834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2e2a6-4136-497d-9d2e-3a97903238cf None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:31.711317 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2e2a6-4136-497d-9d2e-3a97903238cf None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:31.712934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2e2a6-4136-497d-9d2e-3a97903238cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:31.713422 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2e2a6-4136-497d-9d2e-3a97903238cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:31.716157 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2e2a6-4136-497d-9d2e-3a97903238cf None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:31.729424 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 113/221] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:31.736248 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2e2a6-4136-497d-9d2e-3a97903238cf None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:31.796851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 109/222] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 16:50:31.803929 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88441596-362d-4966-836b-ecb10698cf76 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:31.817588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:31.922796 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2e2a6-4136-497d-9d2e-3a97903238cf None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:31.966407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88441596-362d-4966-836b-ecb10698cf76 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:31.976582 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:31.983980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1e124-541e-415f-8d94-410e79155b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:31.985012 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1e124-541e-415f-8d94-410e79155b5e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:31.985422 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1e124-541e-415f-8d94-410e79155b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:31.985805 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1e124-541e-415f-8d94-410e79155b5e None admin] PATH_INFO: `/v3/users/4aa089d7c8da4a4f99db6184504cf48f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:31.987127 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1e124-541e-415f-8d94-410e79155b5e None admin] RBAC: Authorizing `identity:get_user(user_id=4aa089d7c8da4a4f99db6184504cf48f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:31.988664 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1e124-541e-415f-8d94-410e79155b5e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:31.991318 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 114/223] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:31 2022] GET /identity/v3/users/4aa089d7c8da4a4f99db6184504cf48f => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:31.992353 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b9b43-d60a-4aef-baef-dde70d96ef97 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:31.992799 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b9b43-d60a-4aef-baef-dde70d96ef97 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:31.993174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b9b43-d60a-4aef-baef-dde70d96ef97 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:31.994552 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 115/224] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:31.999542 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b9b43-d60a-4aef-baef-dde70d96ef97 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:32.038231 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b9658-3055-40f1-8284-168f3978ca57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:32.040370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b9658-3055-40f1-8284-168f3978ca57 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:32.041081 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b9658-3055-40f1-8284-168f3978ca57 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:32.041813 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b9658-3055-40f1-8284-168f3978ca57 None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:32.044519 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b9658-3055-40f1-8284-168f3978ca57 None admin] RBAC: Authorizing `identity:get_project(project_id=451724484cdd482390defb722f90bb6c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:32.047367 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b9658-3055-40f1-8284-168f3978ca57 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:32.056095 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 110/225] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:31 2022] GET /identity/v3/projects/451724484cdd482390defb722f90bb6c => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:32.056095 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c6322-f231-4621-b68a-8d011fde399e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:32.056095 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c6322-f231-4621-b68a-8d011fde399e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:32.056095 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c6322-f231-4621-b68a-8d011fde399e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:32.093725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-cb7c6322-f231-4621-b68a-8d011fde399e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:32.095817 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cb7c6322-f231-4621-b68a-8d011fde399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:32.146488 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b9b43-d60a-4aef-baef-dde70d96ef97 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:32.190872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d360f-96fa-42e0-b7ae-4325444207c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:32.192631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d360f-96fa-42e0-b7ae-4325444207c1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:32.193101 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d360f-96fa-42e0-b7ae-4325444207c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:32.193554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d360f-96fa-42e0-b7ae-4325444207c1 None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:32.195458 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d360f-96fa-42e0-b7ae-4325444207c1 None admin] RBAC: Authorizing `identity:get_project(project_id=451724484cdd482390defb722f90bb6c)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:32.197381 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d360f-96fa-42e0-b7ae-4325444207c1 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:32.200323 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 116/226] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:31 2022] GET /identity/v3/projects/451724484cdd482390defb722f90bb6c => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:32.201284 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d360f-96fa-42e0-b7ae-4325444207c1 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:32.218212 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 111/227] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:32.219906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c6322-f231-4621-b68a-8d011fde399e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:32.239634 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:32.287601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:32.330809 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d360f-96fa-42e0-b7ae-4325444207c1 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:32.372858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cff098-7ddd-412b-9835-a87c9e9f3c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:32.373892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cff098-7ddd-412b-9835-a87c9e9f3c43 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:32.374379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cff098-7ddd-412b-9835-a87c9e9f3c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:32.375259 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cff098-7ddd-412b-9835-a87c9e9f3c43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:32.376438 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cff098-7ddd-412b-9835-a87c9e9f3c43 None admin] RBAC: Adding query filter params (role.id=bfec786c9ea74c4aaecf243a866539af, scope.project.id=451724484cdd482390defb722f90bb6c, user.id=7c0848a0adf24681b66760a17129a901) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:32.377066 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cff098-7ddd-412b-9835-a87c9e9f3c43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:32.378755 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cff098-7ddd-412b-9835-a87c9e9f3c43 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:32.387191 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 117/228] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:50:32 2022] GET /identity/v3/role_assignments?user.id=7c0848a0adf24681b66760a17129a901&scope.project.id=451724484cdd482390defb722f90bb6c&role.id=bfec786c9ea74c4aaecf243a866539af => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:32.389004 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cff098-7ddd-412b-9835-a87c9e9f3c43 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:32.410505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c6322-f231-4621-b68a-8d011fde399e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:32.456495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff0143-222d-4516-9500-83fccbd72c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:32.457982 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff0143-222d-4516-9500-83fccbd72c25 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:32.458541 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff0143-222d-4516-9500-83fccbd72c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:32.459031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff0143-222d-4516-9500-83fccbd72c25 None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c/users/4aa089d7c8da4a4f99db6184504cf48f/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:32.464151 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff0143-222d-4516-9500-83fccbd72c25 None admin] RBAC: Authorizing `identity:create_grant(project_id=451724484cdd482390defb722f90bb6c, user_id=4aa089d7c8da4a4f99db6184504cf48f, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:32.466035 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff0143-222d-4516-9500-83fccbd72c25 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:32.485499 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 112/229] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:50:32 2022] PUT /identity/v3/projects/451724484cdd482390defb722f90bb6c/users/4aa089d7c8da4a4f99db6184504cf48f/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:50:32.601037 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cff098-7ddd-412b-9835-a87c9e9f3c43 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:32.667859 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:32.681164 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a0a63-5bdf-4e4b-9187-77f3cb0abf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:32.682741 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a0a63-5bdf-4e4b-9187-77f3cb0abf68 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:32.683289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a0a63-5bdf-4e4b-9187-77f3cb0abf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:32.683794 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a0a63-5bdf-4e4b-9187-77f3cb0abf68 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:32.706005 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a0a63-5bdf-4e4b-9187-77f3cb0abf68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:32.723543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-a56a0a63-5bdf-4e4b-9187-77f3cb0abf68 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:32.723543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:32.723543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:32.723543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:32.723543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:32.723543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:32.723543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:32.723543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:32.723543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:32.723543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:32.723543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:32.723543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:32.723543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:32.723543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:32.723543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:32.723543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:32.724471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:32.724471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:32.724471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:32.724471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:32.724471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:32.724471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:32.724471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:32.724471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:32.724471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:32.724471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:32.724471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:32.724471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:32.724471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:32.724471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:32.724471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:32.724471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:32.725303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:32.725303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:32.725303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:32.725303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:32.725303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:32.725303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:32.725303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:32.725303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:32.725303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:32.725303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:32.725303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:32.725303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:32.726420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 118/230] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:50:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:32.736772 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff0143-222d-4516-9500-83fccbd72c25 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:32.823870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:32.864643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff0143-222d-4516-9500-83fccbd72c25 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:32.917253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9776ab-a036-406f-9939-f7f6e62db0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:32.918544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9776ab-a036-406f-9939-f7f6e62db0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:32.919057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9776ab-a036-406f-9939-f7f6e62db0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:32.919567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9776ab-a036-406f-9939-f7f6e62db0f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:32.921294 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9776ab-a036-406f-9939-f7f6e62db0f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:32.922019 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9776ab-a036-406f-9939-f7f6e62db0f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:32.924737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9776ab-a036-406f-9939-f7f6e62db0f8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:32.941722 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 113/231] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:50:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:32.951768 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a0a63-5bdf-4e4b-9187-77f3cb0abf68 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:33.102697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a0a63-5bdf-4e4b-9187-77f3cb0abf68 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:33.152879 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a5f05-dc1e-4706-b571-4054be33e58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:33.154185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a5f05-dc1e-4706-b571-4054be33e58d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:33.154673 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a5f05-dc1e-4706-b571-4054be33e58d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:33.155173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a5f05-dc1e-4706-b571-4054be33e58d None admin] PATH_INFO: `/v3/users/4aa089d7c8da4a4f99db6184504cf48f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:33.162485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a5f05-dc1e-4706-b571-4054be33e58d None admin] RBAC: Authorizing `identity:get_user(user_id=4aa089d7c8da4a4f99db6184504cf48f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:33.164924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a5f05-dc1e-4706-b571-4054be33e58d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:33.167317 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 119/232] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:32 2022] GET /identity/v3/users/4aa089d7c8da4a4f99db6184504cf48f => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:33.172535 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9776ab-a036-406f-9939-f7f6e62db0f8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:33.319695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9776ab-a036-406f-9939-f7f6e62db0f8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:33.353161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:33.360859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b14329-8fc8-45d2-a5e3-e0b8288f052c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:33.361774 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b14329-8fc8-45d2-a5e3-e0b8288f052c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:33.362129 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b14329-8fc8-45d2-a5e3-e0b8288f052c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:33.362543 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b14329-8fc8-45d2-a5e3-e0b8288f052c None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:33.363908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b14329-8fc8-45d2-a5e3-e0b8288f052c None admin] RBAC: Authorizing `identity:get_project(project_id=451724484cdd482390defb722f90bb6c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:33.365379 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b14329-8fc8-45d2-a5e3-e0b8288f052c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:33.367969 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 114/233] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:33 2022] GET /identity/v3/projects/451724484cdd482390defb722f90bb6c => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:33.373433 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a5f05-dc1e-4706-b571-4054be33e58d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:33.469686 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:33.528177 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a5f05-dc1e-4706-b571-4054be33e58d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:33.581276 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86676697-7f40-42cd-bfcc-a3e45f3fa041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:33.582579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86676697-7f40-42cd-bfcc-a3e45f3fa041 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:33.583073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86676697-7f40-42cd-bfcc-a3e45f3fa041 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:33.583571 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86676697-7f40-42cd-bfcc-a3e45f3fa041 None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c/users/4aa089d7c8da4a4f99db6184504cf48f/roles/7a9281e8b95a43c58cf4d0c272dd1469` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:33.591718 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86676697-7f40-42cd-bfcc-a3e45f3fa041 None admin] RBAC: Authorizing `identity:create_grant(project_id=451724484cdd482390defb722f90bb6c, user_id=4aa089d7c8da4a4f99db6184504cf48f, role_id=7a9281e8b95a43c58cf4d0c272dd1469)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:33.593509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86676697-7f40-42cd-bfcc-a3e45f3fa041 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:33.622369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 120/234] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:50:33 2022] PUT /identity/v3/projects/451724484cdd482390defb722f90bb6c/users/4aa089d7c8da4a4f99db6184504cf48f/roles/7a9281e8b95a43c58cf4d0c272dd1469 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:50:34.083658 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca7167-4504-41c6-96ca-d23aced8866f None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:34.084165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca7167-4504-41c6-96ca-d23aced8866f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:34.084239 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca7167-4504-41c6-96ca-d23aced8866f None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:34.086533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 115/235] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:34.104562 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f4962-4293-4a38-9ce7-29112207a186 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:34.105083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f4962-4293-4a38-9ce7-29112207a186 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:34.105189 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f4962-4293-4a38-9ce7-29112207a186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:34.131001 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5b9f4962-4293-4a38-9ce7-29112207a186 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:34.132972 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5b9f4962-4293-4a38-9ce7-29112207a186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:34.230334 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 121/236] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:34.270094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca7167-4504-41c6-96ca-d23aced8866f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:34.336594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c46f1-f895-4eec-b482-954b6a5c1797 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:34.337197 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c46f1-f895-4eec-b482-954b6a5c1797 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:34.337704 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c46f1-f895-4eec-b482-954b6a5c1797 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:34.339609 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 122/237] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:34.344920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695db28-90c2-441a-b804-377c3cb34d28 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:34.345527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695db28-90c2-441a-b804-377c3cb34d28 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:34.346042 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695db28-90c2-441a-b804-377c3cb34d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:34.389826 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6695db28-90c2-441a-b804-377c3cb34d28 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:34.391042 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6695db28-90c2-441a-b804-377c3cb34d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:34.458915 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca7167-4504-41c6-96ca-d23aced8866f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:34.464818 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:34.508456 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 123/238] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:50:34.519280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac827426-1980-4588-b0c6-37079db37ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:34.520082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac827426-1980-4588-b0c6-37079db37ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:34.520364 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac827426-1980-4588-b0c6-37079db37ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:34.520641 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac827426-1980-4588-b0c6-37079db37ca0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:34.521994 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac827426-1980-4588-b0c6-37079db37ca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:34.523962 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac827426-1980-4588-b0c6-37079db37ca0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:34.526036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 116/239] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:50:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:34.534778 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695db28-90c2-441a-b804-377c3cb34d28 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:34.542143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac827426-1980-4588-b0c6-37079db37ca0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:34.678027 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:34.737202 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac827426-1980-4588-b0c6-37079db37ca0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:34.738741 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695db28-90c2-441a-b804-377c3cb34d28 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:34.799370 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e14b2-993a-4457-9a81-e9e53bc51591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:34.799605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92433ac9-7f0b-4fec-9d17-168a2e626438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:34.800072 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e14b2-993a-4457-9a81-e9e53bc51591 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:34.800357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e14b2-993a-4457-9a81-e9e53bc51591 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:34.800543 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92433ac9-7f0b-4fec-9d17-168a2e626438 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:34.800709 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e14b2-993a-4457-9a81-e9e53bc51591 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:34.801279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92433ac9-7f0b-4fec-9d17-168a2e626438 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:34.801426 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e14b2-993a-4457-9a81-e9e53bc51591 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:34.801988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92433ac9-7f0b-4fec-9d17-168a2e626438 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:34.802867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e14b2-993a-4457-9a81-e9e53bc51591 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:34.817361 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92433ac9-7f0b-4fec-9d17-168a2e626438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:34.826899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-92433ac9-7f0b-4fec-9d17-168a2e626438 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 16:50:34.826899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:34.826899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:34.826899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:34.826899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:34.826899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:34.826899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:34.826899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:34.826899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:34.826899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:34.826899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:34.826899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:34.826899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:34.826899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:34.826899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:34.826899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:34.828066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:34.828066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:34.828066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:34.828066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:34.828066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:34.828066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:34.828066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:34.828066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:34.828066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:34.828066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:34.828066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:34.828066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:34.828066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:34.828066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:34.828066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:34.828066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:34.828854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:34.828854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:34.828854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:34.828854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:34.828854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:34.828854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:34.828854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:34.828854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:34.828854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:34.828854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:34.828854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 16:50:34.828854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:34.832008 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 117/240] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:34.839310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92433ac9-7f0b-4fec-9d17-168a2e626438 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:34.860563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 124/241] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 18 16:50:34 2022] POST /identity/v3/users => generated 293 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:50:35.008052 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92433ac9-7f0b-4fec-9d17-168a2e626438 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:35.047973 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:35.060328 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52205190-4b4e-4497-9ff1-aa38960e67c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:35.061021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52205190-4b4e-4497-9ff1-aa38960e67c4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:35.061308 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52205190-4b4e-4497-9ff1-aa38960e67c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:35.061594 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52205190-4b4e-4497-9ff1-aa38960e67c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:35.062403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52205190-4b4e-4497-9ff1-aa38960e67c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:35.062712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52205190-4b4e-4497-9ff1-aa38960e67c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:35.064158 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52205190-4b4e-4497-9ff1-aa38960e67c4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:35.085110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 118/242] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:35.090890 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e14b2-993a-4457-9a81-e9e53bc51591 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:35.148413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:35.244395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e14b2-993a-4457-9a81-e9e53bc51591 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:35.284719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9a30e-16ae-4a81-abb6-7fedc5ea7ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:35.285532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9a30e-16ae-4a81-abb6-7fedc5ea7ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:35.285853 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9a30e-16ae-4a81-abb6-7fedc5ea7ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:35.286131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9a30e-16ae-4a81-abb6-7fedc5ea7ff7 None admin] PATH_INFO: `/v3/users/c5d1d6f24d084669ab0b159609550b68` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:35.303781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9a30e-16ae-4a81-abb6-7fedc5ea7ff7 None admin] RBAC: Authorizing `identity:get_user(user_id=c5d1d6f24d084669ab0b159609550b68)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:35.305290 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9a30e-16ae-4a81-abb6-7fedc5ea7ff7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:35.311661 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 125/243] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:35 2022] GET /identity/v3/users/c5d1d6f24d084669ab0b159609550b68 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:35.313033 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52205190-4b4e-4497-9ff1-aa38960e67c4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:35.383997 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb5787-47f7-41bd-b297-91cff15acf52 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:35.384589 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb5787-47f7-41bd-b297-91cff15acf52 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:35.385116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb5787-47f7-41bd-b297-91cff15acf52 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:35.387197 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 126/244] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:50:35.395180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f20d28-ddac-42b0-b1f4-7e1280d8de67 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:35.395867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f20d28-ddac-42b0-b1f4-7e1280d8de67 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:35.396350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f20d28-ddac-42b0-b1f4-7e1280d8de67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:35.420472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-70f20d28-ddac-42b0-b1f4-7e1280d8de67 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:35.422097 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-70f20d28-ddac-42b0-b1f4-7e1280d8de67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:35.486133 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52205190-4b4e-4497-9ff1-aa38960e67c4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:35.519742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 127/245] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:35.539083 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0af20b-56b5-4957-bdd8-6374d73df556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:35.539679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0af20b-56b5-4957-bdd8-6374d73df556 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:35.539964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0af20b-56b5-4957-bdd8-6374d73df556 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:35.540240 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0af20b-56b5-4957-bdd8-6374d73df556 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:35.545693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f20d28-ddac-42b0-b1f4-7e1280d8de67 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:35.583878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:35.619579 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:35.636708 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0af20b-56b5-4957-bdd8-6374d73df556 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:35.638382 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0af20b-56b5-4957-bdd8-6374d73df556 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:35.680339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f20d28-ddac-42b0-b1f4-7e1280d8de67 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:35.733935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50853f-966b-4a95-81c0-d7d65801d3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:35.735140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50853f-966b-4a95-81c0-d7d65801d3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:35.735628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50853f-966b-4a95-81c0-d7d65801d3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:35.736107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50853f-966b-4a95-81c0-d7d65801d3d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:35.751190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50853f-966b-4a95-81c0-d7d65801d3d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:35.759952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 119/246] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:35.761533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32224de-7a72-4b04-996e-8e5876e17ac5 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:35.761972 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32224de-7a72-4b04-996e-8e5876e17ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:35.762374 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32224de-7a72-4b04-996e-8e5876e17ac5 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:35.763881 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 120/247] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:35.764628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-2f50853f-966b-4a95-81c0-d7d65801d3d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:35.764628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:35.764628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:35.764628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:35.764628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:35.764628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:35.764628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:35.764628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:35.764628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:35.764628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:35.764628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:35.764628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:35.764628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:35.764628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:35.764628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:35.764628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:35.765480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:35.765480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:35.765480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:35.765480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:35.765480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:35.765480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:35.765480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:35.765480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:35.765480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:35.765480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:35.765480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:35.765480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:35.765480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:35.765480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:35.765480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:35.765480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:35.766319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:35.766319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:35.766319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:35.766319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:35.766319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:35.766319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:35.766319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:35.766319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:35.766319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:35.766319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:35.766319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:35.766319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:35.768603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 128/248] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:50:35.775039 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e63b7-99d3-4930-a656-49c9fe9bf914 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:35.775515 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e63b7-99d3-4930-a656-49c9fe9bf914 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:35.775959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e63b7-99d3-4930-a656-49c9fe9bf914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:35.776998 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50853f-966b-4a95-81c0-d7d65801d3d2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:35.812147 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-797e63b7-99d3-4930-a656-49c9fe9bf914 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:35.814400 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-797e63b7-99d3-4930-a656-49c9fe9bf914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:35.936415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:35.959011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50853f-966b-4a95-81c0-d7d65801d3d2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:35.983526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 121/249] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:35.984687 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e63b7-99d3-4930-a656-49c9fe9bf914 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:36.027596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:36.038299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2425ba7-b2e5-435a-81ce-1b3cfd7fa1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:36.039403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2425ba7-b2e5-435a-81ce-1b3cfd7fa1cb None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:36.041078 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2425ba7-b2e5-435a-81ce-1b3cfd7fa1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:36.041515 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2425ba7-b2e5-435a-81ce-1b3cfd7fa1cb None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:36.043905 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2425ba7-b2e5-435a-81ce-1b3cfd7fa1cb None admin] RBAC: Authorizing `identity:get_project(project_id=451724484cdd482390defb722f90bb6c)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:36.046775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2425ba7-b2e5-435a-81ce-1b3cfd7fa1cb None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:36.048700 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 129/250] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:35 2022] GET /identity/v3/projects/451724484cdd482390defb722f90bb6c => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:36.049712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2425ba7-b2e5-435a-81ce-1b3cfd7fa1cb None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:36.201694 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e63b7-99d3-4930-a656-49c9fe9bf914 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:36.235257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2425ba7-b2e5-435a-81ce-1b3cfd7fa1cb None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:36.247894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e659d-4d3f-42ce-a07d-facd19284c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:36.248715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e659d-4d3f-42ce-a07d-facd19284c18 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:36.248903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e659d-4d3f-42ce-a07d-facd19284c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:36.249147 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e659d-4d3f-42ce-a07d-facd19284c18 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:36.249943 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e659d-4d3f-42ce-a07d-facd19284c18 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:36.250251 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e659d-4d3f-42ce-a07d-facd19284c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:36.251759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e659d-4d3f-42ce-a07d-facd19284c18 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:36.269455 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 122/251] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:36.276747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e659d-4d3f-42ce-a07d-facd19284c18 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:36.279548 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043a593-ff37-48e9-b79b-7bcb85bc269f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:36.280588 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043a593-ff37-48e9-b79b-7bcb85bc269f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:36.281095 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043a593-ff37-48e9-b79b-7bcb85bc269f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:36.281565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043a593-ff37-48e9-b79b-7bcb85bc269f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:36.294175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043a593-ff37-48e9-b79b-7bcb85bc269f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:36.305386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-a043a593-ff37-48e9-b79b-7bcb85bc269f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:50:36.305386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:36.305386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:36.305386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:36.305386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:36.305386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:36.305386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:36.305386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:36.305386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:36.305386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:36.305386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:36.305386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:36.305386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:36.305386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:36.305386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:36.305386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:36.306339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:36.306339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:36.306339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:36.306339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:36.306339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:36.306339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:36.306339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:36.306339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:36.306339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:36.306339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:36.306339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:36.306339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:36.306339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:36.306339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:36.306339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:36.306339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:36.307111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:36.307111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:36.307111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:36.307111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:36.307111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:36.307111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:36.307111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:36.307111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:36.307111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:36.307111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:36.307111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:50:36.307111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:36.309579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 130/252] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:50:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:36.310612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043a593-ff37-48e9-b79b-7bcb85bc269f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:36.327332 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:36.434260 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043a593-ff37-48e9-b79b-7bcb85bc269f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:36.459090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:36.476590 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a131a8-09c5-4a1b-96be-b7c3279aada9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:36.478644 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a131a8-09c5-4a1b-96be-b7c3279aada9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:36.479217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a131a8-09c5-4a1b-96be-b7c3279aada9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:36.480194 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a131a8-09c5-4a1b-96be-b7c3279aada9 None admin] PATH_INFO: `/v3/users/7c0848a0adf24681b66760a17129a901` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:36.482234 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a131a8-09c5-4a1b-96be-b7c3279aada9 None admin] RBAC: Authorizing `identity:get_user(user_id=7c0848a0adf24681b66760a17129a901)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:36.482621 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e659d-4d3f-42ce-a07d-facd19284c18 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:36.486710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a131a8-09c5-4a1b-96be-b7c3279aada9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:36.489974 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 131/253] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:36 2022] GET /identity/v3/users/7c0848a0adf24681b66760a17129a901 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:36.491427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a131a8-09c5-4a1b-96be-b7c3279aada9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:36.530265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664abcb-303d-4d3f-b917-63ee508de4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:36.531046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664abcb-303d-4d3f-b917-63ee508de4ad None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:36.531390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664abcb-303d-4d3f-b917-63ee508de4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:36.532559 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664abcb-303d-4d3f-b917-63ee508de4ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:36.533560 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664abcb-303d-4d3f-b917-63ee508de4ad None admin] RBAC: Adding query filter params (role.id=d00df1ddfa594cc084ad85d6d8f45791, scope.project.id=451724484cdd482390defb722f90bb6c, user.id=c5d1d6f24d084669ab0b159609550b68) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:36.534352 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664abcb-303d-4d3f-b917-63ee508de4ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:36.535501 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664abcb-303d-4d3f-b917-63ee508de4ad None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:36.544007 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 123/254] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:50:36 2022] GET /identity/v3/role_assignments?user.id=c5d1d6f24d084669ab0b159609550b68&scope.project.id=451724484cdd482390defb722f90bb6c&role.id=d00df1ddfa594cc084ad85d6d8f45791 => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:36.545460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b192fe0-4330-4a91-b066-484f203b41c4 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:36.545852 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b192fe0-4330-4a91-b066-484f203b41c4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:36.546207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b192fe0-4330-4a91-b066-484f203b41c4 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:36.551911 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 124/255] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:36.551911 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b192fe0-4330-4a91-b066-484f203b41c4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:36.612816 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:36.641605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a131a8-09c5-4a1b-96be-b7c3279aada9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:36.693357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284ca00-769d-43db-a95f-732f00019337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:36.694956 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284ca00-769d-43db-a95f-732f00019337 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:36.695453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284ca00-769d-43db-a95f-732f00019337 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:36.695871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b192fe0-4330-4a91-b066-484f203b41c4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:36.696107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284ca00-769d-43db-a95f-732f00019337 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:36.697104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284ca00-769d-43db-a95f-732f00019337 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:36.697577 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284ca00-769d-43db-a95f-732f00019337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:36.700635 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284ca00-769d-43db-a95f-732f00019337 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:36.712978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 132/256] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:36.715339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab3347-9b2a-4c7a-8c36-3d79846c8f21 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:36.715779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab3347-9b2a-4c7a-8c36-3d79846c8f21 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:36.716200 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab3347-9b2a-4c7a-8c36-3d79846c8f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:36.737362 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47dd6b-1e7c-40fa-bed0-36aff73d060e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:36.738490 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47dd6b-1e7c-40fa-bed0-36aff73d060e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:36.738923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47dd6b-1e7c-40fa-bed0-36aff73d060e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:36.739303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47dd6b-1e7c-40fa-bed0-36aff73d060e None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:36.741324 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47dd6b-1e7c-40fa-bed0-36aff73d060e None admin] RBAC: Authorizing `identity:get_project(project_id=451724484cdd482390defb722f90bb6c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:36.741687 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a3ab3347-9b2a-4c7a-8c36-3d79846c8f21 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:36.743077 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a3ab3347-9b2a-4c7a-8c36-3d79846c8f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:36.743386 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47dd6b-1e7c-40fa-bed0-36aff73d060e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:36.745650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 125/257] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:36 2022] GET /identity/v3/projects/451724484cdd482390defb722f90bb6c => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:36.746581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47dd6b-1e7c-40fa-bed0-36aff73d060e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:36.769781 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:36.855570 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 133/258] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:36.856658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab3347-9b2a-4c7a-8c36-3d79846c8f21 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:36.961235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47dd6b-1e7c-40fa-bed0-36aff73d060e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:36.984739 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:37.013326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04a4bd-afb0-4c35-8a86-6897f306df12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:37.014244 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04a4bd-afb0-4c35-8a86-6897f306df12 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:37.014524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04a4bd-afb0-4c35-8a86-6897f306df12 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:37.014797 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04a4bd-afb0-4c35-8a86-6897f306df12 None admin] PATH_INFO: `/v3/users/4aa089d7c8da4a4f99db6184504cf48f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:37.021824 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04a4bd-afb0-4c35-8a86-6897f306df12 None admin] RBAC: Authorizing `identity:get_user(user_id=4aa089d7c8da4a4f99db6184504cf48f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:37.024124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04a4bd-afb0-4c35-8a86-6897f306df12 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:37.025846 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 126/259] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:36 2022] GET /identity/v3/users/4aa089d7c8da4a4f99db6184504cf48f => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:37.026617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04a4bd-afb0-4c35-8a86-6897f306df12 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:37.063679 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab3347-9b2a-4c7a-8c36-3d79846c8f21 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:37.135525 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f620543-ecf5-48ce-a757-d613f1b6ad88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:37.136430 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f620543-ecf5-48ce-a757-d613f1b6ad88 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:37.136710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f620543-ecf5-48ce-a757-d613f1b6ad88 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:37.136983 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f620543-ecf5-48ce-a757-d613f1b6ad88 None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c/users/7c0848a0adf24681b66760a17129a901/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:37.140525 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f620543-ecf5-48ce-a757-d613f1b6ad88 None admin] RBAC: Authorizing `identity:create_grant(project_id=451724484cdd482390defb722f90bb6c, user_id=7c0848a0adf24681b66760a17129a901, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:37.142011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f620543-ecf5-48ce-a757-d613f1b6ad88 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:37.147522 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:37.172456 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 134/260] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:50:36 2022] PUT /identity/v3/projects/451724484cdd482390defb722f90bb6c/users/7c0848a0adf24681b66760a17129a901/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:50:37.173606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f620543-ecf5-48ce-a757-d613f1b6ad88 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:37.202278 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04a4bd-afb0-4c35-8a86-6897f306df12 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:37.268074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2215b6-3255-46b3-99d2-81e98fe38ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:37.268926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2215b6-3255-46b3-99d2-81e98fe38ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:37.269301 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2215b6-3255-46b3-99d2-81e98fe38ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:37.269589 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2215b6-3255-46b3-99d2-81e98fe38ef3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:37.288510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2215b6-3255-46b3-99d2-81e98fe38ef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:37.302673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-2d2215b6-3255-46b3-99d2-81e98fe38ef3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:37.302673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:37.302673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:37.302673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:37.302673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:37.302673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:37.302673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:37.302673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:37.302673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:37.302673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:37.302673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:37.302673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:37.302673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:37.302673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:37.302673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:37.302673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:37.305068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:37.305068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:37.305068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:37.305068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:37.305068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:37.305068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:37.305068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:37.305068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:37.305068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:37.305068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:37.305068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:37.305068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:37.305068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:37.305068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:37.305068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:37.305068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:37.307161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:37.307161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:37.307161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:37.307161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:37.307161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:37.307161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:37.307161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:37.307161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:37.307161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:37.307161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:37.307161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:37.307161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:37.307161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 127/261] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:50:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:37.313094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2215b6-3255-46b3-99d2-81e98fe38ef3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:37.319746 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f620543-ecf5-48ce-a757-d613f1b6ad88 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:37.354773 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:37.362828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdb656-2b21-42bb-a08c-fe91ce6cf7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:37.363668 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdb656-2b21-42bb-a08c-fe91ce6cf7ce None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:37.364106 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdb656-2b21-42bb-a08c-fe91ce6cf7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:37.364462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdb656-2b21-42bb-a08c-fe91ce6cf7ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:37.446874 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdb656-2b21-42bb-a08c-fe91ce6cf7ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:37.448471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdb656-2b21-42bb-a08c-fe91ce6cf7ce None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:37.483622 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2215b6-3255-46b3-99d2-81e98fe38ef3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:37.525495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52f594-d37f-4f36-a085-da0bc8ca0a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:37.526134 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52f594-d37f-4f36-a085-da0bc8ca0a34 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:37.526423 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52f594-d37f-4f36-a085-da0bc8ca0a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:37.526754 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52f594-d37f-4f36-a085-da0bc8ca0a34 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:37.527642 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52f594-d37f-4f36-a085-da0bc8ca0a34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:37.527959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52f594-d37f-4f36-a085-da0bc8ca0a34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:37.529515 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52f594-d37f-4f36-a085-da0bc8ca0a34 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:37.540560 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 128/262] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:50:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:37.546487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52f594-d37f-4f36-a085-da0bc8ca0a34 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:37.549708 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:37.573452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 135/263] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:37.580079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdb656-2b21-42bb-a08c-fe91ce6cf7ce None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:37.615794 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:37.674094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52f594-d37f-4f36-a085-da0bc8ca0a34 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:37.699601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdb656-2b21-42bb-a08c-fe91ce6cf7ce None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:37.715210 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ce0df-7afe-41e5-8f46-1f60b28f61d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:37.716204 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ce0df-7afe-41e5-8f46-1f60b28f61d2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:37.716496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ce0df-7afe-41e5-8f46-1f60b28f61d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:37.716775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ce0df-7afe-41e5-8f46-1f60b28f61d2 None admin] PATH_INFO: `/v3/users/4aa089d7c8da4a4f99db6184504cf48f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:37.718031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ce0df-7afe-41e5-8f46-1f60b28f61d2 None admin] RBAC: Authorizing `identity:get_user(user_id=4aa089d7c8da4a4f99db6184504cf48f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:37.719848 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ce0df-7afe-41e5-8f46-1f60b28f61d2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:37.721937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 129/264] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:37 2022] GET /identity/v3/users/4aa089d7c8da4a4f99db6184504cf48f => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:37.728508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ce0df-7afe-41e5-8f46-1f60b28f61d2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:37.738509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96794d41-847e-471c-9675-b06e7d4fcfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:37.739504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96794d41-847e-471c-9675-b06e7d4fcfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:37.739786 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96794d41-847e-471c-9675-b06e7d4fcfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:37.740066 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96794d41-847e-471c-9675-b06e7d4fcfe8 None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:37.742061 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96794d41-847e-471c-9675-b06e7d4fcfe8 None admin] RBAC: Authorizing `identity:get_project(project_id=451724484cdd482390defb722f90bb6c)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:37.743679 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96794d41-847e-471c-9675-b06e7d4fcfe8 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:37.745917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 136/265] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:37 2022] GET /identity/v3/projects/451724484cdd482390defb722f90bb6c => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:37.752036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96794d41-847e-471c-9675-b06e7d4fcfe8 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:37.826301 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:37.874182 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:37.878650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96794d41-847e-471c-9675-b06e7d4fcfe8 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:37.889565 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ce0df-7afe-41e5-8f46-1f60b28f61d2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:37.933911 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4f86c-ef00-406f-bb95-79efde2c8d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:37.934721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4f86c-ef00-406f-bb95-79efde2c8d7b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:37.935008 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4f86c-ef00-406f-bb95-79efde2c8d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:37.935282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4f86c-ef00-406f-bb95-79efde2c8d7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:37.936157 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4f86c-ef00-406f-bb95-79efde2c8d7b None admin] RBAC: Adding query filter params (role.id=b3f3f4910bf646699f30b749edeef422, scope.project.id=451724484cdd482390defb722f90bb6c, user.id=4aa089d7c8da4a4f99db6184504cf48f) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:37.936466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4f86c-ef00-406f-bb95-79efde2c8d7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:37.937971 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4f86c-ef00-406f-bb95-79efde2c8d7b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:37.953711 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 137/266] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:50:37 2022] GET /identity/v3/role_assignments?user.id=4aa089d7c8da4a4f99db6184504cf48f&scope.project.id=451724484cdd482390defb722f90bb6c&role.id=b3f3f4910bf646699f30b749edeef422 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:37.964305 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6982379-4e96-4d73-ae19-ffea2f2a45f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:37.965556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6982379-4e96-4d73-ae19-ffea2f2a45f9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:37.966153 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6982379-4e96-4d73-ae19-ffea2f2a45f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:37.966664 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6982379-4e96-4d73-ae19-ffea2f2a45f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:38.115604 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6982379-4e96-4d73-ae19-ffea2f2a45f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:38.119150 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6982379-4e96-4d73-ae19-ffea2f2a45f9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:38.265540 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:38.315934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 130/267] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 16:50:38.324746 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4f86c-ef00-406f-bb95-79efde2c8d7b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:38.421776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6f39f-ed8d-487b-9da4-67e1796bec06 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:38.421776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6f39f-ed8d-487b-9da4-67e1796bec06 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:38.421776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6f39f-ed8d-487b-9da4-67e1796bec06 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:38.427914 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 131/268] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:38.461709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13574a6a-5b1d-4bbb-b646-94b8cb2e99e2 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:38.462390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13574a6a-5b1d-4bbb-b646-94b8cb2e99e2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:38.462908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13574a6a-5b1d-4bbb-b646-94b8cb2e99e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:38.474933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4f86c-ef00-406f-bb95-79efde2c8d7b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:38.508158 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-13574a6a-5b1d-4bbb-b646-94b8cb2e99e2 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:38.509845 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-13574a6a-5b1d-4bbb-b646-94b8cb2e99e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:38.513527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49027896-7e4a-4e0b-b0a2-b70280a8dac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:38.514436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49027896-7e4a-4e0b-b0a2-b70280a8dac0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:38.514709 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49027896-7e4a-4e0b-b0a2-b70280a8dac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:38.514979 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49027896-7e4a-4e0b-b0a2-b70280a8dac0 None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:38.516215 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49027896-7e4a-4e0b-b0a2-b70280a8dac0 None admin] RBAC: Authorizing `identity:get_project(project_id=451724484cdd482390defb722f90bb6c)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:38.517713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49027896-7e4a-4e0b-b0a2-b70280a8dac0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:38.519643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 138/269] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:38 2022] GET /identity/v3/projects/451724484cdd482390defb722f90bb6c => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:38.527407 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49027896-7e4a-4e0b-b0a2-b70280a8dac0 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:38.606091 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:38.659299 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 132/270] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:38.715713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49027896-7e4a-4e0b-b0a2-b70280a8dac0 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:38.732883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13574a6a-5b1d-4bbb-b646-94b8cb2e99e2 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:38.757691 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4598e-503d-4312-b234-d4562d5c0e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:38.758632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4598e-503d-4312-b234-d4562d5c0e42 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:38.759042 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4598e-503d-4312-b234-d4562d5c0e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:38.759438 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4598e-503d-4312-b234-d4562d5c0e42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:38.760401 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4598e-503d-4312-b234-d4562d5c0e42 None admin] RBAC: Adding query filter params (role.id=7a9281e8b95a43c58cf4d0c272dd1469, scope.project.id=451724484cdd482390defb722f90bb6c, user.id=4aa089d7c8da4a4f99db6184504cf48f) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:38.760837 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4598e-503d-4312-b234-d4562d5c0e42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:38.762456 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4598e-503d-4312-b234-d4562d5c0e42 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:38.769421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 139/271] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:50:38 2022] GET /identity/v3/role_assignments?user.id=4aa089d7c8da4a4f99db6184504cf48f&scope.project.id=451724484cdd482390defb722f90bb6c&role.id=7a9281e8b95a43c58cf4d0c272dd1469 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:38.902909 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:38.907283 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13574a6a-5b1d-4bbb-b646-94b8cb2e99e2 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:38.939005 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d38a6-fdb9-4c2a-98a0-9cbe2f13440a None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:38.939562 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d38a6-fdb9-4c2a-98a0-9cbe2f13440a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:38.939979 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d38a6-fdb9-4c2a-98a0-9cbe2f13440a None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:38.941518 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 140/272] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:50:38.951833 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807959c-408f-4f63-a6f4-a114d47106c1 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:38.952350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807959c-408f-4f63-a6f4-a114d47106c1 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:38.952811 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807959c-408f-4f63-a6f4-a114d47106c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:38.958386 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038dc2a-11f3-460c-b97e-1a3a3fc9faeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:38.959187 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038dc2a-11f3-460c-b97e-1a3a3fc9faeb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:38.960019 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038dc2a-11f3-460c-b97e-1a3a3fc9faeb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:38.960307 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038dc2a-11f3-460c-b97e-1a3a3fc9faeb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:38.979512 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038dc2a-11f3-460c-b97e-1a3a3fc9faeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:38.990888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-0038dc2a-11f3-460c-b97e-1a3a3fc9faeb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:38.990888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:38.990888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:38.990888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:38.990888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:38.990888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:38.990888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:38.990888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:38.990888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:38.990888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:38.990888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:38.990888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:38.990888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:38.990888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:38.990888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:38.990888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:38.991828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:38.991828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:38.991828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:38.991828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:38.991828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:38.991828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:38.991828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:38.991828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:38.991828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:38.991828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:38.991828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:38.991828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:38.991828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:38.991828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:38.991828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:38.991828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:38.992618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:38.992618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:38.992618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:38.992618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:38.992618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:38.992618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:38.992618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:38.992618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:38.992618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:38.992618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:38.992618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:38.992618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:38.992618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 133/273] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:50:38.994064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2807959c-408f-4f63-a6f4-a114d47106c1 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:38.994639 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2807959c-408f-4f63-a6f4-a114d47106c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:39.005400 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038dc2a-11f3-460c-b97e-1a3a3fc9faeb None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:39.091476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 141/274] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:39.125565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807959c-408f-4f63-a6f4-a114d47106c1 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:39.164500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:39.173680 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038dc2a-11f3-460c-b97e-1a3a3fc9faeb None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:39.216756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6f570-1ba6-433c-9756-7e2a4f206cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:39.218008 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6f570-1ba6-433c-9756-7e2a4f206cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:39.218506 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6f570-1ba6-433c-9756-7e2a4f206cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:39.218987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6f570-1ba6-433c-9756-7e2a4f206cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:39.220050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6f570-1ba6-433c-9756-7e2a4f206cd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:39.220714 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6f570-1ba6-433c-9756-7e2a4f206cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:39.222453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6f570-1ba6-433c-9756-7e2a4f206cd3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:39.233428 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 134/275] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:39.240408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6f570-1ba6-433c-9756-7e2a4f206cd3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:39.268675 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807959c-408f-4f63-a6f4-a114d47106c1 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:39.273900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:39.312410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15bfee-a063-4421-ab3d-3d1427858b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:39.313303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15bfee-a063-4421-ab3d-3d1427858b28 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:39.313851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15bfee-a063-4421-ab3d-3d1427858b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:39.314356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15bfee-a063-4421-ab3d-3d1427858b28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:39.315770 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15bfee-a063-4421-ab3d-3d1427858b28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:39.317629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15bfee-a063-4421-ab3d-3d1427858b28 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:39.320812 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 142/276] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:50:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:39.325913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15bfee-a063-4421-ab3d-3d1427858b28 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:39.366489 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6f570-1ba6-433c-9756-7e2a4f206cd3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:39.410015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046fe41-cb4a-4520-959f-3944787d5b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:39.411341 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046fe41-cb4a-4520-959f-3944787d5b17 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:39.411780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046fe41-cb4a-4520-959f-3944787d5b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:39.412204 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046fe41-cb4a-4520-959f-3944787d5b17 None admin] PATH_INFO: `/v3/users/d244adf6808a4a29864b211144dbda68` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:39.429306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046fe41-cb4a-4520-959f-3944787d5b17 None admin] RBAC: Authorizing `identity:get_user(user_id=d244adf6808a4a29864b211144dbda68)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:39.431127 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046fe41-cb4a-4520-959f-3944787d5b17 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:39.433802 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 135/277] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:39 2022] GET /identity/v3/users/d244adf6808a4a29864b211144dbda68 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:39.439839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046fe41-cb4a-4520-959f-3944787d5b17 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:39.452438 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:39.464737 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15bfee-a063-4421-ab3d-3d1427858b28 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:39.504708 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577c824-9b6b-4e0d-94b6-5217fc57ae39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:39.505693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577c824-9b6b-4e0d-94b6-5217fc57ae39 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:39.506151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577c824-9b6b-4e0d-94b6-5217fc57ae39 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:39.507938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577c824-9b6b-4e0d-94b6-5217fc57ae39 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:39.508998 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577c824-9b6b-4e0d-94b6-5217fc57ae39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:39.510724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577c824-9b6b-4e0d-94b6-5217fc57ae39 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:39.530211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:39.541082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 143/278] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 18 16:50:39 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:50:39.564646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046fe41-cb4a-4520-959f-3944787d5b17 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:39.627934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a8753-9592-41be-98a1-fedc4bbee2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:39.628618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a8753-9592-41be-98a1-fedc4bbee2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:39.628897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a8753-9592-41be-98a1-fedc4bbee2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:39.629171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a8753-9592-41be-98a1-fedc4bbee2a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:39.630065 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a8753-9592-41be-98a1-fedc4bbee2a2 None admin] RBAC: Adding query filter params (role.id=bfec786c9ea74c4aaecf243a866539af, user.id=d244adf6808a4a29864b211144dbda68, scope.system=all) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:39.630371 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a8753-9592-41be-98a1-fedc4bbee2a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:39.632483 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a8753-9592-41be-98a1-fedc4bbee2a2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:39.638936 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 136/279] 10.222.0.49 () {56 vars in 1308 bytes} [Wed May 18 16:50:39 2022] GET /identity/v3/role_assignments?user.id=d244adf6808a4a29864b211144dbda68&scope.system=all&role.id=bfec786c9ea74c4aaecf243a866539af => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:39.802604 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fbcfa-ae40-4f8f-8787-fc7edd4d2fd9 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:39.802894 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fbcfa-ae40-4f8f-8787-fc7edd4d2fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:39.804197 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fbcfa-ae40-4f8f-8787-fc7edd4d2fd9 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:39.806474 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 144/280] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:39.814614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc82f7-7e31-45d0-9769-25245e15d5ef None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:39.814924 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc82f7-7e31-45d0-9769-25245e15d5ef None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:39.815186 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc82f7-7e31-45d0-9769-25245e15d5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:39.837063 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1bdc82f7-7e31-45d0-9769-25245e15d5ef None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:39.838336 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1bdc82f7-7e31-45d0-9769-25245e15d5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:39.924240 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 137/281] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:39.947823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fbcfa-ae40-4f8f-8787-fc7edd4d2fd9 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:40.074221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fbcfa-ae40-4f8f-8787-fc7edd4d2fd9 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:40.117288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb25d636-f709-46bf-a016-2c85275211db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:40.118136 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25d636-f709-46bf-a016-2c85275211db None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:40.118419 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25d636-f709-46bf-a016-2c85275211db None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:40.118692 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb25d636-f709-46bf-a016-2c85275211db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:40.137484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb25d636-f709-46bf-a016-2c85275211db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:40.145564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-cb25d636-f709-46bf-a016-2c85275211db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 16:50:40.145564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:40.145564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:40.145564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:40.145564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:40.145564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:40.145564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:40.145564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:40.145564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:40.145564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:40.145564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:40.145564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:40.145564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:40.145564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:40.145564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:40.145564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:40.146532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:40.146532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:40.146532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:40.146532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:40.146532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:40.146532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:40.146532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:40.146532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:40.146532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:40.146532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:40.146532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:40.146532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:40.146532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:40.146532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:40.146532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:40.146532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:40.147842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:40.147842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:40.147842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:40.147842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:40.147842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:40.147842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:40.147842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:40.147842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:40.147842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:40.147842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:40.147842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 16:50:40.147842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:40.147842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 145/282] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:40.153712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc82f7-7e31-45d0-9769-25245e15d5ef None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:40.324333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:40.355214 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc82f7-7e31-45d0-9769-25245e15d5ef None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:40.404735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd524c-1d7e-4ca2-842d-ccc95b4afe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:40.405415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd524c-1d7e-4ca2-842d-ccc95b4afe2d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:40.405714 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd524c-1d7e-4ca2-842d-ccc95b4afe2d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:40.405990 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd524c-1d7e-4ca2-842d-ccc95b4afe2d None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:40.406756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd524c-1d7e-4ca2-842d-ccc95b4afe2d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:40.407115 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd524c-1d7e-4ca2-842d-ccc95b4afe2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:40.408567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd524c-1d7e-4ca2-842d-ccc95b4afe2d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:40.413780 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f24cfc-ed8d-4aca-961a-62bf57b6558e None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:40.414358 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f24cfc-ed8d-4aca-961a-62bf57b6558e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:40.414358 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f24cfc-ed8d-4aca-961a-62bf57b6558e None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:40.415720 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 146/283] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:50:40.421998 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc5238-eb62-4300-89d7-e9f87c9514c6 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:40.422289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc5238-eb62-4300-89d7-e9f87c9514c6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:40.422571 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc5238-eb62-4300-89d7-e9f87c9514c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:40.435660 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 138/284] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:40.442493 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd524c-1d7e-4ca2-842d-ccc95b4afe2d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:40.449575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-38bc5238-eb62-4300-89d7-e9f87c9514c6 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:40.450817 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-38bc5238-eb62-4300-89d7-e9f87c9514c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:40.453214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:40.560214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 147/285] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:40.603134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc5238-eb62-4300-89d7-e9f87c9514c6 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:40.699268 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd524c-1d7e-4ca2-842d-ccc95b4afe2d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:40.748201 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc5238-eb62-4300-89d7-e9f87c9514c6 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:40.776154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded64c0-3a4f-4950-be86-4721a394246a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:40.777045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded64c0-3a4f-4950-be86-4721a394246a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:40.777326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded64c0-3a4f-4950-be86-4721a394246a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:40.777600 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded64c0-3a4f-4950-be86-4721a394246a None admin] PATH_INFO: `/v3/users/c5d1d6f24d084669ab0b159609550b68` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:40.778989 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded64c0-3a4f-4950-be86-4721a394246a None admin] RBAC: Authorizing `identity:get_user(user_id=c5d1d6f24d084669ab0b159609550b68)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:40.780447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded64c0-3a4f-4950-be86-4721a394246a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:40.782111 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 139/286] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:40 2022] GET /identity/v3/users/c5d1d6f24d084669ab0b159609550b68 => generated 297 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:40.788895 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded64c0-3a4f-4950-be86-4721a394246a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:40.796493 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:40.818321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f296de-2add-4135-ae09-4d6925ea30a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:40.819168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f296de-2add-4135-ae09-4d6925ea30a4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:40.819449 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f296de-2add-4135-ae09-4d6925ea30a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:40.819723 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f296de-2add-4135-ae09-4d6925ea30a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:40.838013 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:40.843931 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f296de-2add-4135-ae09-4d6925ea30a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:40.868203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-59f296de-2add-4135-ae09-4d6925ea30a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:40.868203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:40.868203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:40.868203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:40.868203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:40.868203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:40.868203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:40.868203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:40.868203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:40.868203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:40.868203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:40.868203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:40.868203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:40.868203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:40.868203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:40.868203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:40.869145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:40.869145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:40.869145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:40.869145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:40.869145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:40.869145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:40.869145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:40.869145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:40.869145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:40.869145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:40.869145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:40.869145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:40.869145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:40.869145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:40.869145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:40.869145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:40.869957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:40.869957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:40.869957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:40.869957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:40.869957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:40.869957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:40.869957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:40.869957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:40.869957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:40.869957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:40.869957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:40.869957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:40.869957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 148/287] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:40.878559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f296de-2add-4135-ae09-4d6925ea30a4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:40.986525 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded64c0-3a4f-4950-be86-4721a394246a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:41.023424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4250121-f6e1-4527-9d63-97e995bac32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:41.024388 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4250121-f6e1-4527-9d63-97e995bac32f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:41.024726 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4250121-f6e1-4527-9d63-97e995bac32f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:41.025009 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4250121-f6e1-4527-9d63-97e995bac32f None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:41.026541 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4250121-f6e1-4527-9d63-97e995bac32f None admin] RBAC: Authorizing `identity:get_project(project_id=451724484cdd482390defb722f90bb6c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:41.028020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4250121-f6e1-4527-9d63-97e995bac32f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:41.029813 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 140/288] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:40 2022] GET /identity/v3/projects/451724484cdd482390defb722f90bb6c => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:41.035376 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4250121-f6e1-4527-9d63-97e995bac32f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:41.105540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f296de-2add-4135-ae09-4d6925ea30a4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:41.130190 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:41.154964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4250121-f6e1-4527-9d63-97e995bac32f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:41.190415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62c4d3-3cbb-42e2-845c-a26a65b47024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:41.191104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62c4d3-3cbb-42e2-845c-a26a65b47024 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:41.191377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62c4d3-3cbb-42e2-845c-a26a65b47024 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:41.191653 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62c4d3-3cbb-42e2-845c-a26a65b47024 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:41.192421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62c4d3-3cbb-42e2-845c-a26a65b47024 None admin] RBAC: Adding query filter params (name=member) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:41.192727 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62c4d3-3cbb-42e2-845c-a26a65b47024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:41.194185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62c4d3-3cbb-42e2-845c-a26a65b47024 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:41.197937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753101f-f25b-43ff-a05e-bae697eca3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:41.198831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753101f-f25b-43ff-a05e-bae697eca3ce None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:41.199110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753101f-f25b-43ff-a05e-bae697eca3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:41.199384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753101f-f25b-43ff-a05e-bae697eca3ce None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c/users/c5d1d6f24d084669ab0b159609550b68/roles/d00df1ddfa594cc084ad85d6d8f45791` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:41.202200 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753101f-f25b-43ff-a05e-bae697eca3ce None admin] RBAC: Authorizing `identity:create_grant(project_id=451724484cdd482390defb722f90bb6c, user_id=c5d1d6f24d084669ab0b159609550b68, role_id=d00df1ddfa594cc084ad85d6d8f45791)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:41.203650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753101f-f25b-43ff-a05e-bae697eca3ce None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:41.216164 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 149/289] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:41.226890 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62c4d3-3cbb-42e2-845c-a26a65b47024 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:41.228907 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 141/290] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:50:41 2022] PUT /identity/v3/projects/451724484cdd482390defb722f90bb6c/users/c5d1d6f24d084669ab0b159609550b68/roles/d00df1ddfa594cc084ad85d6d8f45791 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 16:50:41.354939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:41.413864 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62c4d3-3cbb-42e2-845c-a26a65b47024 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:41.464203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018faeb6-84d5-44ef-8b5e-0bf0c4fade86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:41.465086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018faeb6-84d5-44ef-8b5e-0bf0c4fade86 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:41.465365 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018faeb6-84d5-44ef-8b5e-0bf0c4fade86 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:41.465638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018faeb6-84d5-44ef-8b5e-0bf0c4fade86 None admin] PATH_INFO: `/v3/users/7c0848a0adf24681b66760a17129a901` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:41.466896 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018faeb6-84d5-44ef-8b5e-0bf0c4fade86 None admin] RBAC: Authorizing `identity:get_user(user_id=7c0848a0adf24681b66760a17129a901)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:41.468444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018faeb6-84d5-44ef-8b5e-0bf0c4fade86 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:41.470180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 150/291] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:41 2022] GET /identity/v3/users/7c0848a0adf24681b66760a17129a901 => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:41.475851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753101f-f25b-43ff-a05e-bae697eca3ce None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:41.601387 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753101f-f25b-43ff-a05e-bae697eca3ce None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:41.644985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:41.652324 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b05e9-8b64-4e10-9fc7-a1f8cee78bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:41.653187 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b05e9-8b64-4e10-9fc7-a1f8cee78bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:41.653612 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b05e9-8b64-4e10-9fc7-a1f8cee78bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:41.654058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b05e9-8b64-4e10-9fc7-a1f8cee78bb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:41.754456 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b05e9-8b64-4e10-9fc7-a1f8cee78bb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:41.756795 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b05e9-8b64-4e10-9fc7-a1f8cee78bb8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:41.889262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 142/292] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:41.898740 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018faeb6-84d5-44ef-8b5e-0bf0c4fade86 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:42.031100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018faeb6-84d5-44ef-8b5e-0bf0c4fade86 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:42.064307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:42.075431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281422c1-5eb4-4e89-8563-122f1ca97c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:42.076366 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281422c1-5eb4-4e89-8563-122f1ca97c3c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:42.076704 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281422c1-5eb4-4e89-8563-122f1ca97c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:42.076991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281422c1-5eb4-4e89-8563-122f1ca97c3c None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:42.078302 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281422c1-5eb4-4e89-8563-122f1ca97c3c None admin] RBAC: Authorizing `identity:get_project(project_id=451724484cdd482390defb722f90bb6c)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:42.079790 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281422c1-5eb4-4e89-8563-122f1ca97c3c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:42.081819 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 151/293] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:41 2022] GET /identity/v3/projects/451724484cdd482390defb722f90bb6c => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:42.088598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b05e9-8b64-4e10-9fc7-a1f8cee78bb8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:42.144682 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:42.253389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b05e9-8b64-4e10-9fc7-a1f8cee78bb8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:42.306482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac20baa-7170-4187-9490-87ad1591b483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:42.307501 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac20baa-7170-4187-9490-87ad1591b483 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:42.307981 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac20baa-7170-4187-9490-87ad1591b483 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:42.308452 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac20baa-7170-4187-9490-87ad1591b483 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:42.309508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac20baa-7170-4187-9490-87ad1591b483 None admin] RBAC: Adding query filter params (role.id=bfec786c9ea74c4aaecf243a866539af, scope.project.id=451724484cdd482390defb722f90bb6c, user.id=7c0848a0adf24681b66760a17129a901) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:42.310036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac20baa-7170-4187-9490-87ad1591b483 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:42.311675 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac20baa-7170-4187-9490-87ad1591b483 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:42.318757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 143/294] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:50:42 2022] GET /identity/v3/role_assignments?user.id=7c0848a0adf24681b66760a17129a901&scope.project.id=451724484cdd482390defb722f90bb6c&role.id=bfec786c9ea74c4aaecf243a866539af => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:42.374080 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5836f8-f1a0-4e99-91fa-c5ab1bae00d9 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:42.374468 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5836f8-f1a0-4e99-91fa-c5ab1bae00d9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:42.374676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5836f8-f1a0-4e99-91fa-c5ab1bae00d9 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:42.376191 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 152/295] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:42.382865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585cc16-3645-4f79-8164-dd3aaa188bcd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:42.383494 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585cc16-3645-4f79-8164-dd3aaa188bcd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:42.383996 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585cc16-3645-4f79-8164-dd3aaa188bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:42.418337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0585cc16-3645-4f79-8164-dd3aaa188bcd None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:42.420064 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0585cc16-3645-4f79-8164-dd3aaa188bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:42.535035 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 144/296] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:50:42.540795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e3ff3-6bc3-4efd-a867-28fa3a8da3de None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:42.541318 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e3ff3-6bc3-4efd-a867-28fa3a8da3de None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:42.541318 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e3ff3-6bc3-4efd-a867-28fa3a8da3de None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:42.543047 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 153/297] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:42.548579 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71217c-821d-43f1-8112-13f3dba68c1f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:42.549032 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71217c-821d-43f1-8112-13f3dba68c1f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:42.549448 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71217c-821d-43f1-8112-13f3dba68c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:42.560907 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e3ff3-6bc3-4efd-a867-28fa3a8da3de None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:42.569949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5b71217c-821d-43f1-8112-13f3dba68c1f None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:42.572919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5b71217c-821d-43f1-8112-13f3dba68c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:42.612666 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:42.691031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 145/298] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:42.718032 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e3ff3-6bc3-4efd-a867-28fa3a8da3de None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:42.723026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71217c-821d-43f1-8112-13f3dba68c1f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:42.759655 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43c1dd-f27c-4de2-a127-1a67b607b6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:42.760441 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43c1dd-f27c-4de2-a127-1a67b607b6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:42.760724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43c1dd-f27c-4de2-a127-1a67b607b6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:42.760998 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43c1dd-f27c-4de2-a127-1a67b607b6d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:42.774516 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43c1dd-f27c-4de2-a127-1a67b607b6d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:42.782435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-ae43c1dd-f27c-4de2-a127-1a67b607b6d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:42.782435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:42.782435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:42.782435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:42.782435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:42.782435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:42.782435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:42.782435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:42.782435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:42.782435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:42.782435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:42.782435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:42.782435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:42.782435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:42.782435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:42.782435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:42.783364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:42.783364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:42.783364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:42.783364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:42.783364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:42.783364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:42.783364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:42.783364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:42.783364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:42.783364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:42.783364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:42.783364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:42.783364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:42.783364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:42.783364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:42.783364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:42.784159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:42.784159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:42.784159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:42.784159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:42.784159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:42.784159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:42.784159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:42.784159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:42.784159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:42.784159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:42.784159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:42.784159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:42.784159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 154/299] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:50:42.793232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43c1dd-f27c-4de2-a127-1a67b607b6d7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:42.860291 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71217c-821d-43f1-8112-13f3dba68c1f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:42.864711 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:42.895948 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739110a9-f122-4b88-8f85-0553f8e49fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:42.897264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739110a9-f122-4b88-8f85-0553f8e49fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:42.897544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739110a9-f122-4b88-8f85-0553f8e49fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:42.897845 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739110a9-f122-4b88-8f85-0553f8e49fd2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:42.907945 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739110a9-f122-4b88-8f85-0553f8e49fd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:42.915745 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43c1dd-f27c-4de2-a127-1a67b607b6d7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:42.916184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-739110a9-f122-4b88-8f85-0553f8e49fd2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 16:50:42.916184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:42.916184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:42.916184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:42.916184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:42.916184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:42.916184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:42.916184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:42.916184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:42.916184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:42.916184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:42.916184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:42.916184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:42.916184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:42.916184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:42.916184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:42.917036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:42.917036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:42.917036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:42.917036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:42.917036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:42.917036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:42.917036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:42.917036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:42.917036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:42.917036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:42.917036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:42.917036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:42.917036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:42.917036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:42.917036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:42.917036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:42.917883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:42.917883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:42.917883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:42.917883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:42.917883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:42.917883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:42.917883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:42.917883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:42.917883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:42.917883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:42.917883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 16:50:42.917883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:42.917883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 146/300] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:50:42.919143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee43d9e-4a53-495c-9252-88f7f2100ab9 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:42.919143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee43d9e-4a53-495c-9252-88f7f2100ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:42.919143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee43d9e-4a53-495c-9252-88f7f2100ab9 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:42.920573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 147/301] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:42.925161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee43d9e-4a53-495c-9252-88f7f2100ab9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:42.944319 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:42.961364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0959643-d3c7-4d04-b61a-1d85e0fc7f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:42.962247 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0959643-d3c7-4d04-b61a-1d85e0fc7f3e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:42.962542 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0959643-d3c7-4d04-b61a-1d85e0fc7f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:42.962931 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0959643-d3c7-4d04-b61a-1d85e0fc7f3e None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:42.963806 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0959643-d3c7-4d04-b61a-1d85e0fc7f3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:42.964119 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0959643-d3c7-4d04-b61a-1d85e0fc7f3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:42.965512 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0959643-d3c7-4d04-b61a-1d85e0fc7f3e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:42.979894 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 155/302] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:42.981334 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b71ce-b257-4002-8c05-194f64663870 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:42.981632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b71ce-b257-4002-8c05-194f64663870 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:42.982063 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b71ce-b257-4002-8c05-194f64663870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:42.999752 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c06b71ce-b257-4002-8c05-194f64663870 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:43.000976 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c06b71ce-b257-4002-8c05-194f64663870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:43.033390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee43d9e-4a53-495c-9252-88f7f2100ab9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:43.078699 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 156/303] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:43.080627 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b71ce-b257-4002-8c05-194f64663870 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:43.080740 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f111056-4714-4fa7-a09a-26cd0a68b456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:43.081357 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f111056-4714-4fa7-a09a-26cd0a68b456 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:43.081686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f111056-4714-4fa7-a09a-26cd0a68b456 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:43.082038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f111056-4714-4fa7-a09a-26cd0a68b456 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:43.082811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f111056-4714-4fa7-a09a-26cd0a68b456 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:43.083123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f111056-4714-4fa7-a09a-26cd0a68b456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:43.085864 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f111056-4714-4fa7-a09a-26cd0a68b456 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:43.095924 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 148/304] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:43.103439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f111056-4714-4fa7-a09a-26cd0a68b456 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:43.143854 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:43.197532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:43.210232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b71ce-b257-4002-8c05-194f64663870 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:43.223423 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f111056-4714-4fa7-a09a-26cd0a68b456 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:43.250198 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafccfb-d690-4a37-a5e2-2718445a609e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:43.250889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafccfb-d690-4a37-a5e2-2718445a609e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:43.251173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafccfb-d690-4a37-a5e2-2718445a609e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:43.251445 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafccfb-d690-4a37-a5e2-2718445a609e None admin] PATH_INFO: `/v3/users/d244adf6808a4a29864b211144dbda68` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:43.252657 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafccfb-d690-4a37-a5e2-2718445a609e None admin] RBAC: Authorizing `identity:get_user(user_id=d244adf6808a4a29864b211144dbda68)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:43.254152 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafccfb-d690-4a37-a5e2-2718445a609e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:43.260947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 157/305] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:43 2022] GET /identity/v3/users/d244adf6808a4a29864b211144dbda68 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:43.260947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafccfb-d690-4a37-a5e2-2718445a609e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:43.272028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae9400-68e9-4dbc-a6df-ec59c6fbabbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:43.273016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae9400-68e9-4dbc-a6df-ec59c6fbabbc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:43.273299 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae9400-68e9-4dbc-a6df-ec59c6fbabbc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:43.273571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae9400-68e9-4dbc-a6df-ec59c6fbabbc None admin] PATH_INFO: `/v3/users/0dd1f65dc68246d18190a87b69ec63f6` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:43.288686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae9400-68e9-4dbc-a6df-ec59c6fbabbc None admin] RBAC: Authorizing `identity:get_user(user_id=0dd1f65dc68246d18190a87b69ec63f6)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:43.290105 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae9400-68e9-4dbc-a6df-ec59c6fbabbc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:43.292055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 149/306] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:43 2022] GET /identity/v3/users/0dd1f65dc68246d18190a87b69ec63f6 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:43.292587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae9400-68e9-4dbc-a6df-ec59c6fbabbc None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:43.379845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafccfb-d690-4a37-a5e2-2718445a609e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:43.399083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:43.404034 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae9400-68e9-4dbc-a6df-ec59c6fbabbc None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:43.418563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84037611-2efc-4c7b-a57a-4eed6fd2893a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:43.419367 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84037611-2efc-4c7b-a57a-4eed6fd2893a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:43.419749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84037611-2efc-4c7b-a57a-4eed6fd2893a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:43.420050 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84037611-2efc-4c7b-a57a-4eed6fd2893a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:43.421504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84037611-2efc-4c7b-a57a-4eed6fd2893a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:43.423245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84037611-2efc-4c7b-a57a-4eed6fd2893a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:43.425064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 158/307] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:50:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:43.426077 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84037611-2efc-4c7b-a57a-4eed6fd2893a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:43.451398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56190c2-9ef9-4dd9-9405-43d9133f4862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:43.452266 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56190c2-9ef9-4dd9-9405-43d9133f4862 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:43.452546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56190c2-9ef9-4dd9-9405-43d9133f4862 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:43.452818 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56190c2-9ef9-4dd9-9405-43d9133f4862 None admin] PATH_INFO: `/v3/system/users/d244adf6808a4a29864b211144dbda68/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:43.455851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56190c2-9ef9-4dd9-9405-43d9133f4862 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d244adf6808a4a29864b211144dbda68, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:43.457126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56190c2-9ef9-4dd9-9405-43d9133f4862 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:43.460763 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:43.469548 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 150/308] 10.222.0.49 () {58 vars in 1334 bytes} [Wed May 18 16:50:43 2022] PUT /identity/v3/system/users/d244adf6808a4a29864b211144dbda68/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:50:43.470585 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56190c2-9ef9-4dd9-9405-43d9133f4862 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:43.557356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84037611-2efc-4c7b-a57a-4eed6fd2893a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:43.607544 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f048526-d55b-4b03-8e69-558680caae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:43.608389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f048526-d55b-4b03-8e69-558680caae37 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:43.608778 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f048526-d55b-4b03-8e69-558680caae37 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:43.609167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f048526-d55b-4b03-8e69-558680caae37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:43.610206 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f048526-d55b-4b03-8e69-558680caae37 None admin] RBAC: Adding query filter params (role.id=d00df1ddfa594cc084ad85d6d8f45791, user.id=0dd1f65dc68246d18190a87b69ec63f6, scope.system=all) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:43.610767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f048526-d55b-4b03-8e69-558680caae37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:43.612516 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f048526-d55b-4b03-8e69-558680caae37 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:43.619707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 159/309] 10.222.0.49 () {56 vars in 1308 bytes} [Wed May 18 16:50:43 2022] GET /identity/v3/role_assignments?user.id=0dd1f65dc68246d18190a87b69ec63f6&scope.system=all&role.id=d00df1ddfa594cc084ad85d6d8f45791 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:43.632368 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56190c2-9ef9-4dd9-9405-43d9133f4862 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:43.676336 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f885a-ae07-4c6b-ae28-9ace71ae8903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:43.677342 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f885a-ae07-4c6b-ae28-9ace71ae8903 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:43.677858 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f885a-ae07-4c6b-ae28-9ace71ae8903 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:43.678915 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f885a-ae07-4c6b-ae28-9ace71ae8903 None admin] PATH_INFO: `/v3/groups` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:43.679834 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f885a-ae07-4c6b-ae28-9ace71ae8903 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:43.681586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f885a-ae07-4c6b-ae28-9ace71ae8903 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:43.702273 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 151/310] 10.222.0.49 () {60 vars in 1134 bytes} [Wed May 18 16:50:43 2022] POST /identity/v3/groups => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:50:43.891627 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b864f9-7052-46b6-b801-e0bbb51ac86f None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:43.891931 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b864f9-7052-46b6-b801-e0bbb51ac86f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:43.892238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b864f9-7052-46b6-b801-e0bbb51ac86f None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:43.894040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 160/311] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:43.900003 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b435d-75cb-49f8-bf5f-d6c91d703d51 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:43.900297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b435d-75cb-49f8-bf5f-d6c91d703d51 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:43.900585 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b435d-75cb-49f8-bf5f-d6c91d703d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:43.919815 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-171b435d-75cb-49f8-bf5f-d6c91d703d51 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:43.921052 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-171b435d-75cb-49f8-bf5f-d6c91d703d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:43.988122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:44.002983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 152/312] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:44.026527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b864f9-7052-46b6-b801-e0bbb51ac86f None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:44.091342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:44.149776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b864f9-7052-46b6-b801-e0bbb51ac86f None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:44.187903 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15874fc8-7c90-4653-9a36-d13eb4ce57d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:44.188717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15874fc8-7c90-4653-9a36-d13eb4ce57d1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:44.189003 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15874fc8-7c90-4653-9a36-d13eb4ce57d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:44.189277 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15874fc8-7c90-4653-9a36-d13eb4ce57d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:44.201154 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15874fc8-7c90-4653-9a36-d13eb4ce57d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:44.209403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-15874fc8-7c90-4653-9a36-d13eb4ce57d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 16:50:44.209403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:44.209403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:44.209403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:44.209403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:44.209403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:44.209403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:44.209403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:44.209403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:44.209403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:44.209403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:44.209403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:44.209403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:44.209403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:44.209403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:44.209403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:44.210501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:44.210501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:44.210501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:44.210501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:44.210501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:44.210501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:44.210501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:44.210501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:44.210501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:44.210501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:44.210501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:44.210501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:44.210501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:44.210501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:44.210501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:44.210501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:44.211281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:44.211281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:44.211281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:44.211281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:44.211281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:44.211281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:44.211281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:44.211281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:44.211281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:44.211281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:44.211281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 16:50:44.211281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:44.211869 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 161/313] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:44.216925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b435d-75cb-49f8-bf5f-d6c91d703d51 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:44.334891 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b435d-75cb-49f8-bf5f-d6c91d703d51 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:44.372340 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5c865-5ca0-4622-9bac-e843541a3c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:44.373426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5c865-5ca0-4622-9bac-e843541a3c1c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:44.373970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5c865-5ca0-4622-9bac-e843541a3c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:44.374449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5c865-5ca0-4622-9bac-e843541a3c1c None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:44.375470 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5c865-5ca0-4622-9bac-e843541a3c1c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:44.375977 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5c865-5ca0-4622-9bac-e843541a3c1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:44.377596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5c865-5ca0-4622-9bac-e843541a3c1c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:44.388097 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 153/314] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:44.393947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15874fc8-7c90-4653-9a36-d13eb4ce57d1 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:44.501151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15874fc8-7c90-4653-9a36-d13eb4ce57d1 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:44.512030 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:44.545745 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b20906-8a0c-499b-95b0-05c43db665f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:44.546633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b20906-8a0c-499b-95b0-05c43db665f0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:44.546920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b20906-8a0c-499b-95b0-05c43db665f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:44.547200 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b20906-8a0c-499b-95b0-05c43db665f0 None admin] PATH_INFO: `/v3/users/c5d1d6f24d084669ab0b159609550b68` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:44.548438 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b20906-8a0c-499b-95b0-05c43db665f0 None admin] RBAC: Authorizing `identity:get_user(user_id=c5d1d6f24d084669ab0b159609550b68)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:44.549919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b20906-8a0c-499b-95b0-05c43db665f0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:44.551578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 162/315] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:44 2022] GET /identity/v3/users/c5d1d6f24d084669ab0b159609550b68 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:44.557677 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5c865-5ca0-4622-9bac-e843541a3c1c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:44.615136 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:44.667291 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5c865-5ca0-4622-9bac-e843541a3c1c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:44.707681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaac95f-fdfd-4fd6-b9ec-58cd5b976df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:44.708709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaac95f-fdfd-4fd6-b9ec-58cd5b976df4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:44.709771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaac95f-fdfd-4fd6-b9ec-58cd5b976df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:44.710269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaac95f-fdfd-4fd6-b9ec-58cd5b976df4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:44.788074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaac95f-fdfd-4fd6-b9ec-58cd5b976df4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:44.790148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaac95f-fdfd-4fd6-b9ec-58cd5b976df4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:44.850626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:44.903564 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 154/316] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:44.913690 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b20906-8a0c-499b-95b0-05c43db665f0 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:45.023823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b20906-8a0c-499b-95b0-05c43db665f0 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:45.071418 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62f887-97e5-475e-b5d4-15c868d62830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:45.072570 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62f887-97e5-475e-b5d4-15c868d62830 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:45.073084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62f887-97e5-475e-b5d4-15c868d62830 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:45.073564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62f887-97e5-475e-b5d4-15c868d62830 None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:45.075029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62f887-97e5-475e-b5d4-15c868d62830 None admin] RBAC: Authorizing `identity:get_project(project_id=451724484cdd482390defb722f90bb6c)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:45.076701 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62f887-97e5-475e-b5d4-15c868d62830 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:45.078974 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 163/317] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:44 2022] GET /identity/v3/projects/451724484cdd482390defb722f90bb6c => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:45.086021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaac95f-fdfd-4fd6-b9ec-58cd5b976df4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:45.197484 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaac95f-fdfd-4fd6-b9ec-58cd5b976df4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:45.234760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b3ff9-6008-4fc4-9d57-082a3cc90cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:45.235421 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b3ff9-6008-4fc4-9d57-082a3cc90cce None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:45.235704 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b3ff9-6008-4fc4-9d57-082a3cc90cce None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:45.235978 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b3ff9-6008-4fc4-9d57-082a3cc90cce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:45.236823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b3ff9-6008-4fc4-9d57-082a3cc90cce None admin] RBAC: Adding query filter params (role.id=d00df1ddfa594cc084ad85d6d8f45791, scope.project.id=451724484cdd482390defb722f90bb6c, user.id=c5d1d6f24d084669ab0b159609550b68) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:45.237132 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b3ff9-6008-4fc4-9d57-082a3cc90cce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:45.238606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b3ff9-6008-4fc4-9d57-082a3cc90cce None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:45.245603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 155/318] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:50:45 2022] GET /identity/v3/role_assignments?user.id=c5d1d6f24d084669ab0b159609550b68&scope.project.id=451724484cdd482390defb722f90bb6c&role.id=d00df1ddfa594cc084ad85d6d8f45791 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:45.891650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010901ae-8de5-4089-be9e-b595d333bcc9 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:45.892029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010901ae-8de5-4089-be9e-b595d333bcc9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:45.892227 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010901ae-8de5-4089-be9e-b595d333bcc9 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:45.893717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 164/319] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:45.900060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240b13c-a5ab-4642-9bea-007f4a19a229 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:45.900601 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240b13c-a5ab-4642-9bea-007f4a19a229 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:45.900601 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240b13c-a5ab-4642-9bea-007f4a19a229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:45.918200 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5240b13c-a5ab-4642-9bea-007f4a19a229 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:45.919463 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5240b13c-a5ab-4642-9bea-007f4a19a229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:45.931771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:45.966676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab22bd-69cb-48af-af34-d0f0f7e3ec72 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:45.967323 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab22bd-69cb-48af-af34-d0f0f7e3ec72 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:45.967323 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab22bd-69cb-48af-af34-d0f0f7e3ec72 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:45.968574 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 165/320] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:45.974252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05ab23-27a4-4831-bd82-e1da3a1782d3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:45.974619 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05ab23-27a4-4831-bd82-e1da3a1782d3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:45.975471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05ab23-27a4-4831-bd82-e1da3a1782d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:45.993772 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-8d05ab23-27a4-4831-bd82-e1da3a1782d3 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:45.995258 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8d05ab23-27a4-4831-bd82-e1da3a1782d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:45.999534 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 156/321] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:46.024882 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240b13c-a5ab-4642-9bea-007f4a19a229 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:46.041539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:46.081840 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 166/322] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:50:46.100975 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05ab23-27a4-4831-bd82-e1da3a1782d3 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:46.132760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240b13c-a5ab-4642-9bea-007f4a19a229 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:46.177612 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521fbff-3a1b-4ef3-ab5a-600093a7f7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:46.179390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521fbff-3a1b-4ef3-ab5a-600093a7f7bd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:46.179866 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521fbff-3a1b-4ef3-ab5a-600093a7f7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:46.180130 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521fbff-3a1b-4ef3-ab5a-600093a7f7bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:46.190880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521fbff-3a1b-4ef3-ab5a-600093a7f7bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:46.199937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-b521fbff-3a1b-4ef3-ab5a-600093a7f7bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:46.199937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:46.199937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:46.199937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:46.199937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:46.199937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:46.199937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:46.199937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:46.199937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:46.199937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:46.199937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:46.199937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:46.199937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:46.199937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:46.199937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:46.199937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:46.200951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:46.200951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:46.200951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:46.200951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:46.200951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:46.200951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:46.200951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:46.200951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:46.200951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:46.200951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:46.200951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:46.200951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:46.200951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:46.200951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:46.200951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:46.200951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:46.201803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:46.201803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:46.201803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:46.201803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:46.201803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:46.201803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:46.201803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:46.201803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:46.201803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:46.201803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:46.201803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:46.201803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:46.201803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 157/323] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:50:46.204243 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75d947-c937-4aef-95cf-d7ba319323bf None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:46.204531 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75d947-c937-4aef-95cf-d7ba319323bf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:46.204809 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75d947-c937-4aef-95cf-d7ba319323bf None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:46.206439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 158/324] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:46.207142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75d947-c937-4aef-95cf-d7ba319323bf None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:46.217933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05ab23-27a4-4831-bd82-e1da3a1782d3 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:46.218117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:46.254773 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd89fac-f8b3-4143-ab59-a0302a58d1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:46.255658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd89fac-f8b3-4143-ab59-a0302a58d1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:46.255969 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd89fac-f8b3-4143-ab59-a0302a58d1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:46.256221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd89fac-f8b3-4143-ab59-a0302a58d1a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:46.268209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd89fac-f8b3-4143-ab59-a0302a58d1a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:46.276559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-2fd89fac-f8b3-4143-ab59-a0302a58d1a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 16:50:46.276559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:46.276559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:46.276559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:46.276559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:46.276559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:46.276559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:46.276559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:46.276559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:46.276559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:46.276559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:46.276559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:46.276559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:46.276559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:46.276559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:46.276559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:46.277476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:46.277476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:46.277476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:46.277476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:46.277476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:46.277476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:46.277476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:46.277476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:46.277476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:46.277476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:46.277476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:46.277476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:46.277476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:46.277476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:46.277476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:46.277476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:46.278311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:46.278311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:46.278311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:46.278311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:46.278311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:46.278311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:46.278311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:46.278311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:46.278311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:46.278311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:46.278311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 16:50:46.278311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:46.278311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 167/325] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:50:46.279019 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4391395-396c-47fe-84e9-34fb17ce6083 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:46.279307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4391395-396c-47fe-84e9-34fb17ce6083 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:46.279585 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4391395-396c-47fe-84e9-34fb17ce6083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:46.298292 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e4391395-396c-47fe-84e9-34fb17ce6083 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:46.299480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e4391395-396c-47fe-84e9-34fb17ce6083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:46.323720 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75d947-c937-4aef-95cf-d7ba319323bf None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:46.326925 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:46.358907 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1d242-4e78-48e0-9cd0-31d659649845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:46.359582 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1d242-4e78-48e0-9cd0-31d659649845 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:46.359868 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1d242-4e78-48e0-9cd0-31d659649845 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:46.360139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1d242-4e78-48e0-9cd0-31d659649845 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:46.360895 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1d242-4e78-48e0-9cd0-31d659649845 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:46.361198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1d242-4e78-48e0-9cd0-31d659649845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:46.362645 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1d242-4e78-48e0-9cd0-31d659649845 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:46.370102 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 168/326] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:46.370803 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4391395-396c-47fe-84e9-34fb17ce6083 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:46.373013 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 159/327] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:46.378432 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1d242-4e78-48e0-9cd0-31d659649845 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:46.452208 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:46.478032 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4391395-396c-47fe-84e9-34fb17ce6083 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:46.487827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1d242-4e78-48e0-9cd0-31d659649845 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:46.514486 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabc433-1253-48c1-ab48-17c4e77109dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:46.515168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabc433-1253-48c1-ab48-17c4e77109dc None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:46.515452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabc433-1253-48c1-ab48-17c4e77109dc None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:46.515732 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabc433-1253-48c1-ab48-17c4e77109dc None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:46.516495 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabc433-1253-48c1-ab48-17c4e77109dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:46.516802 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabc433-1253-48c1-ab48-17c4e77109dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:46.518249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabc433-1253-48c1-ab48-17c4e77109dc None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:46.526174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d2af8-9240-4364-ba07-e4e3b8a33308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:46.527069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d2af8-9240-4364-ba07-e4e3b8a33308 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:46.527351 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d2af8-9240-4364-ba07-e4e3b8a33308 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:46.527629 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d2af8-9240-4364-ba07-e4e3b8a33308 None admin] PATH_INFO: `/v3/users/d244adf6808a4a29864b211144dbda68` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:46.527713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 169/328] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:46.528475 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabc433-1253-48c1-ab48-17c4e77109dc None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:46.528860 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d2af8-9240-4364-ba07-e4e3b8a33308 None admin] RBAC: Authorizing `identity:get_user(user_id=d244adf6808a4a29864b211144dbda68)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:46.530385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d2af8-9240-4364-ba07-e4e3b8a33308 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:46.532064 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 160/329] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:46 2022] GET /identity/v3/users/d244adf6808a4a29864b211144dbda68 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:46.534934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d2af8-9240-4364-ba07-e4e3b8a33308 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:46.559020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:46.636315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabc433-1253-48c1-ab48-17c4e77109dc None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:46.640592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d2af8-9240-4364-ba07-e4e3b8a33308 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:46.671092 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dfcaa-4d9a-48d3-9b12-c80ca85ad0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:46.671886 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dfcaa-4d9a-48d3-9b12-c80ca85ad0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:46.672165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dfcaa-4d9a-48d3-9b12-c80ca85ad0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:46.672437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dfcaa-4d9a-48d3-9b12-c80ca85ad0f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:46.673597 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dfcaa-4d9a-48d3-9b12-c80ca85ad0f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:46.675089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dfcaa-4d9a-48d3-9b12-c80ca85ad0f4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:46.675674 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68561296-c2b7-4f7a-83e1-d8f8774ccd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:46.676555 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68561296-c2b7-4f7a-83e1-d8f8774ccd80 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:46.676982 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68561296-c2b7-4f7a-83e1-d8f8774ccd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:46.677080 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 170/330] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:50:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:46.677150 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68561296-c2b7-4f7a-83e1-d8f8774ccd80 None admin] PATH_INFO: `/v3/users/0dd1f65dc68246d18190a87b69ec63f6` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:46.677730 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dfcaa-4d9a-48d3-9b12-c80ca85ad0f4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:46.679029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68561296-c2b7-4f7a-83e1-d8f8774ccd80 None admin] RBAC: Authorizing `identity:get_user(user_id=0dd1f65dc68246d18190a87b69ec63f6)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:46.680474 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68561296-c2b7-4f7a-83e1-d8f8774ccd80 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:46.686755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 161/331] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:46 2022] GET /identity/v3/users/0dd1f65dc68246d18190a87b69ec63f6 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:46.686755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68561296-c2b7-4f7a-83e1-d8f8774ccd80 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:46.688344 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:46.785299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:46.793904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dfcaa-4d9a-48d3-9b12-c80ca85ad0f4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:46.794857 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68561296-c2b7-4f7a-83e1-d8f8774ccd80 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:46.829247 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590d93a-4024-4063-b84d-94d34723a8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:46.830185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590d93a-4024-4063-b84d-94d34723a8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:46.830464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590d93a-4024-4063-b84d-94d34723a8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:46.830744 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590d93a-4024-4063-b84d-94d34723a8e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:46.831570 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590d93a-4024-4063-b84d-94d34723a8e1 None admin] RBAC: Adding query filter params (role.id=bfec786c9ea74c4aaecf243a866539af, user.id=d244adf6808a4a29864b211144dbda68, scope.system=all) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:46.831827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cd080-9ffc-46df-9adf-8bcafdddf296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:46.831936 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590d93a-4024-4063-b84d-94d34723a8e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:46.832491 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cd080-9ffc-46df-9adf-8bcafdddf296 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:46.832776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cd080-9ffc-46df-9adf-8bcafdddf296 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:46.833055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cd080-9ffc-46df-9adf-8bcafdddf296 None admin] PATH_INFO: `/v3/groups` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:46.833298 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590d93a-4024-4063-b84d-94d34723a8e1 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:46.833778 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cd080-9ffc-46df-9adf-8bcafdddf296 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:46.836103 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cd080-9ffc-46df-9adf-8bcafdddf296 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:46.846319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 171/332] 10.222.0.49 () {56 vars in 1308 bytes} [Wed May 18 16:50:46 2022] GET /identity/v3/role_assignments?user.id=d244adf6808a4a29864b211144dbda68&scope.system=all&role.id=bfec786c9ea74c4aaecf243a866539af => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:46.847165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590d93a-4024-4063-b84d-94d34723a8e1 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:46.861387 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 162/333] 10.222.0.49 () {60 vars in 1134 bytes} [Wed May 18 16:50:46 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 16:50:46.977572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590d93a-4024-4063-b84d-94d34723a8e1 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:47.019086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80952c34-88ad-4a3b-9833-ddb00eec4588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:47.020001 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80952c34-88ad-4a3b-9833-ddb00eec4588 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:47.020303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80952c34-88ad-4a3b-9833-ddb00eec4588 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:47.020562 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80952c34-88ad-4a3b-9833-ddb00eec4588 None admin] PATH_INFO: `/v3/system/users/0dd1f65dc68246d18190a87b69ec63f6/roles/d00df1ddfa594cc084ad85d6d8f45791` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:47.022663 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80952c34-88ad-4a3b-9833-ddb00eec4588 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0dd1f65dc68246d18190a87b69ec63f6, role_id=d00df1ddfa594cc084ad85d6d8f45791)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:47.024094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80952c34-88ad-4a3b-9833-ddb00eec4588 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:47.035549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 172/334] 10.222.0.49 () {58 vars in 1334 bytes} [Wed May 18 16:50:46 2022] PUT /identity/v3/system/users/0dd1f65dc68246d18190a87b69ec63f6/roles/d00df1ddfa594cc084ad85d6d8f45791 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:50:49.486206 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdd51a-bb12-439c-978b-3aafd792a454 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:49.487119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdd51a-bb12-439c-978b-3aafd792a454 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:49.487565 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdd51a-bb12-439c-978b-3aafd792a454 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:49.489430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 163/335] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:49.495121 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef941711-76b0-4350-90c5-b94980ab86bf None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:49.495974 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef941711-76b0-4350-90c5-b94980ab86bf None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:49.496407 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef941711-76b0-4350-90c5-b94980ab86bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:49.520283 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ef941711-76b0-4350-90c5-b94980ab86bf None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:49.522507 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ef941711-76b0-4350-90c5-b94980ab86bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:49.540725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:49.573780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f0757-1115-49fd-84b6-c793f8ad183e None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:49.574091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f0757-1115-49fd-84b6-c793f8ad183e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:49.574337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f0757-1115-49fd-84b6-c793f8ad183e None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:49.575714 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 164/336] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:49.582682 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba8d91-5d54-493f-9b62-899cc4df564d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:49.583293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba8d91-5d54-493f-9b62-899cc4df564d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:49.583780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba8d91-5d54-493f-9b62-899cc4df564d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:49.622784 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-05ba8d91-5d54-493f-9b62-899cc4df564d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:49.624436 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-05ba8d91-5d54-493f-9b62-899cc4df564d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:49.644332 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 173/337] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:50:49.682226 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef941711-76b0-4350-90c5-b94980ab86bf None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:49.769791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:49.795814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 165/338] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:50:49.838748 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba8d91-5d54-493f-9b62-899cc4df564d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:49.847218 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef941711-76b0-4350-90c5-b94980ab86bf None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:49.890345 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912b147-0b17-46b7-91dd-b4b6c3a59a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:49.891141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912b147-0b17-46b7-91dd-b4b6c3a59a42 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:49.891427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912b147-0b17-46b7-91dd-b4b6c3a59a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:49.891704 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912b147-0b17-46b7-91dd-b4b6c3a59a42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:49.920683 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912b147-0b17-46b7-91dd-b4b6c3a59a42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:49.939642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-7912b147-0b17-46b7-91dd-b4b6c3a59a42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:49.939642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:49.939642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:49.939642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:49.939642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:49.939642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:49.939642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:49.939642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:49.939642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:49.939642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:49.939642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:49.939642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:49.939642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:49.939642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:49.939642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:49.939642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:49.940660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:49.940660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:49.940660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:49.940660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:49.940660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:49.940660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:49.940660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:49.940660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:49.940660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:49.940660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:49.940660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:49.940660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:49.940660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:49.940660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:49.940660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:49.940660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:49.941481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:49.941481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:49.941481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:49.941481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:49.941481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:49.941481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:49.941481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:49.941481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:49.941481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:49.941481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:49.941481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:49.941481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:49.941481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 174/339] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:49.954543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912b147-0b17-46b7-91dd-b4b6c3a59a42 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:49.973708 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:50.026072 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba8d91-5d54-493f-9b62-899cc4df564d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:50.075118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a97f4e-cf97-4a23-9571-434053861275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:50.075948 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a97f4e-cf97-4a23-9571-434053861275 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:50.076235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a97f4e-cf97-4a23-9571-434053861275 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:50.076514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a97f4e-cf97-4a23-9571-434053861275 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:50.092703 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a97f4e-cf97-4a23-9571-434053861275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:50.102547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-40a97f4e-cf97-4a23-9571-434053861275 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 18 16:50:50.102547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:50.102547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:50.102547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:50.102547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:50.102547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:50.102547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:50.102547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:50.102547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:50.102547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:50.102547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:50.102547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:50.102547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:50.102547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:50.102547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:50.102547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:50.103481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:50.103481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:50.103481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:50.103481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:50.103481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:50.103481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:50.103481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:50.103481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:50.103481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:50.103481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:50.103481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:50.103481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:50.103481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:50.103481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:50.103481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:50.103481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:50.104269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:50.104269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:50.104269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:50.104269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:50.104269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:50.104269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:50.104269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:50.104269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:50.104269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:50.104269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:50.104269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 18 16:50:50.104269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:50.104269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 166/340] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:50.105410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d31f39-bedd-40bf-b381-ac09ea0aab27 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:50.109757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d31f39-bedd-40bf-b381-ac09ea0aab27 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:50.109757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d31f39-bedd-40bf-b381-ac09ea0aab27 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:50.109757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 167/341] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:50.116508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c61306-4404-4750-8c57-117055168fcb None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:50.116888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c61306-4404-4750-8c57-117055168fcb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:50.117172 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c61306-4404-4750-8c57-117055168fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:50.145968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f1c61306-4404-4750-8c57-117055168fcb None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:50.146646 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912b147-0b17-46b7-91dd-b4b6c3a59a42 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:50.147204 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f1c61306-4404-4750-8c57-117055168fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:50.198523 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bae1aa-46f9-43b6-a89c-32eecf37e3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:50.199214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bae1aa-46f9-43b6-a89c-32eecf37e3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:50.199497 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bae1aa-46f9-43b6-a89c-32eecf37e3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:50.199836 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bae1aa-46f9-43b6-a89c-32eecf37e3b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:50.200612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bae1aa-46f9-43b6-a89c-32eecf37e3b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:50.200924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bae1aa-46f9-43b6-a89c-32eecf37e3b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:50.202356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bae1aa-46f9-43b6-a89c-32eecf37e3b6 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:50.216346 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 175/342] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:50.217275 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bae1aa-46f9-43b6-a89c-32eecf37e3b6 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:50.229687 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:50.260180 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 168/343] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:50.261173 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c61306-4404-4750-8c57-117055168fcb None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:50.319015 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:50.382956 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c61306-4404-4750-8c57-117055168fcb None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:50.409374 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bae1aa-46f9-43b6-a89c-32eecf37e3b6 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:50.422633 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034acb1-fdaa-4b38-b2f7-29f3701949eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:50.423293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034acb1-fdaa-4b38-b2f7-29f3701949eb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:50.423579 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034acb1-fdaa-4b38-b2f7-29f3701949eb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:50.423859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034acb1-fdaa-4b38-b2f7-29f3701949eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:50.472669 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa97b6-afeb-478f-bac3-e20c8cf6a8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:50.473775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa97b6-afeb-478f-bac3-e20c8cf6a8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:50.474280 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa97b6-afeb-478f-bac3-e20c8cf6a8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:50.474816 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa97b6-afeb-478f-bac3-e20c8cf6a8e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:50.475799 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa97b6-afeb-478f-bac3-e20c8cf6a8e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:50.476319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa97b6-afeb-478f-bac3-e20c8cf6a8e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:50.477957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa97b6-afeb-478f-bac3-e20c8cf6a8e0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:50.486031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:50.492441 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 176/344] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:50.493594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa97b6-afeb-478f-bac3-e20c8cf6a8e0 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:50.508329 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034acb1-fdaa-4b38-b2f7-29f3701949eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:50.510602 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034acb1-fdaa-4b38-b2f7-29f3701949eb None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:50.625582 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 169/345] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:50.626835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034acb1-fdaa-4b38-b2f7-29f3701949eb None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:50.743485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034acb1-fdaa-4b38-b2f7-29f3701949eb None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:50.759731 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:50.786488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0099d5-8192-47c0-8797-fe918c018a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:50.788370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0099d5-8192-47c0-8797-fe918c018a35 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:50.788913 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0099d5-8192-47c0-8797-fe918c018a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:50.789353 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0099d5-8192-47c0-8797-fe918c018a35 None admin] PATH_INFO: `/v3/users/0dd1f65dc68246d18190a87b69ec63f6` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:50.791287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0099d5-8192-47c0-8797-fe918c018a35 None admin] RBAC: Authorizing `identity:get_user(user_id=0dd1f65dc68246d18190a87b69ec63f6)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:50.793743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0099d5-8192-47c0-8797-fe918c018a35 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:50.797889 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 170/346] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:50:50 2022] GET /identity/v3/users/0dd1f65dc68246d18190a87b69ec63f6 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:50.799245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0099d5-8192-47c0-8797-fe918c018a35 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:50.879834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa97b6-afeb-478f-bac3-e20c8cf6a8e0 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:50.920581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0099d5-8192-47c0-8797-fe918c018a35 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:50.961244 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:50.963712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e1da4-1d0e-4314-90e3-aca9501754a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:50.964821 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e1da4-1d0e-4314-90e3-aca9501754a3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:50.965275 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e1da4-1d0e-4314-90e3-aca9501754a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:50.965840 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e1da4-1d0e-4314-90e3-aca9501754a3 None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:50.967838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e1da4-1d0e-4314-90e3-aca9501754a3 None admin] RBAC: Authorizing `identity:get_project(project_id=e2c925ab39e142be8182f673b844dc7a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:50.969440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e1da4-1d0e-4314-90e3-aca9501754a3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:50.971808 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 171/347] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:50 2022] GET /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:50.973059 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e1da4-1d0e-4314-90e3-aca9501754a3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:50.975447 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ead2a-0386-4509-b6d7-1fb1d3b61c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:50.977046 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ead2a-0386-4509-b6d7-1fb1d3b61c87 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:50.977806 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ead2a-0386-4509-b6d7-1fb1d3b61c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:50.978606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ead2a-0386-4509-b6d7-1fb1d3b61c87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:51.003299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ead2a-0386-4509-b6d7-1fb1d3b61c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:51.008898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:51.020612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-aa6ead2a-0386-4509-b6d7-1fb1d3b61c87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:51.020612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:51.020612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:51.020612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:51.020612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:51.020612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:51.020612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:51.020612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:51.020612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:51.020612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:51.020612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:51.020612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:51.020612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:51.020612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:51.020612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:51.020612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:51.022229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:51.022229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:51.022229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:51.022229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:51.022229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:51.022229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:51.022229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:51.022229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:51.022229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:51.022229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:51.022229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:51.022229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:51.022229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:51.022229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:51.022229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:51.022229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:51.023834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:51.023834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:51.023834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:51.023834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:51.023834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:51.023834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:51.023834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:51.023834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:51.023834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:51.023834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:51.023834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:51.023834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:51.023834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 177/348] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:50:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 529 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:51.023834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ead2a-0386-4509-b6d7-1fb1d3b61c87 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:51.096728 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e1da4-1d0e-4314-90e3-aca9501754a3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:51.135500 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796035d-34f5-49ce-8fa9-6a21de9c44ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:51.136449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796035d-34f5-49ce-8fa9-6a21de9c44ee None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:51.136938 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796035d-34f5-49ce-8fa9-6a21de9c44ee None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:51.137350 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796035d-34f5-49ce-8fa9-6a21de9c44ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:51.138398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796035d-34f5-49ce-8fa9-6a21de9c44ee None admin] RBAC: Adding query filter params (role.id=d00df1ddfa594cc084ad85d6d8f45791, user.id=0dd1f65dc68246d18190a87b69ec63f6, scope.system=all) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:51.138862 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796035d-34f5-49ce-8fa9-6a21de9c44ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:51.141566 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796035d-34f5-49ce-8fa9-6a21de9c44ee None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:51.161820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 172/349] 10.222.0.49 () {56 vars in 1308 bytes} [Wed May 18 16:50:50 2022] GET /identity/v3/role_assignments?user.id=0dd1f65dc68246d18190a87b69ec63f6&scope.system=all&role.id=d00df1ddfa594cc084ad85d6d8f45791 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:51.164187 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2898b66-05d6-4a8f-a69f-8ae45684801f None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:51.164737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2898b66-05d6-4a8f-a69f-8ae45684801f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:51.165175 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2898b66-05d6-4a8f-a69f-8ae45684801f None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:51.165546 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ead2a-0386-4509-b6d7-1fb1d3b61c87 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:51.167373 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 173/350] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:51.168453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2898b66-05d6-4a8f-a69f-8ae45684801f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:51.210703 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702fb01-7954-4337-b1b8-e07e17bda215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:51.211598 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702fb01-7954-4337-b1b8-e07e17bda215 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:51.211881 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702fb01-7954-4337-b1b8-e07e17bda215 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:51.212161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702fb01-7954-4337-b1b8-e07e17bda215 None admin] PATH_INFO: `/v3/groups/12c86d136c4f4ac59729e795a3884f86` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:51.230358 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702fb01-7954-4337-b1b8-e07e17bda215 None admin] RBAC: Authorizing `identity:get_group(group_id=12c86d136c4f4ac59729e795a3884f86)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:51.232861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702fb01-7954-4337-b1b8-e07e17bda215 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:51.238763 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 178/351] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 18 16:50:51 2022] GET /identity/v3/groups/12c86d136c4f4ac59729e795a3884f86 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:51.239881 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881e7f9-2f1d-49cc-933f-1a02ac672e5a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:51.240359 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881e7f9-2f1d-49cc-933f-1a02ac672e5a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:51.240663 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881e7f9-2f1d-49cc-933f-1a02ac672e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:51.276846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b881e7f9-2f1d-49cc-933f-1a02ac672e5a None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:51.278141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b881e7f9-2f1d-49cc-933f-1a02ac672e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:51.340468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:51.384658 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2898b66-05d6-4a8f-a69f-8ae45684801f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:51.414674 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:51.452658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 179/352] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:51.455172 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881e7f9-2f1d-49cc-933f-1a02ac672e5a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:51.463510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb888e10-8bd1-4342-8cd4-22bc4498605e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:51.464576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb888e10-8bd1-4342-8cd4-22bc4498605e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:51.467390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb888e10-8bd1-4342-8cd4-22bc4498605e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:51.467960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb888e10-8bd1-4342-8cd4-22bc4498605e None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:51.469050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb888e10-8bd1-4342-8cd4-22bc4498605e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:51.469576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb888e10-8bd1-4342-8cd4-22bc4498605e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:51.473763 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb888e10-8bd1-4342-8cd4-22bc4498605e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:51.488697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 174/353] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:50:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:51.496663 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb888e10-8bd1-4342-8cd4-22bc4498605e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:51.611885 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881e7f9-2f1d-49cc-933f-1a02ac672e5a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:51.640849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb888e10-8bd1-4342-8cd4-22bc4498605e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:51.667029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41e771-8939-4f19-8580-141a1d2e326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:51.667629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41e771-8939-4f19-8580-141a1d2e326f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:51.667912 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41e771-8939-4f19-8580-141a1d2e326f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:51.668189 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41e771-8939-4f19-8580-141a1d2e326f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:51.669043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41e771-8939-4f19-8580-141a1d2e326f None admin] RBAC: Adding query filter params (group.id=12c86d136c4f4ac59729e795a3884f86, role.id=bfec786c9ea74c4aaecf243a866539af, scope.project.id=e2c925ab39e142be8182f673b844dc7a) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:51.669353 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41e771-8939-4f19-8580-141a1d2e326f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:51.670824 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41e771-8939-4f19-8580-141a1d2e326f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:51.681699 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 180/354] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 18 16:50:51 2022] GET /identity/v3/role_assignments?group.id=12c86d136c4f4ac59729e795a3884f86&scope.project.id=e2c925ab39e142be8182f673b844dc7a&role.id=bfec786c9ea74c4aaecf243a866539af => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:51.681699 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41e771-8939-4f19-8580-141a1d2e326f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:51.708886 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f804839-7797-4f06-b10c-242c7bb82b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:51.710146 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f804839-7797-4f06-b10c-242c7bb82b1e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:51.710432 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f804839-7797-4f06-b10c-242c7bb82b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:51.710709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f804839-7797-4f06-b10c-242c7bb82b1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:51.730024 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:51.763404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:51.837147 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f804839-7797-4f06-b10c-242c7bb82b1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:51.838676 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f804839-7797-4f06-b10c-242c7bb82b1e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:51.849379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41e771-8939-4f19-8580-141a1d2e326f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:51.903063 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6576f-9b0c-4462-85e6-a8dbbadf0fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:51.904624 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6576f-9b0c-4462-85e6-a8dbbadf0fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:51.905599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6576f-9b0c-4462-85e6-a8dbbadf0fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:51.905599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6576f-9b0c-4462-85e6-a8dbbadf0fc4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:51.923033 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6576f-9b0c-4462-85e6-a8dbbadf0fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:51.932237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-1bc6576f-9b0c-4462-85e6-a8dbbadf0fc4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:51.932237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:51.932237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:51.932237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:51.932237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:51.932237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:51.932237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:51.932237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:51.932237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:51.932237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:51.932237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:51.932237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:51.932237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:51.932237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:51.932237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:51.932237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:51.933184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:51.933184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:51.933184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:51.933184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:51.933184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:51.933184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:51.933184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:51.933184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:51.933184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:51.933184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:51.933184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:51.933184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:51.933184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:51.933184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:51.933184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:51.933184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:51.934035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:51.934035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:51.934035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:51.934035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:51.934035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:51.934035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:51.934035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:51.934035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:51.934035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:51.934035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:51.934035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:51.934035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:51.934035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 181/355] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:51.934991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5f9f9-4f5c-48c6-b542-f4387b7b47fc None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:51.935236 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5f9f9-4f5c-48c6-b542-f4387b7b47fc None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:51.935523 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5f9f9-4f5c-48c6-b542-f4387b7b47fc None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:51.940017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 182/356] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:51.940017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cb3d7-b04c-4d18-9a9b-e4ffaeeb9516 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:51.940017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cb3d7-b04c-4d18-9a9b-e4ffaeeb9516 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:51.940017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cb3d7-b04c-4d18-9a9b-e4ffaeeb9516 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:51.940341 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 183/357] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:51.940930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1cb3d7-b04c-4d18-9a9b-e4ffaeeb9516 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:51.993116 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 175/358] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 16:50:51.993116 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ead18-4c01-47d1-8072-58661e77ed54 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:51.993116 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ead18-4c01-47d1-8072-58661e77ed54 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:51.993433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ead18-4c01-47d1-8072-58661e77ed54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:52.019171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a36ead18-4c01-47d1-8072-58661e77ed54 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:52.020376 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a36ead18-4c01-47d1-8072-58661e77ed54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:52.061392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:52.106262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 176/359] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:52.108038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fa1e4-0140-46af-94fb-dde82f8d2b01 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:52.108431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1cb3d7-b04c-4d18-9a9b-e4ffaeeb9516 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:52.108766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fa1e4-0140-46af-94fb-dde82f8d2b01 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:52.109243 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fa1e4-0140-46af-94fb-dde82f8d2b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:52.119803 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:52.129137 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b29fa1e4-0140-46af-94fb-dde82f8d2b01 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:52.130354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b29fa1e4-0140-46af-94fb-dde82f8d2b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:52.154779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b9b50-af36-41df-82cf-ee8061e60d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:52.155465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b9b50-af36-41df-82cf-ee8061e60d41 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:52.155805 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b9b50-af36-41df-82cf-ee8061e60d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:52.156021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b9b50-af36-41df-82cf-ee8061e60d41 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:52.156778 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b9b50-af36-41df-82cf-ee8061e60d41 None admin] RBAC: Adding query filter params (name=member) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:52.157097 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b9b50-af36-41df-82cf-ee8061e60d41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:52.158696 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b9b50-af36-41df-82cf-ee8061e60d41 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:52.169468 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 184/360] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:52.170192 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b9b50-af36-41df-82cf-ee8061e60d41 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:52.222525 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 177/361] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:52.223323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fa1e4-0140-46af-94fb-dde82f8d2b01 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:52.302108 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b9b50-af36-41df-82cf-ee8061e60d41 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:52.351903 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e1ae3-afd0-4237-91fd-b5d32f760b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:52.351903 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e1ae3-afd0-4237-91fd-b5d32f760b4f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:52.351903 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e1ae3-afd0-4237-91fd-b5d32f760b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:52.352258 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e1ae3-afd0-4237-91fd-b5d32f760b4f None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:52.353380 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e1ae3-afd0-4237-91fd-b5d32f760b4f None admin] RBAC: Authorizing `identity:get_project(project_id=e2c925ab39e142be8182f673b844dc7a)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:52.354902 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e1ae3-afd0-4237-91fd-b5d32f760b4f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:52.356659 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 185/362] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:52 2022] GET /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:52.357625 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:52.357758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e1ae3-afd0-4237-91fd-b5d32f760b4f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:52.359806 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fa1e4-0140-46af-94fb-dde82f8d2b01 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:52.407303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:52.415519 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b079b73-3837-480e-baa3-8e6cbf35cd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:52.416396 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b079b73-3837-480e-baa3-8e6cbf35cd03 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:52.416684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b079b73-3837-480e-baa3-8e6cbf35cd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:52.416994 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b079b73-3837-480e-baa3-8e6cbf35cd03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:52.431667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b079b73-3837-480e-baa3-8e6cbf35cd03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:52.440468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-6b079b73-3837-480e-baa3-8e6cbf35cd03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:50:52.440468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:52.440468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:52.440468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:52.440468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:52.440468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:52.440468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:52.440468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:52.440468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:52.440468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:52.440468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:52.440468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:52.440468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:52.440468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:52.440468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:52.440468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:52.441453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:52.441453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:52.441453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:52.441453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:52.441453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:52.441453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:52.441453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:52.441453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:52.441453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:52.441453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:52.441453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:52.441453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:52.441453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:52.441453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:52.441453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:52.441453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:52.442650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:52.442650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:52.442650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:52.442650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:52.442650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:52.442650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:52.442650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:52.442650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:52.442650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:52.442650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:52.442650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:50:52.442650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:52.442650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 178/363] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:50:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:52.442650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b079b73-3837-480e-baa3-8e6cbf35cd03 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:52.494175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e1ae3-afd0-4237-91fd-b5d32f760b4f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:52.551800 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd71f90-5986-4cbd-86f4-31fff4a9b1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:52.552909 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd71f90-5986-4cbd-86f4-31fff4a9b1fd None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:52.553497 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd71f90-5986-4cbd-86f4-31fff4a9b1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:52.554025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd71f90-5986-4cbd-86f4-31fff4a9b1fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:52.590104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b079b73-3837-480e-baa3-8e6cbf35cd03 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:52.635411 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5f6e3-87bb-44d7-974e-39ac55756ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:52.636232 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5f6e3-87bb-44d7-974e-39ac55756ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:52.636516 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5f6e3-87bb-44d7-974e-39ac55756ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:52.636792 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5f6e3-87bb-44d7-974e-39ac55756ef4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:52.650326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5f6e3-87bb-44d7-974e-39ac55756ef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:52.654762 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd71f90-5986-4cbd-86f4-31fff4a9b1fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:52.656256 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd71f90-5986-4cbd-86f4-31fff4a9b1fd None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:52.658733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-34a5f6e3-87bb-44d7-974e-39ac55756ef4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:52.658733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:52.658733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:52.658733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:52.658733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:52.658733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:52.658733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:52.658733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:52.658733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:52.658733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:52.658733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:52.658733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:52.658733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:52.658733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:52.658733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:52.658733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:52.659598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:52.659598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:52.659598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:52.659598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:52.659598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:52.659598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:52.659598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:52.659598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:52.659598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:52.659598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:52.659598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:52.659598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:52.659598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:52.659598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:52.659598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:52.659598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:52.660389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:52.660389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:52.660389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:52.660389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:52.660389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:52.660389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:52.660389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:52.660389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:52.660389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:52.660389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:52.660389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:52.660389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:52.660389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 179/364] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:50:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:52.661045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5f6e3-87bb-44d7-974e-39ac55756ef4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:52.701418 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:52.717218 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:52.800611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 186/365] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:52.802618 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd71f90-5986-4cbd-86f4-31fff4a9b1fd None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:52.806878 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5f6e3-87bb-44d7-974e-39ac55756ef4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:52.857100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd0ff2-b931-4a81-a7a4-3666b3f96565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:52.858040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd0ff2-b931-4a81-a7a4-3666b3f96565 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:52.858332 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd0ff2-b931-4a81-a7a4-3666b3f96565 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:52.858609 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd0ff2-b931-4a81-a7a4-3666b3f96565 None admin] PATH_INFO: `/v3/groups/12c86d136c4f4ac59729e795a3884f86` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:52.859829 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd0ff2-b931-4a81-a7a4-3666b3f96565 None admin] RBAC: Authorizing `identity:get_group(group_id=12c86d136c4f4ac59729e795a3884f86)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:52.861292 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd0ff2-b931-4a81-a7a4-3666b3f96565 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:52.864750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 180/366] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 18 16:50:52 2022] GET /identity/v3/groups/12c86d136c4f4ac59729e795a3884f86 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:52.864750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd0ff2-b931-4a81-a7a4-3666b3f96565 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:52.944321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd71f90-5986-4cbd-86f4-31fff4a9b1fd None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:52.988134 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:52.992623 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23c0ef-0804-4f4e-9a0c-424305c6a9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:52.993256 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23c0ef-0804-4f4e-9a0c-424305c6a9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:52.993543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23c0ef-0804-4f4e-9a0c-424305c6a9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:52.993956 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23c0ef-0804-4f4e-9a0c-424305c6a9a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:52.994828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23c0ef-0804-4f4e-9a0c-424305c6a9a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:52.995142 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23c0ef-0804-4f4e-9a0c-424305c6a9a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:52.996562 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23c0ef-0804-4f4e-9a0c-424305c6a9a7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:53.004592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:53.009396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 187/367] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:53.010774 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23c0ef-0804-4f4e-9a0c-424305c6a9a7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:53.013603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd0ff2-b931-4a81-a7a4-3666b3f96565 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:53.075067 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb772811-d848-484f-a41c-9fd8da06cfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:53.076248 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb772811-d848-484f-a41c-9fd8da06cfa4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:53.076712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb772811-d848-484f-a41c-9fd8da06cfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:53.077348 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb772811-d848-484f-a41c-9fd8da06cfa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:53.078761 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb772811-d848-484f-a41c-9fd8da06cfa4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:53.079541 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb772811-d848-484f-a41c-9fd8da06cfa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:53.081529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb772811-d848-484f-a41c-9fd8da06cfa4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:53.094632 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 181/368] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:50:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:53.096172 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb772811-d848-484f-a41c-9fd8da06cfa4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:53.154651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23c0ef-0804-4f4e-9a0c-424305c6a9a7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:53.205387 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a6211-132d-49e0-ad76-3ed8b2ba8ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:53.206295 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a6211-132d-49e0-ad76-3ed8b2ba8ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:53.206575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a6211-132d-49e0-ad76-3ed8b2ba8ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:53.206847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a6211-132d-49e0-ad76-3ed8b2ba8ec4 None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:53.208771 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a6211-132d-49e0-ad76-3ed8b2ba8ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=451724484cdd482390defb722f90bb6c)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:53.210866 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a6211-132d-49e0-ad76-3ed8b2ba8ec4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:53.212976 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 188/369] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:53 2022] GET /identity/v3/projects/451724484cdd482390defb722f90bb6c => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:53.213925 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a6211-132d-49e0-ad76-3ed8b2ba8ec4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:53.236126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb772811-d848-484f-a41c-9fd8da06cfa4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:53.274870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a20d3-9bd9-4858-a812-b4ae97e38a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:53.275540 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a20d3-9bd9-4858-a812-b4ae97e38a41 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:53.275819 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a20d3-9bd9-4858-a812-b4ae97e38a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:53.276096 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a20d3-9bd9-4858-a812-b4ae97e38a41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:53.277013 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a20d3-9bd9-4858-a812-b4ae97e38a41 None admin] RBAC: Adding query filter params (group.id=12c86d136c4f4ac59729e795a3884f86, role.id=7a9281e8b95a43c58cf4d0c272dd1469, scope.project.id=e2c925ab39e142be8182f673b844dc7a) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:53.277442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a20d3-9bd9-4858-a812-b4ae97e38a41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:53.279058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a20d3-9bd9-4858-a812-b4ae97e38a41 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:53.285716 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 182/370] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 18 16:50:53 2022] GET /identity/v3/role_assignments?group.id=12c86d136c4f4ac59729e795a3884f86&scope.project.id=e2c925ab39e142be8182f673b844dc7a&role.id=7a9281e8b95a43c58cf4d0c272dd1469 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:53.286367 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a20d3-9bd9-4858-a812-b4ae97e38a41 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:53.291509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:53.306616 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:53.344370 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a6211-132d-49e0-ad76-3ed8b2ba8ec4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:53.401301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a5d6b-d04d-4b28-a0f7-1486072a07a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:53.402183 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a5d6b-d04d-4b28-a0f7-1486072a07a1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:53.402563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a5d6b-d04d-4b28-a0f7-1486072a07a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:53.403576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a5d6b-d04d-4b28-a0f7-1486072a07a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:53.419400 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a20d3-9bd9-4858-a812-b4ae97e38a41 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:53.466986 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562b0ab-0f08-440d-a2d2-ba0ddfc79c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:53.467948 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562b0ab-0f08-440d-a2d2-ba0ddfc79c3c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:53.468233 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562b0ab-0f08-440d-a2d2-ba0ddfc79c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:53.468572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562b0ab-0f08-440d-a2d2-ba0ddfc79c3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:53.502486 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a5d6b-d04d-4b28-a0f7-1486072a07a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:53.504065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a5d6b-d04d-4b28-a0f7-1486072a07a1 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:53.565201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562b0ab-0f08-440d-a2d2-ba0ddfc79c3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:53.566722 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562b0ab-0f08-440d-a2d2-ba0ddfc79c3c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:53.587666 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:53.596810 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:53.642902 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 189/371] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:53.644100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a5d6b-d04d-4b28-a0f7-1486072a07a1 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:53.705910 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 183/372] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:50:53.707806 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562b0ab-0f08-440d-a2d2-ba0ddfc79c3c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:53.780467 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a5d6b-d04d-4b28-a0f7-1486072a07a1 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:53.816125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562b0ab-0f08-440d-a2d2-ba0ddfc79c3c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:53.823327 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f95f4-0105-447f-b5a3-9b89b7524bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:53.824706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f95f4-0105-447f-b5a3-9b89b7524bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:53.825192 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f95f4-0105-447f-b5a3-9b89b7524bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:53.825727 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f95f4-0105-447f-b5a3-9b89b7524bc9 None admin] PATH_INFO: `/v3/groups/12c86d136c4f4ac59729e795a3884f86` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:53.827301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f95f4-0105-447f-b5a3-9b89b7524bc9 None admin] RBAC: Authorizing `identity:get_group(group_id=12c86d136c4f4ac59729e795a3884f86)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:53.829089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f95f4-0105-447f-b5a3-9b89b7524bc9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:53.831321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 190/373] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 18 16:50:53 2022] GET /identity/v3/groups/12c86d136c4f4ac59729e795a3884f86 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:53.833490 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:53.835025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f95f4-0105-447f-b5a3-9b89b7524bc9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:53.858822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f3c75-d07d-4cf5-ba5e-e8b29ff6ddac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:53.859614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f3c75-d07d-4cf5-ba5e-e8b29ff6ddac None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:53.859891 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f3c75-d07d-4cf5-ba5e-e8b29ff6ddac None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:53.860162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f3c75-d07d-4cf5-ba5e-e8b29ff6ddac None admin] PATH_INFO: `/v3/projects/a76edbb694024faba6c3d4a9e9057ee3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:53.861843 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f3c75-d07d-4cf5-ba5e-e8b29ff6ddac None admin] RBAC: Authorizing `identity:get_project(project_id=a76edbb694024faba6c3d4a9e9057ee3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:53.863058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f3c75-d07d-4cf5-ba5e-e8b29ff6ddac None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:53.864890 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 184/374] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:53 2022] GET /identity/v3/projects/a76edbb694024faba6c3d4a9e9057ee3 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:53.868666 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f3c75-d07d-4cf5-ba5e-e8b29ff6ddac None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:53.902095 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:53.964374 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f95f4-0105-447f-b5a3-9b89b7524bc9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:54.002852 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f3c75-d07d-4cf5-ba5e-e8b29ff6ddac None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:54.018635 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa52405-6675-4cb9-8398-1347b3e2efe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:54.020180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa52405-6675-4cb9-8398-1347b3e2efe5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:54.020667 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa52405-6675-4cb9-8398-1347b3e2efe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:54.021484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa52405-6675-4cb9-8398-1347b3e2efe5 None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:54.024688 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa52405-6675-4cb9-8398-1347b3e2efe5 None admin] RBAC: Authorizing `identity:get_project(project_id=451724484cdd482390defb722f90bb6c)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:54.026545 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa52405-6675-4cb9-8398-1347b3e2efe5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:54.029362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 191/375] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:53 2022] GET /identity/v3/projects/451724484cdd482390defb722f90bb6c => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:54.030428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa52405-6675-4cb9-8398-1347b3e2efe5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:54.059990 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5ac52-f97f-46d7-a497-1b94185093d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:54.060675 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5ac52-f97f-46d7-a497-1b94185093d9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:54.060966 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5ac52-f97f-46d7-a497-1b94185093d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:54.061246 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5ac52-f97f-46d7-a497-1b94185093d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:54.066020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5ac52-f97f-46d7-a497-1b94185093d9 None admin] RBAC: Adding query filter params (group.id=12c86d136c4f4ac59729e795a3884f86, role.id=bfec786c9ea74c4aaecf243a866539af, scope.project.id=451724484cdd482390defb722f90bb6c) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:54.066020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5ac52-f97f-46d7-a497-1b94185093d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:54.066020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5ac52-f97f-46d7-a497-1b94185093d9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:54.074990 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 185/376] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 18 16:50:53 2022] GET /identity/v3/role_assignments?group.id=12c86d136c4f4ac59729e795a3884f86&scope.project.id=451724484cdd482390defb722f90bb6c&role.id=bfec786c9ea74c4aaecf243a866539af => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:54.075946 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5ac52-f97f-46d7-a497-1b94185093d9 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:54.192389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:54.193254 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa52405-6675-4cb9-8398-1347b3e2efe5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:54.200370 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:54.249312 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58b2c4-e0a8-42ee-a60e-152b76999623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:54.250632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58b2c4-e0a8-42ee-a60e-152b76999623 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:54.251123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58b2c4-e0a8-42ee-a60e-152b76999623 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:54.251620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58b2c4-e0a8-42ee-a60e-152b76999623 None admin] PATH_INFO: `/v3/groups/5ab1dfe696ae4e4e9c0a1e7328dba58f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:54.267123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58b2c4-e0a8-42ee-a60e-152b76999623 None admin] RBAC: Authorizing `identity:get_group(group_id=5ab1dfe696ae4e4e9c0a1e7328dba58f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:54.269854 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58b2c4-e0a8-42ee-a60e-152b76999623 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:54.272413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 192/377] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 18 16:50:54 2022] GET /identity/v3/groups/5ab1dfe696ae4e4e9c0a1e7328dba58f => generated 229 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:54.274576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be216e-7070-46a3-93d7-209db1bce096 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:54.275117 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be216e-7070-46a3-93d7-209db1bce096 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:54.276253 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be216e-7070-46a3-93d7-209db1bce096 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:54.279349 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 193/378] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:54.280588 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be216e-7070-46a3-93d7-209db1bce096 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:54.296453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5ac52-f97f-46d7-a497-1b94185093d9 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:54.346138 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26686ee0-6598-4eac-b5dd-9a27e4675d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:54.347115 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26686ee0-6598-4eac-b5dd-9a27e4675d72 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:54.347405 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26686ee0-6598-4eac-b5dd-9a27e4675d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:54.347685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26686ee0-6598-4eac-b5dd-9a27e4675d72 None admin] PATH_INFO: `/v3/groups/12c86d136c4f4ac59729e795a3884f86` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:54.348946 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26686ee0-6598-4eac-b5dd-9a27e4675d72 None admin] RBAC: Authorizing `identity:get_group(group_id=12c86d136c4f4ac59729e795a3884f86)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:54.351418 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26686ee0-6598-4eac-b5dd-9a27e4675d72 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:54.353326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 186/379] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 18 16:50:54 2022] GET /identity/v3/groups/12c86d136c4f4ac59729e795a3884f86 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:54.356431 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfcd53-6782-49d1-874b-58e908ba75ed None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:54.356431 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfcd53-6782-49d1-874b-58e908ba75ed None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:54.356431 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfcd53-6782-49d1-874b-58e908ba75ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:54.383424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-dccfcd53-6782-49d1-874b-58e908ba75ed None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:54.385551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-dccfcd53-6782-49d1-874b-58e908ba75ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:54.465976 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be216e-7070-46a3-93d7-209db1bce096 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:54.501606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 187/380] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:54.501606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfcd53-6782-49d1-874b-58e908ba75ed None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:54.516214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e7b63-e97e-4bfb-8572-dbd6fe9c4f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:54.517291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e7b63-e97e-4bfb-8572-dbd6fe9c4f1a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:54.517814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e7b63-e97e-4bfb-8572-dbd6fe9c4f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:54.518320 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e7b63-e97e-4bfb-8572-dbd6fe9c4f1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:54.519361 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e7b63-e97e-4bfb-8572-dbd6fe9c4f1a None admin] RBAC: Adding query filter params (group.id=5ab1dfe696ae4e4e9c0a1e7328dba58f, role.id=b3f3f4910bf646699f30b749edeef422, scope.project.id=a76edbb694024faba6c3d4a9e9057ee3) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:54.519924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e7b63-e97e-4bfb-8572-dbd6fe9c4f1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:54.522227 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e7b63-e97e-4bfb-8572-dbd6fe9c4f1a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:54.534048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 194/381] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 18 16:50:54 2022] GET /identity/v3/role_assignments?group.id=5ab1dfe696ae4e4e9c0a1e7328dba58f&scope.project.id=a76edbb694024faba6c3d4a9e9057ee3&role.id=b3f3f4910bf646699f30b749edeef422 => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:54.544266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e7b63-e97e-4bfb-8572-dbd6fe9c4f1a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:54.568818 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:54.604432 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:54.688377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfcd53-6782-49d1-874b-58e908ba75ed None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:54.754030 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e7b63-e97e-4bfb-8572-dbd6fe9c4f1a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:54.759916 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c5f8e-5ec4-4049-a782-eeb27ba51660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:54.760602 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c5f8e-5ec4-4049-a782-eeb27ba51660 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:54.760885 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c5f8e-5ec4-4049-a782-eeb27ba51660 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:54.761160 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c5f8e-5ec4-4049-a782-eeb27ba51660 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:54.762063 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c5f8e-5ec4-4049-a782-eeb27ba51660 None admin] RBAC: Adding query filter params (group.id=12c86d136c4f4ac59729e795a3884f86, role.id=7a9281e8b95a43c58cf4d0c272dd1469, scope.project.id=451724484cdd482390defb722f90bb6c) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:54.762377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c5f8e-5ec4-4049-a782-eeb27ba51660 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:54.764220 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c5f8e-5ec4-4049-a782-eeb27ba51660 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:54.781254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 188/382] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 18 16:50:54 2022] GET /identity/v3/role_assignments?group.id=12c86d136c4f4ac59729e795a3884f86&scope.project.id=451724484cdd482390defb722f90bb6c&role.id=7a9281e8b95a43c58cf4d0c272dd1469 => generated 260 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:54.812421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e3a9b-8de8-4a63-b374-885e1a0fab96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:54.813278 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e3a9b-8de8-4a63-b374-885e1a0fab96 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:54.813564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e3a9b-8de8-4a63-b374-885e1a0fab96 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:54.813880 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e3a9b-8de8-4a63-b374-885e1a0fab96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:54.827277 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e3a9b-8de8-4a63-b374-885e1a0fab96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:54.836059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-304e3a9b-8de8-4a63-b374-885e1a0fab96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:54.836059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:54.836059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:54.836059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:54.836059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:54.836059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:54.836059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:54.836059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:54.836059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:54.836059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:54.836059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:54.836059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:54.836059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:54.836059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:54.836059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:54.836059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:54.836991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:54.836991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:54.836991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:54.836991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:54.836991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:54.836991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:54.836991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:54.836991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:54.836991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:54.836991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:54.836991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:54.836991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:54.836991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:54.836991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:54.836991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:54.836991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:54.837846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:54.837846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:54.837846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:54.837846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:54.837846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:54.837846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:54.837846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:54.837846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:54.837846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:54.837846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:54.837846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:54.837846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:54.837846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 195/383] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:50:54.843339 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c5f8e-5ec4-4049-a782-eeb27ba51660 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:55.034311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c5f8e-5ec4-4049-a782-eeb27ba51660 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:55.066082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:55.122209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c0dba-80d1-4fe6-9ecc-5dd4fe6b2b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:55.123392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c0dba-80d1-4fe6-9ecc-5dd4fe6b2b09 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:55.123903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c0dba-80d1-4fe6-9ecc-5dd4fe6b2b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:55.124412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c0dba-80d1-4fe6-9ecc-5dd4fe6b2b09 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:55.125910 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c0dba-80d1-4fe6-9ecc-5dd4fe6b2b09 None admin] RBAC: Adding query filter params (name=member) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:55.126481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c0dba-80d1-4fe6-9ecc-5dd4fe6b2b09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:55.129105 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c0dba-80d1-4fe6-9ecc-5dd4fe6b2b09 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:55.147111 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 189/384] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:55.156450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e3a9b-8de8-4a63-b374-885e1a0fab96 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:55.299228 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:55.313689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e3a9b-8de8-4a63-b374-885e1a0fab96 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:55.361936 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcb0e2-1688-4b47-93ca-3dad70a06ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:55.362803 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcb0e2-1688-4b47-93ca-3dad70a06ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:55.363085 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcb0e2-1688-4b47-93ca-3dad70a06ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:55.363354 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcb0e2-1688-4b47-93ca-3dad70a06ea5 None admin] PATH_INFO: `/v3/groups/12c86d136c4f4ac59729e795a3884f86` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:55.364526 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffcb0e2-1688-4b47-93ca-3dad70a06ea5 None admin] RBAC: Authorizing `identity:get_group(group_id=12c86d136c4f4ac59729e795a3884f86)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:55.366118 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffcb0e2-1688-4b47-93ca-3dad70a06ea5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:55.368206 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 196/385] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 18 16:50:55 2022] GET /identity/v3/groups/12c86d136c4f4ac59729e795a3884f86 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:55.376878 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c0dba-80d1-4fe6-9ecc-5dd4fe6b2b09 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:55.535871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c0dba-80d1-4fe6-9ecc-5dd4fe6b2b09 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:55.593734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20309aa5-3255-4911-b753-f2aab9c36934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:55.595113 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20309aa5-3255-4911-b753-f2aab9c36934 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:55.595641 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20309aa5-3255-4911-b753-f2aab9c36934 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:55.595980 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20309aa5-3255-4911-b753-f2aab9c36934 None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:55.598967 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20309aa5-3255-4911-b753-f2aab9c36934 None admin] RBAC: Authorizing `identity:get_project(project_id=e2c925ab39e142be8182f673b844dc7a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:55.600325 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20309aa5-3255-4911-b753-f2aab9c36934 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:55.602661 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 190/386] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:55 2022] GET /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:55.608939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcb0e2-1688-4b47-93ca-3dad70a06ea5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:55.767766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcb0e2-1688-4b47-93ca-3dad70a06ea5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:55.808217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137de8c-7ff4-49cb-87fd-7c34c4a67962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:55.808761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137de8c-7ff4-49cb-87fd-7c34c4a67962 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:55.809040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137de8c-7ff4-49cb-87fd-7c34c4a67962 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:55.809311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137de8c-7ff4-49cb-87fd-7c34c4a67962 None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a/groups/12c86d136c4f4ac59729e795a3884f86/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:55.811392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137de8c-7ff4-49cb-87fd-7c34c4a67962 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2c925ab39e142be8182f673b844dc7a, group_id=12c86d136c4f4ac59729e795a3884f86, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:55.813007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137de8c-7ff4-49cb-87fd-7c34c4a67962 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:55.830382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 197/387] 10.222.0.49 () {58 vars in 1442 bytes} [Wed May 18 16:50:55 2022] PUT /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a/groups/12c86d136c4f4ac59729e795a3884f86/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:50:56.398913 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5e354-7dce-41c6-8e20-01fda648b4b8 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:56.399409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5e354-7dce-41c6-8e20-01fda648b4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:56.399409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5e354-7dce-41c6-8e20-01fda648b4b8 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:56.401314 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 191/388] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:56.407381 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a56e53-7226-43f2-9c3a-e86b9c3bb592 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:56.408155 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a56e53-7226-43f2-9c3a-e86b9c3bb592 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:56.408155 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a56e53-7226-43f2-9c3a-e86b9c3bb592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:56.427193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-29a56e53-7226-43f2-9c3a-e86b9c3bb592 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:56.428972 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-29a56e53-7226-43f2-9c3a-e86b9c3bb592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:56.445393 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:56.503826 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 198/389] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:56.526974 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5e354-7dce-41c6-8e20-01fda648b4b8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:56.591335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:56.671370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5e354-7dce-41c6-8e20-01fda648b4b8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:56.726359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6be5a-2e08-4667-87b2-71a5dd8bd1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:56.727212 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6be5a-2e08-4667-87b2-71a5dd8bd1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:56.727495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6be5a-2e08-4667-87b2-71a5dd8bd1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:56.727774 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6be5a-2e08-4667-87b2-71a5dd8bd1d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:56.747549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6be5a-2e08-4667-87b2-71a5dd8bd1d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:56.756581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-17c6be5a-2e08-4667-87b2-71a5dd8bd1d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:56.756581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:56.756581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:56.756581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:56.756581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:56.756581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:56.756581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:56.756581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:56.756581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:56.756581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:56.756581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:56.756581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:56.756581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:56.756581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:56.756581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:56.756581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:56.758398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:56.758398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:56.758398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:56.758398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:56.758398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:56.758398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:56.758398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:56.758398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:56.758398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:56.758398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:56.758398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:56.758398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:56.758398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:56.758398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:56.758398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:56.758398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:56.759684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:56.759684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:56.759684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:56.759684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:56.759684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:56.759684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:56.759684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:56.759684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:56.759684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:56.759684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:56.759684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:56.759684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:56.759684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 192/390] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:50:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:56.764110 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a56e53-7226-43f2-9c3a-e86b9c3bb592 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:56.948437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a56e53-7226-43f2-9c3a-e86b9c3bb592 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:56.999873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8de1c2-dc76-4799-a70d-bee1d8db38f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:57.000549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8de1c2-dc76-4799-a70d-bee1d8db38f7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:57.000830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8de1c2-dc76-4799-a70d-bee1d8db38f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:57.001104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8de1c2-dc76-4799-a70d-bee1d8db38f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:57.001888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8de1c2-dc76-4799-a70d-bee1d8db38f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:57.002261 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8de1c2-dc76-4799-a70d-bee1d8db38f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:57.003670 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8de1c2-dc76-4799-a70d-bee1d8db38f7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:57.013758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 199/391] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:50:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:57.022917 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6be5a-2e08-4667-87b2-71a5dd8bd1d7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:57.071443 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f5fca-0c5a-4aef-9048-efa7bb7ba814 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:57.072065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f5fca-0c5a-4aef-9048-efa7bb7ba814 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:57.072548 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f5fca-0c5a-4aef-9048-efa7bb7ba814 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:57.074176 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 200/392] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:57.079779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d21398-939d-42bf-91db-159fe682cc7a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:57.080583 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d21398-939d-42bf-91db-159fe682cc7a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:57.081078 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d21398-939d-42bf-91db-159fe682cc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:57.102595 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-60d21398-939d-42bf-91db-159fe682cc7a None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:57.104148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-60d21398-939d-42bf-91db-159fe682cc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:57.114069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:57.186384 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 201/393] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:50:57.214787 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d21398-939d-42bf-91db-159fe682cc7a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:57.288201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:57.300564 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6be5a-2e08-4667-87b2-71a5dd8bd1d7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:57.339640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d21398-939d-42bf-91db-159fe682cc7a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:57.380904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53df8e1-eff5-4200-9505-95e01a50a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:57.383173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53df8e1-eff5-4200-9505-95e01a50a881 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:57.383695 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53df8e1-eff5-4200-9505-95e01a50a881 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:57.384183 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53df8e1-eff5-4200-9505-95e01a50a881 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:57.397968 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53df8e1-eff5-4200-9505-95e01a50a881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:57.413723 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244ef97-70a1-43e8-842d-b07022093c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:57.415269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ef97-70a1-43e8-842d-b07022093c48 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:57.415724 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ef97-70a1-43e8-842d-b07022093c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:57.415835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-f53df8e1-eff5-4200-9505-95e01a50a881 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:57.415835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:57.415835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:57.415835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:57.415835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:57.415835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:57.415835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:57.415835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:57.415835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:57.415835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:57.415835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:57.415835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:57.415835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:57.415835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:57.415835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:57.415835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:57.416985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:57.416985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:57.416985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:57.416985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:57.416985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:57.416985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:57.416985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:57.416985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:57.416985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:57.416985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:57.416985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:57.416985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:57.416985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:57.416985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:57.416985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:57.416985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:57.417814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:57.417814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:57.417814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:57.417814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:57.417814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:57.417814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:57.417814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:57.417814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:57.417814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:57.417814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:57.417814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:57.417814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:57.417814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 202/394] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:50:57.419310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244ef97-70a1-43e8-842d-b07022093c48 None admin] PATH_INFO: `/v3/groups/12c86d136c4f4ac59729e795a3884f86` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:57.420826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244ef97-70a1-43e8-842d-b07022093c48 None admin] RBAC: Authorizing `identity:get_group(group_id=12c86d136c4f4ac59729e795a3884f86)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:57.422849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244ef97-70a1-43e8-842d-b07022093c48 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:57.423037 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53df8e1-eff5-4200-9505-95e01a50a881 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:57.425279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 193/395] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 18 16:50:57 2022] GET /identity/v3/groups/12c86d136c4f4ac59729e795a3884f86 => generated 226 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:57.434037 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:57.434920 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244ef97-70a1-43e8-842d-b07022093c48 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:57.545052 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53df8e1-eff5-4200-9505-95e01a50a881 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:57.587773 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7ad8d-82ad-45a1-a0b4-0d30004e0fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:57.589694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7ad8d-82ad-45a1-a0b4-0d30004e0fae None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:57.591287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7ad8d-82ad-45a1-a0b4-0d30004e0fae None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:57.592504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7ad8d-82ad-45a1-a0b4-0d30004e0fae None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:57.593481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7ad8d-82ad-45a1-a0b4-0d30004e0fae None admin] RBAC: Adding query filter params (name=member) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:57.596735 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7ad8d-82ad-45a1-a0b4-0d30004e0fae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:57.598595 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7ad8d-82ad-45a1-a0b4-0d30004e0fae None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:57.619011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 203/396] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:57.626668 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7ad8d-82ad-45a1-a0b4-0d30004e0fae None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:57.681716 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244ef97-70a1-43e8-842d-b07022093c48 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:57.729313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743c30c-206a-4fd0-bd8c-bb6b60f36965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:57.730963 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743c30c-206a-4fd0-bd8c-bb6b60f36965 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:57.731562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743c30c-206a-4fd0-bd8c-bb6b60f36965 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:57.732108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743c30c-206a-4fd0-bd8c-bb6b60f36965 None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:57.733609 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743c30c-206a-4fd0-bd8c-bb6b60f36965 None admin] RBAC: Authorizing `identity:get_project(project_id=e2c925ab39e142be8182f673b844dc7a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:57.734058 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:57.736166 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743c30c-206a-4fd0-bd8c-bb6b60f36965 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:57.738581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 194/397] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:57 2022] GET /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:57.740283 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c78284-ba44-450c-a069-f290b1ef24ff None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:57.740755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c78284-ba44-450c-a069-f290b1ef24ff None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:57.741739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c78284-ba44-450c-a069-f290b1ef24ff None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:57.743307 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 195/398] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:57.744583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c78284-ba44-450c-a069-f290b1ef24ff None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:57.789477 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7ad8d-82ad-45a1-a0b4-0d30004e0fae None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:57.799233 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:57.842932 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005c2f3-f6f4-4b41-9bfc-3d115d57d2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:57.844157 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005c2f3-f6f4-4b41-9bfc-3d115d57d2ff None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:57.844505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005c2f3-f6f4-4b41-9bfc-3d115d57d2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:57.844966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005c2f3-f6f4-4b41-9bfc-3d115d57d2ff None admin] PATH_INFO: `/v3/groups/12c86d136c4f4ac59729e795a3884f86` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:57.851213 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005c2f3-f6f4-4b41-9bfc-3d115d57d2ff None admin] RBAC: Authorizing `identity:get_group(group_id=12c86d136c4f4ac59729e795a3884f86)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:57.853605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005c2f3-f6f4-4b41-9bfc-3d115d57d2ff None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:57.861691 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 204/399] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 18 16:50:57 2022] GET /identity/v3/groups/12c86d136c4f4ac59729e795a3884f86 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:57.864072 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151a254-7045-497b-89bc-1308a6e4b6cb None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:57.864365 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151a254-7045-497b-89bc-1308a6e4b6cb None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:57.864639 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151a254-7045-497b-89bc-1308a6e4b6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:57.882700 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a151a254-7045-497b-89bc-1308a6e4b6cb None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:57.884140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a151a254-7045-497b-89bc-1308a6e4b6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:57.890549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c78284-ba44-450c-a069-f290b1ef24ff None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:57.941284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bc8ec-68f5-4eda-821e-f57a06e8674b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:57.942374 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bc8ec-68f5-4eda-821e-f57a06e8674b None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:57.942763 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bc8ec-68f5-4eda-821e-f57a06e8674b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:57.943195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bc8ec-68f5-4eda-821e-f57a06e8674b None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a/groups/12c86d136c4f4ac59729e795a3884f86/roles/7a9281e8b95a43c58cf4d0c272dd1469` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:57.947477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bc8ec-68f5-4eda-821e-f57a06e8674b None admin] RBAC: Authorizing `identity:create_grant(project_id=e2c925ab39e142be8182f673b844dc7a, group_id=12c86d136c4f4ac59729e795a3884f86, role_id=7a9281e8b95a43c58cf4d0c272dd1469)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:57.949613 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bc8ec-68f5-4eda-821e-f57a06e8674b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:57.966162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 205/400] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:57.967135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151a254-7045-497b-89bc-1308a6e4b6cb None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:57.969499 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 196/401] 10.222.0.49 () {58 vars in 1442 bytes} [Wed May 18 16:50:57 2022] PUT /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a/groups/12c86d136c4f4ac59729e795a3884f86/roles/7a9281e8b95a43c58cf4d0c272dd1469 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:50:57.970904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5edaad-eab2-4fce-8d36-ec8b8d989915 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:57.971217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5edaad-eab2-4fce-8d36-ec8b8d989915 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:57.971490 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5edaad-eab2-4fce-8d36-ec8b8d989915 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:57.977827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 197/402] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:57.981776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539b918-261b-472e-be9b-24546e44dc2f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:57.982281 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539b918-261b-472e-be9b-24546e44dc2f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:57.982788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539b918-261b-472e-be9b-24546e44dc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:58.009936 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3539b918-261b-472e-be9b-24546e44dc2f None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:58.011190 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3539b918-261b-472e-be9b-24546e44dc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:58.076520 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:58.114218 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 198/403] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:58.115915 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539b918-261b-472e-be9b-24546e44dc2f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:58.154125 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151a254-7045-497b-89bc-1308a6e4b6cb None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:58.156354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:58.201119 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f887c-e900-4856-9f44-ec0ebdd6eab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:58.202306 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f887c-e900-4856-9f44-ec0ebdd6eab6 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:58.202634 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f887c-e900-4856-9f44-ec0ebdd6eab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:58.202864 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f887c-e900-4856-9f44-ec0ebdd6eab6 None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:58.204297 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f887c-e900-4856-9f44-ec0ebdd6eab6 None admin] RBAC: Authorizing `identity:get_project(project_id=451724484cdd482390defb722f90bb6c)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:58.206945 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f887c-e900-4856-9f44-ec0ebdd6eab6 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:58.209348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 206/404] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:57 2022] GET /identity/v3/projects/451724484cdd482390defb722f90bb6c => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:58.213711 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f887c-e900-4856-9f44-ec0ebdd6eab6 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:58.260529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539b918-261b-472e-be9b-24546e44dc2f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:58.306989 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbe659-1230-423b-a645-95e81fa0e2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:58.307805 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbe659-1230-423b-a645-95e81fa0e2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:58.308089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbe659-1230-423b-a645-95e81fa0e2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:58.308369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbe659-1230-423b-a645-95e81fa0e2a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:58.323893 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbe659-1230-423b-a645-95e81fa0e2a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:58.332592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-04bbe659-1230-423b-a645-95e81fa0e2a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:50:58.332592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:58.332592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:58.332592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:58.332592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:58.332592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:58.332592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:58.332592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:58.332592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:58.332592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:58.332592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:58.332592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:58.332592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:58.332592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:58.332592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:58.332592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:58.333605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:58.333605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:58.333605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:58.333605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:58.333605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:58.333605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:58.333605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:58.333605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:58.333605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:58.333605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:58.333605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:58.333605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:58.333605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:58.333605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:58.333605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:58.333605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:58.334457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:58.334457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:58.334457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:58.334457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:58.334457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:58.334457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:58.334457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:58.334457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:58.334457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:58.334457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:58.334457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:50:58.334457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:58.337317 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 199/405] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:50:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:58.343286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbe659-1230-423b-a645-95e81fa0e2a0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:58.343591 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f887c-e900-4856-9f44-ec0ebdd6eab6 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:58.384572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:58.391969 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb28047-44c0-42a6-a37d-d984ab1d90c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:58.392801 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb28047-44c0-42a6-a37d-d984ab1d90c8 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:58.393082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb28047-44c0-42a6-a37d-d984ab1d90c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:58.393353 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb28047-44c0-42a6-a37d-d984ab1d90c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:58.409138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb28047-44c0-42a6-a37d-d984ab1d90c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:58.420315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-9bb28047-44c0-42a6-a37d-d984ab1d90c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:58.420315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:58.420315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:58.420315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:58.420315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:58.420315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:58.420315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:58.420315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:58.420315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:58.420315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:58.420315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:58.420315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:58.420315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:58.420315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:58.420315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:58.420315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:58.421719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:58.421719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:58.421719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:58.421719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:58.421719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:58.421719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:58.421719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:58.421719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:58.421719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:58.421719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:58.421719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:58.421719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:50:58.421719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:58.421719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:58.421719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:58.421719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:58.422636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:58.422636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:58.422636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:58.422636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:58.422636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:58.422636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:58.422636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:58.422636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:58.422636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:58.422636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:58.422636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:50:58.422636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:50:58.422636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 207/406] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:50:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:58.422636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb28047-44c0-42a6-a37d-d984ab1d90c8 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:58.459931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:58.481034 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbe659-1230-423b-a645-95e81fa0e2a0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:58.523368 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eaf4e9-2d7b-479c-8aa2-4a55d3e2dc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:58.525454 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaf4e9-2d7b-479c-8aa2-4a55d3e2dc82 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:58.526097 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaf4e9-2d7b-479c-8aa2-4a55d3e2dc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:58.526557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eaf4e9-2d7b-479c-8aa2-4a55d3e2dc82 None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c/groups/12c86d136c4f4ac59729e795a3884f86/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:58.530389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eaf4e9-2d7b-479c-8aa2-4a55d3e2dc82 None admin] RBAC: Authorizing `identity:create_grant(project_id=451724484cdd482390defb722f90bb6c, group_id=12c86d136c4f4ac59729e795a3884f86, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:58.532276 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eaf4e9-2d7b-479c-8aa2-4a55d3e2dc82 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:58.554384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 200/407] 10.222.0.49 () {58 vars in 1442 bytes} [Wed May 18 16:50:58 2022] PUT /identity/v3/projects/451724484cdd482390defb722f90bb6c/groups/12c86d136c4f4ac59729e795a3884f86/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:50:58.559764 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eaf4e9-2d7b-479c-8aa2-4a55d3e2dc82 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:58.582067 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb28047-44c0-42a6-a37d-d984ab1d90c8 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:58.669943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab651b3b-22c4-48a1-959d-24b41592f25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:58.670640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab651b3b-22c4-48a1-959d-24b41592f25b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:58.670922 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab651b3b-22c4-48a1-959d-24b41592f25b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:58.671193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab651b3b-22c4-48a1-959d-24b41592f25b None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:58.671962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab651b3b-22c4-48a1-959d-24b41592f25b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:58.672271 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab651b3b-22c4-48a1-959d-24b41592f25b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:58.674938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab651b3b-22c4-48a1-959d-24b41592f25b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:58.698535 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 208/408] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:58.705850 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab651b3b-22c4-48a1-959d-24b41592f25b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:58.745146 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eaf4e9-2d7b-479c-8aa2-4a55d3e2dc82 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:58.781170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:58.825140 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51bf5c-6a5a-45c3-b972-c9a71a6a378f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:58.826069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51bf5c-6a5a-45c3-b972-c9a71a6a378f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:58.826476 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51bf5c-6a5a-45c3-b972-c9a71a6a378f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:58.827054 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51bf5c-6a5a-45c3-b972-c9a71a6a378f None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:58.828029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51bf5c-6a5a-45c3-b972-c9a71a6a378f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:58.828837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51bf5c-6a5a-45c3-b972-c9a71a6a378f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:58.830958 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51bf5c-6a5a-45c3-b972-c9a71a6a378f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:58.842144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 201/409] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:50:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:58.843718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4b779-849a-4d3d-9c86-b5d698c366fa None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:58.844332 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4b779-849a-4d3d-9c86-b5d698c366fa None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:58.844713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4b779-849a-4d3d-9c86-b5d698c366fa None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:58.846776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 202/410] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:50:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:50:58.847874 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4b779-849a-4d3d-9c86-b5d698c366fa None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:58.862655 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab651b3b-22c4-48a1-959d-24b41592f25b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:58.866729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:58.901301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427fe32-b844-4ce3-bcbe-60fcb90ad92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:58.902355 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427fe32-b844-4ce3-bcbe-60fcb90ad92b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:58.902739 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427fe32-b844-4ce3-bcbe-60fcb90ad92b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:58.903185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427fe32-b844-4ce3-bcbe-60fcb90ad92b None admin] PATH_INFO: `/v3/groups/5ab1dfe696ae4e4e9c0a1e7328dba58f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:58.904468 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427fe32-b844-4ce3-bcbe-60fcb90ad92b None admin] RBAC: Authorizing `identity:get_group(group_id=5ab1dfe696ae4e4e9c0a1e7328dba58f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:58.906086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427fe32-b844-4ce3-bcbe-60fcb90ad92b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:58.908218 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 209/411] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 18 16:50:58 2022] GET /identity/v3/groups/5ab1dfe696ae4e4e9c0a1e7328dba58f => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:50:58.909647 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17f385-1ce1-43d9-8ab7-00dd19f255f4 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:58.910061 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17f385-1ce1-43d9-8ab7-00dd19f255f4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:58.910585 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17f385-1ce1-43d9-8ab7-00dd19f255f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:58.929365 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-be17f385-1ce1-43d9-8ab7-00dd19f255f4 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:50:58.930768 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-be17f385-1ce1-43d9-8ab7-00dd19f255f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:50:59.003065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 210/412] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:50:59.010859 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17f385-1ce1-43d9-8ab7-00dd19f255f4 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:59.053006 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4b779-849a-4d3d-9c86-b5d698c366fa None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:59.095847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:59.106160 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff139bc-6cbc-4c09-a96d-952a9218e802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:59.108098 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff139bc-6cbc-4c09-a96d-952a9218e802 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:59.108710 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff139bc-6cbc-4c09-a96d-952a9218e802 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:59.109368 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff139bc-6cbc-4c09-a96d-952a9218e802 None admin] PATH_INFO: `/v3/groups/12c86d136c4f4ac59729e795a3884f86` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:59.111522 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff139bc-6cbc-4c09-a96d-952a9218e802 None admin] RBAC: Authorizing `identity:get_group(group_id=12c86d136c4f4ac59729e795a3884f86)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:59.113879 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff139bc-6cbc-4c09-a96d-952a9218e802 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:59.121630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 203/413] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 18 16:50:58 2022] GET /identity/v3/groups/12c86d136c4f4ac59729e795a3884f86 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:59.123551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff139bc-6cbc-4c09-a96d-952a9218e802 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:59.161109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17f385-1ce1-43d9-8ab7-00dd19f255f4 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:59.200988 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7185d7e-7a39-4cae-9d7a-9f558044db24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:59.201828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7185d7e-7a39-4cae-9d7a-9f558044db24 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:59.202160 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7185d7e-7a39-4cae-9d7a-9f558044db24 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:59.202727 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7185d7e-7a39-4cae-9d7a-9f558044db24 None admin] PATH_INFO: `/v3/projects/a76edbb694024faba6c3d4a9e9057ee3` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:59.203768 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7185d7e-7a39-4cae-9d7a-9f558044db24 None admin] RBAC: Authorizing `identity:get_project(project_id=a76edbb694024faba6c3d4a9e9057ee3)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:59.205536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7185d7e-7a39-4cae-9d7a-9f558044db24 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:59.209728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 211/414] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:59 2022] GET /identity/v3/projects/a76edbb694024faba6c3d4a9e9057ee3 => generated 344 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:59.209728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7185d7e-7a39-4cae-9d7a-9f558044db24 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:59.223219 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:59.261109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff139bc-6cbc-4c09-a96d-952a9218e802 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:59.310032 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97936a6-6323-45fb-9a59-df09cf8cf32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:59.310867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97936a6-6323-45fb-9a59-df09cf8cf32c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:59.311153 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97936a6-6323-45fb-9a59-df09cf8cf32c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:59.311430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97936a6-6323-45fb-9a59-df09cf8cf32c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:59.328780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97936a6-6323-45fb-9a59-df09cf8cf32c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:50:59.337643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a97936a6-6323-45fb-9a59-df09cf8cf32c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:59.337643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:50:59.337643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:50:59.337643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:50:59.337643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:50:59.337643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:50:59.337643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:50:59.337643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:50:59.337643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:50:59.337643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:50:59.337643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:50:59.337643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:50:59.337643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:50:59.337643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:50:59.337643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:50:59.337643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:50:59.338788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:50:59.338788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:50:59.338788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:50:59.338788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:50:59.338788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:50:59.338788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:50:59.338788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:50:59.338788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:50:59.338788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:50:59.338788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:50:59.338788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:50:59.338788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:50:59.338788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:50:59.338788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:50:59.338788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:50:59.338788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:50:59.339588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:50:59.339588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:50:59.339588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:50:59.339588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:50:59.339588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:50:59.339588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:50:59.339588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:50:59.339588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:50:59.339588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:50:59.339588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:50:59.339588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 16:50:59.339588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:50:59.342231 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 204/415] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:50:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:50:59.343273 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97936a6-6323-45fb-9a59-df09cf8cf32c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:59.345173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7185d7e-7a39-4cae-9d7a-9f558044db24 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:59.370872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:59.397527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17b0a2-ca8b-4df9-bcc1-127a3283c1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:59.398455 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17b0a2-ca8b-4df9-bcc1-127a3283c1ca None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:59.398821 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17b0a2-ca8b-4df9-bcc1-127a3283c1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:59.399217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae17b0a2-ca8b-4df9-bcc1-127a3283c1ca None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:59.401524 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17b0a2-ca8b-4df9-bcc1-127a3283c1ca None admin] RBAC: Authorizing `identity:get_project(project_id=451724484cdd482390defb722f90bb6c)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:59.403369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae17b0a2-ca8b-4df9-bcc1-127a3283c1ca None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:59.409845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 212/416] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:50:59 2022] GET /identity/v3/projects/451724484cdd482390defb722f90bb6c => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:59.409845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17b0a2-ca8b-4df9-bcc1-127a3283c1ca None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:59.476795 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97936a6-6323-45fb-9a59-df09cf8cf32c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:59.519564 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cd6a5-8cfa-43b6-bc49-620cb37260d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:59.520854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cd6a5-8cfa-43b6-bc49-620cb37260d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:59.525473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cd6a5-8cfa-43b6-bc49-620cb37260d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:59.526148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cd6a5-8cfa-43b6-bc49-620cb37260d0 None admin] PATH_INFO: `/v3/projects/a76edbb694024faba6c3d4a9e9057ee3/groups/5ab1dfe696ae4e4e9c0a1e7328dba58f/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:59.528955 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cd6a5-8cfa-43b6-bc49-620cb37260d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a76edbb694024faba6c3d4a9e9057ee3, group_id=5ab1dfe696ae4e4e9c0a1e7328dba58f, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:59.530928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cd6a5-8cfa-43b6-bc49-620cb37260d0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:59.533922 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:59.537930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae17b0a2-ca8b-4df9-bcc1-127a3283c1ca None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:59.550259 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 205/417] 10.222.0.49 () {58 vars in 1442 bytes} [Wed May 18 16:50:59 2022] PUT /identity/v3/projects/a76edbb694024faba6c3d4a9e9057ee3/groups/5ab1dfe696ae4e4e9c0a1e7328dba58f/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:50:59.551483 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cd6a5-8cfa-43b6-bc49-620cb37260d0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:59.596455 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360c223-b975-40ea-bb2d-fc659c5cff59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:59.597140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360c223-b975-40ea-bb2d-fc659c5cff59 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:59.597727 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360c223-b975-40ea-bb2d-fc659c5cff59 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:59.597727 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360c223-b975-40ea-bb2d-fc659c5cff59 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:59.598522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360c223-b975-40ea-bb2d-fc659c5cff59 None admin] RBAC: Adding query filter params (name=member) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:50:59.598831 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360c223-b975-40ea-bb2d-fc659c5cff59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:59.600784 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360c223-b975-40ea-bb2d-fc659c5cff59 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:59.611374 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 213/418] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:50:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:50:59.616865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360c223-b975-40ea-bb2d-fc659c5cff59 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:50:59.679415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:50:59.749259 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360c223-b975-40ea-bb2d-fc659c5cff59 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:59.755786 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cd6a5-8cfa-43b6-bc49-620cb37260d0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:50:59.790606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8965f0-c959-4979-81fc-f94959b1c214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:59.791277 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8965f0-c959-4979-81fc-f94959b1c214 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:59.791554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8965f0-c959-4979-81fc-f94959b1c214 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:59.791917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8965f0-c959-4979-81fc-f94959b1c214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:59.874765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8965f0-c959-4979-81fc-f94959b1c214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:59.876406 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8965f0-c959-4979-81fc-f94959b1c214 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:59.876725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf59021-6972-4555-8994-8ecbe3bf555a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:50:59.877980 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf59021-6972-4555-8994-8ecbe3bf555a None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:50:59.878659 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf59021-6972-4555-8994-8ecbe3bf555a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:50:59.879167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf59021-6972-4555-8994-8ecbe3bf555a None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c/groups/12c86d136c4f4ac59729e795a3884f86/roles/7a9281e8b95a43c58cf4d0c272dd1469` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:50:59.883529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf59021-6972-4555-8994-8ecbe3bf555a None admin] RBAC: Authorizing `identity:create_grant(project_id=451724484cdd482390defb722f90bb6c, group_id=12c86d136c4f4ac59729e795a3884f86, role_id=7a9281e8b95a43c58cf4d0c272dd1469)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:50:59.885396 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf59021-6972-4555-8994-8ecbe3bf555a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:50:59.904877 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 206/419] 10.222.0.49 () {58 vars in 1442 bytes} [Wed May 18 16:50:59 2022] PUT /identity/v3/projects/451724484cdd482390defb722f90bb6c/groups/12c86d136c4f4ac59729e795a3884f86/roles/7a9281e8b95a43c58cf4d0c272dd1469 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:50:59.940505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:00.008794 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 214/420] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:50:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:51:00.010410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf59021-6972-4555-8994-8ecbe3bf555a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:00.110046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:00.155132 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf59021-6972-4555-8994-8ecbe3bf555a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:00.196930 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf147c-4b20-4396-9db3-8d1dcb386f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:00.197820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf147c-4b20-4396-9db3-8d1dcb386f4a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:00.198161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf147c-4b20-4396-9db3-8d1dcb386f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:00.198444 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf147c-4b20-4396-9db3-8d1dcb386f4a None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:00.199777 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf147c-4b20-4396-9db3-8d1dcb386f4a None admin] RBAC: Authorizing `identity:get_project(project_id=e2c925ab39e142be8182f673b844dc7a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:00.201254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf147c-4b20-4396-9db3-8d1dcb386f4a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:00.203374 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 207/421] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:51:00 2022] GET /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:00.210017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8965f0-c959-4979-81fc-f94959b1c214 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:00.353871 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8965f0-c959-4979-81fc-f94959b1c214 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:00.393881 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1bb75-3241-4646-bf63-00239ad28f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:00.395127 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1bb75-3241-4646-bf63-00239ad28f34 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:00.395615 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1bb75-3241-4646-bf63-00239ad28f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:00.396081 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1bb75-3241-4646-bf63-00239ad28f34 None admin] PATH_INFO: `/v3/groups/12c86d136c4f4ac59729e795a3884f86` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:00.398030 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1bb75-3241-4646-bf63-00239ad28f34 None admin] RBAC: Authorizing `identity:get_group(group_id=12c86d136c4f4ac59729e795a3884f86)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:00.399734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1bb75-3241-4646-bf63-00239ad28f34 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:00.401986 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 215/422] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 18 16:51:00 2022] GET /identity/v3/groups/12c86d136c4f4ac59729e795a3884f86 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:00.407612 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf147c-4b20-4396-9db3-8d1dcb386f4a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:00.477868 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13652cef-ee18-449e-845f-f85c1031f00f None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:00.478478 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13652cef-ee18-449e-845f-f85c1031f00f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:00.478949 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13652cef-ee18-449e-845f-f85c1031f00f None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:00.480795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 216/423] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:00.492009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fceef15-8903-489e-91d2-e6cd331d968e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:00.492626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fceef15-8903-489e-91d2-e6cd331d968e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:00.493096 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fceef15-8903-489e-91d2-e6cd331d968e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:00.523028 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9fceef15-8903-489e-91d2-e6cd331d968e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:00.524607 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9fceef15-8903-489e-91d2-e6cd331d968e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:00.543688 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf147c-4b20-4396-9db3-8d1dcb386f4a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:00.547172 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:00.574167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:00.586722 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3a360-e735-454c-b5a7-02e8c366ddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:00.587719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3a360-e735-454c-b5a7-02e8c366ddf4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:00.588275 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3a360-e735-454c-b5a7-02e8c366ddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:00.588700 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3a360-e735-454c-b5a7-02e8c366ddf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:00.589893 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3a360-e735-454c-b5a7-02e8c366ddf4 None admin] RBAC: Adding query filter params (group.id=12c86d136c4f4ac59729e795a3884f86, role.id=bfec786c9ea74c4aaecf243a866539af, scope.project.id=e2c925ab39e142be8182f673b844dc7a) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:00.590362 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3a360-e735-454c-b5a7-02e8c366ddf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:00.592217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3a360-e735-454c-b5a7-02e8c366ddf4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:00.599556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 208/424] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 18 16:51:00 2022] GET /identity/v3/role_assignments?group.id=12c86d136c4f4ac59729e795a3884f86&scope.project.id=e2c925ab39e142be8182f673b844dc7a&role.id=bfec786c9ea74c4aaecf243a866539af => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:00.667729 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 217/425] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:51:00.707293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3a360-e735-454c-b5a7-02e8c366ddf4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:00.851523 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3a360-e735-454c-b5a7-02e8c366ddf4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:00.890154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8df7d-dc85-4d46-82e7-6d005eb9a257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:00.891217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8df7d-dc85-4d46-82e7-6d005eb9a257 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:00.891650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8df7d-dc85-4d46-82e7-6d005eb9a257 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:00.892070 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8df7d-dc85-4d46-82e7-6d005eb9a257 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:00.905158 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8df7d-dc85-4d46-82e7-6d005eb9a257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:00.914776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-dfd8df7d-dc85-4d46-82e7-6d005eb9a257 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:51:00.914776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:00.914776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:00.914776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:00.914776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:00.914776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:00.914776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:00.914776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:00.914776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:00.914776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:00.914776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:00.914776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:00.914776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:00.914776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:00.914776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:00.914776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:00.915894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:00.915894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:00.915894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:00.915894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:00.915894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:00.915894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:00.915894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:00.915894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:00.915894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:00.915894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:00.915894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:00.915894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:00.915894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:00.915894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:00.915894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:00.915894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:00.916883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:00.916883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:00.916883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:00.916883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:00.916883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:00.916883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:00.916883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:00.916883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:00.916883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:00.916883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:00.916883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:51:00.916883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:00.919284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 209/426] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:51:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:00.925032 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fceef15-8903-489e-91d2-e6cd331d968e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:01.066966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fceef15-8903-489e-91d2-e6cd331d968e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:01.119502 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ae71a-2aa0-4648-8601-426996a39734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:01.120134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ae71a-2aa0-4648-8601-426996a39734 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:01.120419 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ae71a-2aa0-4648-8601-426996a39734 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:01.120698 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ae71a-2aa0-4648-8601-426996a39734 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:01.121495 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ae71a-2aa0-4648-8601-426996a39734 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:01.121873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ae71a-2aa0-4648-8601-426996a39734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:01.123329 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ae71a-2aa0-4648-8601-426996a39734 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:01.135726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 218/427] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:01.141411 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8df7d-dc85-4d46-82e7-6d005eb9a257 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:01.198011 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:01.260998 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8df7d-dc85-4d46-82e7-6d005eb9a257 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:01.298540 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699d5f-0770-4e57-8565-3a9040246ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:01.299198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699d5f-0770-4e57-8565-3a9040246ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:01.299485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699d5f-0770-4e57-8565-3a9040246ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:01.299770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699d5f-0770-4e57-8565-3a9040246ae4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:01.318677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcea1c3-68bb-4f3d-8ca1-25a677a4690d None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:01.318984 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcea1c3-68bb-4f3d-8ca1-25a677a4690d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:01.319255 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcea1c3-68bb-4f3d-8ca1-25a677a4690d None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:01.322265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 219/428] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:01.326878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b44218-0526-4aa2-9c10-0a0f7083faad None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:01.327172 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b44218-0526-4aa2-9c10-0a0f7083faad None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:01.327453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b44218-0526-4aa2-9c10-0a0f7083faad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:01.346745 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f9b44218-0526-4aa2-9c10-0a0f7083faad None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:01.348062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f9b44218-0526-4aa2-9c10-0a0f7083faad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:01.350804 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:01.379227 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33699d5f-0770-4e57-8565-3a9040246ae4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:01.381567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33699d5f-0770-4e57-8565-3a9040246ae4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:01.429808 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 220/429] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:01.431867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:01.454661 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b44218-0526-4aa2-9c10-0a0f7083faad None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:01.492959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 210/430] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:51:01.499004 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699d5f-0770-4e57-8565-3a9040246ae4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:01.574833 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b44218-0526-4aa2-9c10-0a0f7083faad None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:01.613297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699d5f-0770-4e57-8565-3a9040246ae4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:01.614887 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bfc72-a286-4dfc-b02b-5612cd4a23e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:01.616326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bfc72-a286-4dfc-b02b-5612cd4a23e1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:01.616641 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bfc72-a286-4dfc-b02b-5612cd4a23e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:01.616991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bfc72-a286-4dfc-b02b-5612cd4a23e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:01.625065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:01.631404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bfc72-a286-4dfc-b02b-5612cd4a23e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:01.639749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-045bfc72-a286-4dfc-b02b-5612cd4a23e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 18 16:51:01.639749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:01.639749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:01.639749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:01.639749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:01.639749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:01.639749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:01.639749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:01.639749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:01.639749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:01.639749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:01.639749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:01.639749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:01.639749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:01.639749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:01.639749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:01.641973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:01.641973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:01.641973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:01.641973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:01.641973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:01.641973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:01.641973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:01.641973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:01.641973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:01.641973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:01.641973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:01.641973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:01.641973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:01.641973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:01.641973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:01.641973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:01.643904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:01.643904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:01.643904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:01.643904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:01.643904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:01.643904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:01.643904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:01.643904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:01.643904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:01.643904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:01.643904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 18 16:51:01.643904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:01.645873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 221/431] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:51:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:01.648408 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bfc72-a286-4dfc-b02b-5612cd4a23e1 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:01.655776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b8415-83f8-4b69-aead-40035c87e952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:01.656653 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b8415-83f8-4b69-aead-40035c87e952 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:01.656983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b8415-83f8-4b69-aead-40035c87e952 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:01.657267 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b8415-83f8-4b69-aead-40035c87e952 None admin] PATH_INFO: `/v3/projects/e2c925ab39e142be8182f673b844dc7a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:01.659174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b8415-83f8-4b69-aead-40035c87e952 None admin] RBAC: Authorizing `identity:get_project(project_id=e2c925ab39e142be8182f673b844dc7a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:01.660638 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b8415-83f8-4b69-aead-40035c87e952 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:01.663615 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 211/432] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:51:01 2022] GET /identity/v3/projects/e2c925ab39e142be8182f673b844dc7a => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:01.668588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b8415-83f8-4b69-aead-40035c87e952 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:01.686817 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:01.764546 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bfc72-a286-4dfc-b02b-5612cd4a23e1 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:01.788361 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b8415-83f8-4b69-aead-40035c87e952 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:01.804541 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a02c0-3995-4583-9bdd-e485603de6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:01.805221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a02c0-3995-4583-9bdd-e485603de6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:01.805506 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a02c0-3995-4583-9bdd-e485603de6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:01.805809 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a02c0-3995-4583-9bdd-e485603de6a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:01.806579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a02c0-3995-4583-9bdd-e485603de6a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:01.806888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a02c0-3995-4583-9bdd-e485603de6a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:01.808283 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a02c0-3995-4583-9bdd-e485603de6a2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:01.821807 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 222/433] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:51:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:01.823977 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a02c0-3995-4583-9bdd-e485603de6a2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:01.840267 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0f2ac-ba94-491a-943b-dbb3cbdee3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:01.841199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0f2ac-ba94-491a-943b-dbb3cbdee3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:01.841486 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0f2ac-ba94-491a-943b-dbb3cbdee3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:01.841801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0f2ac-ba94-491a-943b-dbb3cbdee3a9 None admin] PATH_INFO: `/v3/groups/12c86d136c4f4ac59729e795a3884f86` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:01.843055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0f2ac-ba94-491a-943b-dbb3cbdee3a9 None admin] RBAC: Authorizing `identity:get_group(group_id=12c86d136c4f4ac59729e795a3884f86)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:01.844520 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0f2ac-ba94-491a-943b-dbb3cbdee3a9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:01.846593 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 212/434] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 18 16:51:01 2022] GET /identity/v3/groups/12c86d136c4f4ac59729e795a3884f86 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:01.856710 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0f2ac-ba94-491a-943b-dbb3cbdee3a9 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:01.898048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:01.944746 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a02c0-3995-4583-9bdd-e485603de6a2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:01.957987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:01.981296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0f2ac-ba94-491a-943b-dbb3cbdee3a9 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:01.984992 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157debf-4441-4e35-b208-da070be043b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:01.985686 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157debf-4441-4e35-b208-da070be043b9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:01.985974 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157debf-4441-4e35-b208-da070be043b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:01.986256 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157debf-4441-4e35-b208-da070be043b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:02.019473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202fbfe-1278-4c2c-a2cf-2838e98b3a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:02.020277 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202fbfe-1278-4c2c-a2cf-2838e98b3a70 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:02.020662 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202fbfe-1278-4c2c-a2cf-2838e98b3a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:02.021040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202fbfe-1278-4c2c-a2cf-2838e98b3a70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:02.022702 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202fbfe-1278-4c2c-a2cf-2838e98b3a70 None admin] RBAC: Adding query filter params (group.id=12c86d136c4f4ac59729e795a3884f86, role.id=7a9281e8b95a43c58cf4d0c272dd1469, scope.project.id=e2c925ab39e142be8182f673b844dc7a) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:02.023121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202fbfe-1278-4c2c-a2cf-2838e98b3a70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:02.024727 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202fbfe-1278-4c2c-a2cf-2838e98b3a70 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:02.031974 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 213/435] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 18 16:51:01 2022] GET /identity/v3/role_assignments?group.id=12c86d136c4f4ac59729e795a3884f86&scope.project.id=e2c925ab39e142be8182f673b844dc7a&role.id=7a9281e8b95a43c58cf4d0c272dd1469 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:02.076417 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157debf-4441-4e35-b208-da070be043b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:02.078340 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157debf-4441-4e35-b208-da070be043b9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:02.147074 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:02.204652 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 223/436] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 16:51:02.210736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202fbfe-1278-4c2c-a2cf-2838e98b3a70 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:02.342816 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202fbfe-1278-4c2c-a2cf-2838e98b3a70 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:02.382770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf3ea8-8e16-4e76-b74a-2565722c4d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:02.383672 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf3ea8-8e16-4e76-b74a-2565722c4d56 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:02.383956 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf3ea8-8e16-4e76-b74a-2565722c4d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:02.384234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf3ea8-8e16-4e76-b74a-2565722c4d56 None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:02.385503 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf3ea8-8e16-4e76-b74a-2565722c4d56 None admin] RBAC: Authorizing `identity:get_project(project_id=451724484cdd482390defb722f90bb6c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:02.387008 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf3ea8-8e16-4e76-b74a-2565722c4d56 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:02.389146 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 214/437] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:51:02 2022] GET /identity/v3/projects/451724484cdd482390defb722f90bb6c => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:02.394709 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157debf-4441-4e35-b208-da070be043b9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:02.445705 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6c551-afdb-4a64-89ec-5f91949e4742 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:02.446336 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6c551-afdb-4a64-89ec-5f91949e4742 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:02.446803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6c551-afdb-4a64-89ec-5f91949e4742 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:02.448972 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 215/438] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:51:02.455385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad0200-9863-4f8c-b85d-431e62d1605f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:02.456081 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad0200-9863-4f8c-b85d-431e62d1605f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:02.456557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad0200-9863-4f8c-b85d-431e62d1605f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:02.480351 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-08ad0200-9863-4f8c-b85d-431e62d1605f None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:02.481747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-08ad0200-9863-4f8c-b85d-431e62d1605f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:02.494178 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:02.536678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157debf-4441-4e35-b208-da070be043b9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:02.589185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b6acb-ba37-4a94-89b7-9a64f046cef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:02.590125 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b6acb-ba37-4a94-89b7-9a64f046cef9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:02.590415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b6acb-ba37-4a94-89b7-9a64f046cef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:02.590689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b6acb-ba37-4a94-89b7-9a64f046cef9 None admin] PATH_INFO: `/v3/groups/12c86d136c4f4ac59729e795a3884f86` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:02.591947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b6acb-ba37-4a94-89b7-9a64f046cef9 None admin] RBAC: Authorizing `identity:get_group(group_id=12c86d136c4f4ac59729e795a3884f86)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:02.593431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b6acb-ba37-4a94-89b7-9a64f046cef9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:02.595163 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 224/439] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 18 16:51:02 2022] GET /identity/v3/groups/12c86d136c4f4ac59729e795a3884f86 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:02.602868 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b6acb-ba37-4a94-89b7-9a64f046cef9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:02.607610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 216/440] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:02.630784 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad0200-9863-4f8c-b85d-431e62d1605f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:02.638719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:02.727468 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b6acb-ba37-4a94-89b7-9a64f046cef9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:02.747748 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad0200-9863-4f8c-b85d-431e62d1605f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:02.766190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697d2ea-1626-49ce-9e0f-b4ed0a4de11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:02.766848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697d2ea-1626-49ce-9e0f-b4ed0a4de11a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:02.767130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697d2ea-1626-49ce-9e0f-b4ed0a4de11a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:02.767408 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697d2ea-1626-49ce-9e0f-b4ed0a4de11a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:02.768248 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697d2ea-1626-49ce-9e0f-b4ed0a4de11a None admin] RBAC: Adding query filter params (group.id=12c86d136c4f4ac59729e795a3884f86, role.id=bfec786c9ea74c4aaecf243a866539af, scope.project.id=451724484cdd482390defb722f90bb6c) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:02.768553 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697d2ea-1626-49ce-9e0f-b4ed0a4de11a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:02.770029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697d2ea-1626-49ce-9e0f-b4ed0a4de11a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:02.785712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 225/441] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 18 16:51:02 2022] GET /identity/v3/role_assignments?group.id=12c86d136c4f4ac59729e795a3884f86&scope.project.id=451724484cdd482390defb722f90bb6c&role.id=bfec786c9ea74c4aaecf243a866539af => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:02.797571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809320d-af3d-4f12-80ff-5fac9bbe5d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:02.798454 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809320d-af3d-4f12-80ff-5fac9bbe5d7e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:02.798745 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809320d-af3d-4f12-80ff-5fac9bbe5d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:02.799016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809320d-af3d-4f12-80ff-5fac9bbe5d7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:02.812714 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809320d-af3d-4f12-80ff-5fac9bbe5d7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:02.821567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-f809320d-af3d-4f12-80ff-5fac9bbe5d7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:51:02.821567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:02.821567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:02.821567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:02.821567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:02.821567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:02.821567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:02.821567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:02.821567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:02.821567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:02.821567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:02.821567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:02.821567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:02.821567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:02.821567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:02.821567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:02.822597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:02.822597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:02.822597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:02.822597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:02.822597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:02.822597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:02.822597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:02.822597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:02.822597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:02.822597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:02.822597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:02.822597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:02.822597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:02.822597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:02.822597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:02.822597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:02.828557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:02.828557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:02.828557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:02.828557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:02.828557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:02.828557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:02.828557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:02.828557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:02.828557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:02.828557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:02.828557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:51:02.828557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:02.829197 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5327b6-15b8-492c-aa6f-cffd6c65fbd6 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:02.829197 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5327b6-15b8-492c-aa6f-cffd6c65fbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:02.829197 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5327b6-15b8-492c-aa6f-cffd6c65fbd6 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:02.829392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 217/442] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:51:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:02.829459 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 226/443] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:51:02.829524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809320d-af3d-4f12-80ff-5fac9bbe5d7e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:02.830334 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99748b-cf83-4a1c-b5cd-08cb37ec2e30 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:02.830450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99748b-cf83-4a1c-b5cd-08cb37ec2e30 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:02.830714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99748b-cf83-4a1c-b5cd-08cb37ec2e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:02.836028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:02.850640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-1f99748b-cf83-4a1c-b5cd-08cb37ec2e30 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:02.851619 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1f99748b-cf83-4a1c-b5cd-08cb37ec2e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:02.940323 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 227/444] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:02.964594 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809320d-af3d-4f12-80ff-5fac9bbe5d7e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:02.965889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99748b-cf83-4a1c-b5cd-08cb37ec2e30 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:02.996060 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:03.009876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37044e08-880d-4773-8ecd-df13172d4f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:03.010085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37044e08-880d-4773-8ecd-df13172d4f59 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:03.010286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37044e08-880d-4773-8ecd-df13172d4f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:03.011454 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37044e08-880d-4773-8ecd-df13172d4f59 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:03.012251 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37044e08-880d-4773-8ecd-df13172d4f59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:03.012565 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37044e08-880d-4773-8ecd-df13172d4f59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:03.013999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37044e08-880d-4773-8ecd-df13172d4f59 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:03.023603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 218/445] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:51:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:03.029285 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37044e08-880d-4773-8ecd-df13172d4f59 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:03.092816 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99748b-cf83-4a1c-b5cd-08cb37ec2e30 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:03.126120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:03.140584 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9edb9a-2cc7-49f8-bb90-4256b0f63774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:03.141436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9edb9a-2cc7-49f8-bb90-4256b0f63774 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:03.141741 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9edb9a-2cc7-49f8-bb90-4256b0f63774 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:03.142005 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9edb9a-2cc7-49f8-bb90-4256b0f63774 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:03.157480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9edb9a-2cc7-49f8-bb90-4256b0f63774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:03.167933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-4a9edb9a-2cc7-49f8-bb90-4256b0f63774 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:51:03.167933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:03.167933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:03.167933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:03.167933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:03.167933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:03.167933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:03.167933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:03.167933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:03.167933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:03.167933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:03.167933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:03.167933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:03.167933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:03.167933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:03.167933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:03.169266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:03.169266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:03.169266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:03.169266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:03.169266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:03.169266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:03.169266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:03.169266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:03.169266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:03.169266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:03.169266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:03.169266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:03.169266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:03.169266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:03.169266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:03.169266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:03.170190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:03.170190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:03.170190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:03.170190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:03.170190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:03.170190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:03.170190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:03.170190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:03.170190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:03.170190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:03.170190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:51:03.170190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:03.170190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 228/446] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:51:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:03.173557 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9edb9a-2cc7-49f8-bb90-4256b0f63774 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:03.183671 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37044e08-880d-4773-8ecd-df13172d4f59 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:03.234119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aa325-f047-458a-89e4-2015e8858cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:03.234862 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aa325-f047-458a-89e4-2015e8858cfa None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:03.235266 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aa325-f047-458a-89e4-2015e8858cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:03.235658 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aa325-f047-458a-89e4-2015e8858cfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:03.276169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:03.297119 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9edb9a-2cc7-49f8-bb90-4256b0f63774 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:03.310916 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aa325-f047-458a-89e4-2015e8858cfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:03.312824 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757aa325-f047-458a-89e4-2015e8858cfa None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:03.340748 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878416a1-6066-4527-abd6-787d416f5197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:03.341434 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878416a1-6066-4527-abd6-787d416f5197 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:03.341982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878416a1-6066-4527-abd6-787d416f5197 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:03.342311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878416a1-6066-4527-abd6-787d416f5197 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:03.343111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878416a1-6066-4527-abd6-787d416f5197 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:03.343423 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878416a1-6066-4527-abd6-787d416f5197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:03.344818 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878416a1-6066-4527-abd6-787d416f5197 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:03.356866 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 229/447] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:03.362095 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878416a1-6066-4527-abd6-787d416f5197 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:03.399011 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:03.443958 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 219/448] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:51:03.449588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aa325-f047-458a-89e4-2015e8858cfa None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:03.482246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878416a1-6066-4527-abd6-787d416f5197 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:03.519591 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0c500-acae-4931-99b1-b7899cb5ada9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:03.520254 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0c500-acae-4931-99b1-b7899cb5ada9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:03.520533 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0c500-acae-4931-99b1-b7899cb5ada9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:03.520811 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0c500-acae-4931-99b1-b7899cb5ada9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:03.539851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:03.557402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757aa325-f047-458a-89e4-2015e8858cfa None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:03.593424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7dd60-fdea-4c82-a1fa-834a2b27651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:03.594320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7dd60-fdea-4c82-a1fa-834a2b27651e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:03.594603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7dd60-fdea-4c82-a1fa-834a2b27651e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:03.594881 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7dd60-fdea-4c82-a1fa-834a2b27651e None admin] PATH_INFO: `/v3/projects/a76edbb694024faba6c3d4a9e9057ee3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:03.596097 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7dd60-fdea-4c82-a1fa-834a2b27651e None admin] RBAC: Authorizing `identity:get_project(project_id=a76edbb694024faba6c3d4a9e9057ee3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:03.597215 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0c500-acae-4931-99b1-b7899cb5ada9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:03.597649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7dd60-fdea-4c82-a1fa-834a2b27651e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:03.598713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0c500-acae-4931-99b1-b7899cb5ada9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:03.599321 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 220/449] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:51:03 2022] GET /identity/v3/projects/a76edbb694024faba6c3d4a9e9057ee3 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:03.605498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7dd60-fdea-4c82-a1fa-834a2b27651e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:03.640427 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:03.704094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 230/450] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 16:51:03.711064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0c500-acae-4931-99b1-b7899cb5ada9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:03.712288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7dd60-fdea-4c82-a1fa-834a2b27651e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:03.746608 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065962c-4420-4b4b-b9ee-b6461888e10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:03.747458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065962c-4420-4b4b-b9ee-b6461888e10c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:03.747734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065962c-4420-4b4b-b9ee-b6461888e10c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:03.748006 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065962c-4420-4b4b-b9ee-b6461888e10c None admin] PATH_INFO: `/v3/groups/5ab1dfe696ae4e4e9c0a1e7328dba58f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:03.749200 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065962c-4420-4b4b-b9ee-b6461888e10c None admin] RBAC: Authorizing `identity:get_group(group_id=5ab1dfe696ae4e4e9c0a1e7328dba58f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:03.750773 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065962c-4420-4b4b-b9ee-b6461888e10c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:03.752301 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 221/451] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 18 16:51:03 2022] GET /identity/v3/groups/5ab1dfe696ae4e4e9c0a1e7328dba58f => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:03.758641 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:03.758899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065962c-4420-4b4b-b9ee-b6461888e10c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:03.815223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0c500-acae-4931-99b1-b7899cb5ada9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:03.853867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b5cf7-33fc-41d1-ade5-d8d1274b80a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:03.854737 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b5cf7-33fc-41d1-ade5-d8d1274b80a1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:03.855017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b5cf7-33fc-41d1-ade5-d8d1274b80a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:03.855293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b5cf7-33fc-41d1-ade5-d8d1274b80a1 None admin] PATH_INFO: `/v3/projects/451724484cdd482390defb722f90bb6c` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:03.856555 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b5cf7-33fc-41d1-ade5-d8d1274b80a1 None admin] RBAC: Authorizing `identity:get_project(project_id=451724484cdd482390defb722f90bb6c)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:03.858221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b5cf7-33fc-41d1-ade5-d8d1274b80a1 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:03.859951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 231/452] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:51:03 2022] GET /identity/v3/projects/451724484cdd482390defb722f90bb6c => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:03.864793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065962c-4420-4b4b-b9ee-b6461888e10c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:03.864793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:03.865864 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b5cf7-33fc-41d1-ade5-d8d1274b80a1 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:03.907504 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8959c7-61fd-4a0a-b08e-95b6f47b793c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:03.908155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8959c7-61fd-4a0a-b08e-95b6f47b793c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:03.908463 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8959c7-61fd-4a0a-b08e-95b6f47b793c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:03.908737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8959c7-61fd-4a0a-b08e-95b6f47b793c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:03.909579 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8959c7-61fd-4a0a-b08e-95b6f47b793c None admin] RBAC: Adding query filter params (group.id=5ab1dfe696ae4e4e9c0a1e7328dba58f, role.id=b3f3f4910bf646699f30b749edeef422, scope.project.id=a76edbb694024faba6c3d4a9e9057ee3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:03.909923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8959c7-61fd-4a0a-b08e-95b6f47b793c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:03.911367 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8959c7-61fd-4a0a-b08e-95b6f47b793c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:03.917974 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 222/453] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 18 16:51:03 2022] GET /identity/v3/role_assignments?group.id=5ab1dfe696ae4e4e9c0a1e7328dba58f&scope.project.id=a76edbb694024faba6c3d4a9e9057ee3&role.id=b3f3f4910bf646699f30b749edeef422 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:03.984984 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b5cf7-33fc-41d1-ade5-d8d1274b80a1 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:04.000694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:04.025481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc775482-d5e0-4a6f-94ad-3f22dfe39809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:04.026393 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc775482-d5e0-4a6f-94ad-3f22dfe39809 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:04.026677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc775482-d5e0-4a6f-94ad-3f22dfe39809 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:04.026952 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc775482-d5e0-4a6f-94ad-3f22dfe39809 None admin] PATH_INFO: `/v3/groups/12c86d136c4f4ac59729e795a3884f86` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:04.028243 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc775482-d5e0-4a6f-94ad-3f22dfe39809 None admin] RBAC: Authorizing `identity:get_group(group_id=12c86d136c4f4ac59729e795a3884f86)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:04.029762 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc775482-d5e0-4a6f-94ad-3f22dfe39809 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:04.031482 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 232/454] 10.222.0.49 () {56 vars in 1180 bytes} [Wed May 18 16:51:03 2022] GET /identity/v3/groups/12c86d136c4f4ac59729e795a3884f86 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:04.038602 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8959c7-61fd-4a0a-b08e-95b6f47b793c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:04.152619 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8959c7-61fd-4a0a-b08e-95b6f47b793c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:04.192439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb7614-8d42-4102-b3a0-098a75a4917f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:04.193136 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb7614-8d42-4102-b3a0-098a75a4917f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:04.193419 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb7614-8d42-4102-b3a0-098a75a4917f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:04.193746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb7614-8d42-4102-b3a0-098a75a4917f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:04.194602 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb7614-8d42-4102-b3a0-098a75a4917f None admin] RBAC: Adding query filter params (group.id=12c86d136c4f4ac59729e795a3884f86, role.id=7a9281e8b95a43c58cf4d0c272dd1469, scope.project.id=451724484cdd482390defb722f90bb6c) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:04.194965 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb7614-8d42-4102-b3a0-098a75a4917f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:04.196416 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb7614-8d42-4102-b3a0-098a75a4917f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:04.202612 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 223/455] 10.222.0.49 () {56 vars in 1376 bytes} [Wed May 18 16:51:04 2022] GET /identity/v3/role_assignments?group.id=12c86d136c4f4ac59729e795a3884f86&scope.project.id=451724484cdd482390defb722f90bb6c&role.id=7a9281e8b95a43c58cf4d0c272dd1469 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:07.156558 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d73ec2-8511-43dd-b71a-041b136871a3 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:07.157574 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d73ec2-8511-43dd-b71a-041b136871a3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:07.158112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d73ec2-8511-43dd-b71a-041b136871a3 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:07.159694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 233/456] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:51:07.166737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed9aa3-4740-45d1-a0bc-49a5a6cc2507 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:07.167958 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed9aa3-4740-45d1-a0bc-49a5a6cc2507 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:07.168483 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed9aa3-4740-45d1-a0bc-49a5a6cc2507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:07.194775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-68ed9aa3-4740-45d1-a0bc-49a5a6cc2507 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:07.196370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-68ed9aa3-4740-45d1-a0bc-49a5a6cc2507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:07.235110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:07.298771 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fb668-250b-448b-840c-1e7a383967d0 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:07.299054 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fb668-250b-448b-840c-1e7a383967d0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:07.299497 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fb668-250b-448b-840c-1e7a383967d0 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:07.301381 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 234/457] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:07.303176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 224/458] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:51:07.308124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b65ead-41d9-4803-a83e-17be6c5df1d0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:07.308907 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b65ead-41d9-4803-a83e-17be6c5df1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:07.309575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b65ead-41d9-4803-a83e-17be6c5df1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:07.327753 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed9aa3-4740-45d1-a0bc-49a5a6cc2507 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:07.350787 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b5b65ead-41d9-4803-a83e-17be6c5df1d0 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:07.352130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b5b65ead-41d9-4803-a83e-17be6c5df1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:07.509147 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 235/459] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:07.519348 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed9aa3-4740-45d1-a0bc-49a5a6cc2507 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:07.551435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b65ead-41d9-4803-a83e-17be6c5df1d0 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:07.580791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bf670-fde2-4d90-a21e-c087da302145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:07.581519 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf670-fde2-4d90-a21e-c087da302145 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:07.581837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf670-fde2-4d90-a21e-c087da302145 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:07.582118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bf670-fde2-4d90-a21e-c087da302145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:07.598298 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bf670-fde2-4d90-a21e-c087da302145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:07.600574 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bf670-fde2-4d90-a21e-c087da302145 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:07.621453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1c4bf670-fde2-4d90-a21e-c087da302145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:07.621453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:07.621453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:07.621453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:07.621453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:07.621453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:07.621453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:07.621453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:07.621453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:07.621453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:07.621453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:07.621453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:07.621453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:07.621453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:07.621453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:07.622439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:07.622439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:07.622439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:07.622439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:07.622439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:07.622439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:07.622439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:07.622439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:07.622439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:07.622439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:07.622439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:07.622439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:07.622439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:07.622439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:07.622439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:07.622439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:07.622439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:07.623296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:07.623296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:07.623296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:07.623296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:07.625746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 225/460] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:07.631871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c133bc4-548e-4439-bf08-069aee8d898e None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:07.632665 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c133bc4-548e-4439-bf08-069aee8d898e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:07.633160 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c133bc4-548e-4439-bf08-069aee8d898e None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:07.634838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 226/461] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:07.635924 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c133bc4-548e-4439-bf08-069aee8d898e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:07.653879 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:07.692656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b65ead-41d9-4803-a83e-17be6c5df1d0 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:07.706107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:07.733391 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3872e47-d10d-4c3c-aa17-1400f37a6de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:07.734441 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3872e47-d10d-4c3c-aa17-1400f37a6de3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:07.734949 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3872e47-d10d-4c3c-aa17-1400f37a6de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:07.735457 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3872e47-d10d-4c3c-aa17-1400f37a6de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:07.747123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3872e47-d10d-4c3c-aa17-1400f37a6de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:07.749084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3872e47-d10d-4c3c-aa17-1400f37a6de3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:07.759439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c133bc4-548e-4439-bf08-069aee8d898e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:07.769813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-e3872e47-d10d-4c3c-aa17-1400f37a6de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:07.769813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:07.769813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:07.769813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:07.769813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:07.769813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:07.769813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:07.769813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:07.769813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:07.769813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:07.769813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:07.769813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:07.769813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:07.769813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:07.769813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:07.770767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:07.770767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:07.770767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:07.770767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:07.770767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:07.770767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:07.770767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:07.770767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:07.770767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:07.770767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:07.770767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:07.770767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:07.770767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:07.770767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:07.770767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:07.770767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:07.770767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:07.772629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:07.772629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:07.772629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:07.772629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:07.775219 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 236/462] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:07.776779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77e206-e651-442a-87d4-6fa83ad2270a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:07.777278 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77e206-e651-442a-87d4-6fa83ad2270a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:07.777828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77e206-e651-442a-87d4-6fa83ad2270a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:07.796328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-cf77e206-e651-442a-87d4-6fa83ad2270a None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:07.797936 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cf77e206-e651-442a-87d4-6fa83ad2270a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:07.798043 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc415435-1a1d-4e2e-b594-7b86fe1b08fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:07.798686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc415435-1a1d-4e2e-b594-7b86fe1b08fa None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:07.799082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc415435-1a1d-4e2e-b594-7b86fe1b08fa None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:07.799366 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc415435-1a1d-4e2e-b594-7b86fe1b08fa None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:07.800112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc415435-1a1d-4e2e-b594-7b86fe1b08fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:07.800418 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc415435-1a1d-4e2e-b594-7b86fe1b08fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:07.801972 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc415435-1a1d-4e2e-b594-7b86fe1b08fa None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:07.821109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 227/463] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:07.822205 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc415435-1a1d-4e2e-b594-7b86fe1b08fa None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:07.889770 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 237/464] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:07.891299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77e206-e651-442a-87d4-6fa83ad2270a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:07.923467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:07.957989 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc415435-1a1d-4e2e-b594-7b86fe1b08fa None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:08.009943 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e697908-4c60-4bad-ae5d-84b64bd6481e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:08.010780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e697908-4c60-4bad-ae5d-84b64bd6481e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:08.011074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e697908-4c60-4bad-ae5d-84b64bd6481e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:08.011357 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e697908-4c60-4bad-ae5d-84b64bd6481e None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:08.012128 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e697908-4c60-4bad-ae5d-84b64bd6481e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:08.012442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e697908-4c60-4bad-ae5d-84b64bd6481e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:08.014083 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e697908-4c60-4bad-ae5d-84b64bd6481e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:08.029771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 228/465] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:08.030572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e697908-4c60-4bad-ae5d-84b64bd6481e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:08.038867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:08.054232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77e206-e651-442a-87d4-6fa83ad2270a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:08.107693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b5f2b-9b20-4570-be2c-fe64c52d0932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:08.108653 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b5f2b-9b20-4570-be2c-fe64c52d0932 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:08.108938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b5f2b-9b20-4570-be2c-fe64c52d0932 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:08.109217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b5f2b-9b20-4570-be2c-fe64c52d0932 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:08.110691 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b5f2b-9b20-4570-be2c-fe64c52d0932 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:08.112335 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b5f2b-9b20-4570-be2c-fe64c52d0932 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:08.136226 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 238/466] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 18 16:51:07 2022] POST /identity/v3/users => generated 246 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:51:08.136990 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b5f2b-9b20-4570-be2c-fe64c52d0932 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:08.171549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e697908-4c60-4bad-ae5d-84b64bd6481e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:08.220404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:08.228117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f71f2-c3f3-434a-a9ef-d27f2b5290ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:08.230042 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f71f2-c3f3-434a-a9ef-d27f2b5290ab None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:08.230577 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f71f2-c3f3-434a-a9ef-d27f2b5290ab None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:08.231569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f71f2-c3f3-434a-a9ef-d27f2b5290ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:08.248533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f71f2-c3f3-434a-a9ef-d27f2b5290ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:08.251467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f71f2-c3f3-434a-a9ef-d27f2b5290ab None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:08.261195 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b5f2b-9b20-4570-be2c-fe64c52d0932 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:08.277837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-467f71f2-c3f3-434a-a9ef-d27f2b5290ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:08.277837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:08.277837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:08.277837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:08.277837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:08.277837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:08.277837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:08.277837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:08.277837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:08.277837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:08.277837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:08.277837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:08.277837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:08.277837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:08.277837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:08.278776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:08.278776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:08.278776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:08.278776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:08.278776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:08.278776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:08.278776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:08.278776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:08.278776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:08.278776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:08.278776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:08.278776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:08.278776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:08.278776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:08.278776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:08.278776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:08.278776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:08.279649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:08.279649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:08.279649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:08.279649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:08.282106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 229/467] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:08.283899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef3037-676e-46c6-b987-df2b43a59054 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:08.284409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef3037-676e-46c6-b987-df2b43a59054 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:08.284901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef3037-676e-46c6-b987-df2b43a59054 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:08.291759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 230/468] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:08.291759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef3037-676e-46c6-b987-df2b43a59054 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:08.312316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d4d08-7c3f-4fd7-9663-09035e52be6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:08.313007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d4d08-7c3f-4fd7-9663-09035e52be6b None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:08.313291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d4d08-7c3f-4fd7-9663-09035e52be6b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:08.313563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d4d08-7c3f-4fd7-9663-09035e52be6b None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:08.314319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d4d08-7c3f-4fd7-9663-09035e52be6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:08.315856 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d4d08-7c3f-4fd7-9663-09035e52be6b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:08.342307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 239/469] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 18 16:51:08 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:51:08.350090 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c32296-5f9a-481d-8d8b-5b6b9fa667a4 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:08.350090 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c32296-5f9a-481d-8d8b-5b6b9fa667a4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:08.350090 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c32296-5f9a-481d-8d8b-5b6b9fa667a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:08.352903 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:08.367478 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-19c32296-5f9a-481d-8d8b-5b6b9fa667a4 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:08.368744 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-19c32296-5f9a-481d-8d8b-5b6b9fa667a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:08.461449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef3037-676e-46c6-b987-df2b43a59054 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:08.468114 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 240/470] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:08.495733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c32296-5f9a-481d-8d8b-5b6b9fa667a4 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:08.502538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551a4dc-7dd0-4738-b995-0543dc4ef48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:08.503217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551a4dc-7dd0-4738-b995-0543dc4ef48b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:08.503500 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551a4dc-7dd0-4738-b995-0543dc4ef48b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:08.504213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551a4dc-7dd0-4738-b995-0543dc4ef48b None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:08.504675 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551a4dc-7dd0-4738-b995-0543dc4ef48b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:08.504981 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551a4dc-7dd0-4738-b995-0543dc4ef48b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:08.507227 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551a4dc-7dd0-4738-b995-0543dc4ef48b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:08.520335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 231/471] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:08.527390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551a4dc-7dd0-4738-b995-0543dc4ef48b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:08.589694 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:08.644805 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c32296-5f9a-481d-8d8b-5b6b9fa667a4 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:08.668974 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551a4dc-7dd0-4738-b995-0543dc4ef48b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:08.695380 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f8fa1-d269-4592-8082-b8b3d0110aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:08.696250 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f8fa1-d269-4592-8082-b8b3d0110aee None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:08.696537 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f8fa1-d269-4592-8082-b8b3d0110aee None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:08.696815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f8fa1-d269-4592-8082-b8b3d0110aee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:08.699665 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:08.714598 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f8fa1-d269-4592-8082-b8b3d0110aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:08.715492 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f8fa1-d269-4592-8082-b8b3d0110aee None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:08.720632 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299b39c-023b-4bcc-be59-5acde9ded4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:08.721678 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299b39c-023b-4bcc-be59-5acde9ded4da None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:08.722172 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299b39c-023b-4bcc-be59-5acde9ded4da None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:08.722741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299b39c-023b-4bcc-be59-5acde9ded4da None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:08.724340 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299b39c-023b-4bcc-be59-5acde9ded4da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:08.727266 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a299b39c-023b-4bcc-be59-5acde9ded4da None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:08.738252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-6c3f8fa1-d269-4592-8082-b8b3d0110aee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:08.738252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:08.738252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:08.738252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:08.738252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:08.738252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:08.738252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:08.738252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:08.738252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:08.738252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:08.738252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:08.738252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:08.738252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:08.738252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:08.738252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:08.739536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:08.739536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:08.739536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:08.739536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:08.739536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:08.739536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:08.739536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:08.739536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:08.739536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:08.739536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:08.739536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:08.739536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:08.739536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:08.739536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:08.739536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:08.739536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:08.739536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:08.742356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:08.742356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:08.742356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:08.742356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:08.742356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 241/472] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:08.747678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f8fa1-d269-4592-8082-b8b3d0110aee None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:08.759383 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 232/473] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 18 16:51:08 2022] POST /identity/v3/users => generated 248 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:51:08.773782 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba956a-7e3e-465e-b734-0e316b163067 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:08.774453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba956a-7e3e-465e-b734-0e316b163067 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:08.775219 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba956a-7e3e-465e-b734-0e316b163067 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:08.777921 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 233/474] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:51:08.784084 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05301af2-8c82-4ba9-8286-f4d68848f735 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:08.784425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05301af2-8c82-4ba9-8286-f4d68848f735 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:08.784634 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05301af2-8c82-4ba9-8286-f4d68848f735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:08.805843 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-05301af2-8c82-4ba9-8286-f4d68848f735 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:08.807085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-05301af2-8c82-4ba9-8286-f4d68848f735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:08.890792 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f8fa1-d269-4592-8082-b8b3d0110aee None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:08.906043 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 234/475] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:08.940077 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c73e94-6058-4708-88fa-06dbd3c7f795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:08.940572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05301af2-8c82-4ba9-8286-f4d68848f735 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:08.941400 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c73e94-6058-4708-88fa-06dbd3c7f795 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:08.941944 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c73e94-6058-4708-88fa-06dbd3c7f795 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:08.942427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c73e94-6058-4708-88fa-06dbd3c7f795 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:08.944148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c73e94-6058-4708-88fa-06dbd3c7f795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:08.944684 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c73e94-6058-4708-88fa-06dbd3c7f795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:08.946491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c73e94-6058-4708-88fa-06dbd3c7f795 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:08.970052 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 242/476] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:08.976992 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c73e94-6058-4708-88fa-06dbd3c7f795 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:08.983277 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:09.044196 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:09.076314 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05301af2-8c82-4ba9-8286-f4d68848f735 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:09.110807 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c73e94-6058-4708-88fa-06dbd3c7f795 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:09.114271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d9325-23b1-447b-ac9f-e9b1f030c869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:09.115696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d9325-23b1-447b-ac9f-e9b1f030c869 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:09.116040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d9325-23b1-447b-ac9f-e9b1f030c869 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:09.116382 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d9325-23b1-447b-ac9f-e9b1f030c869 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:09.117200 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d9325-23b1-447b-ac9f-e9b1f030c869 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:09.118685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d9325-23b1-447b-ac9f-e9b1f030c869 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:09.125636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.sql.core [None req-0c3d9325-23b1-447b-ac9f-e9b1f030c869 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 18 16:51:09.125636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 18 16:51:09.125636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [parameters: {'id': '44b9e40cb88d49dcb1ad628389522598', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 18 16:51:09.125636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80344) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 18 16:51:09.148578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-0c3d9325-23b1-447b-ac9f-e9b1f030c869 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 18 16:51:09.148578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:09.148578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 16:51:09.148578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 16:51:09.148578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 16:51:09.148578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 16:51:09.148578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 16:51:09.148578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application result = self._query(query) May 18 16:51:09.148578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 16:51:09.148578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application conn.query(q) May 18 16:51:09.148578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 16:51:09.148578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 16:51:09.148578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 16:51:09.148578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application result.read() May 18 16:51:09.148578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 16:51:09.149496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 16:51:09.149496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 16:51:09.149496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 16:51:09.149496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 16:51:09.149496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 16:51:09.149496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 16:51:09.149496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 16:51:09.149496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 18 16:51:09.149496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:09.149496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 18 16:51:09.149496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:09.149496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:09.149496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 18 16:51:09.149496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 18 16:51:09.149496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 18 16:51:09.149496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return ref.to_dict() May 18 16:51:09.149496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 16:51:09.149496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application next(self.gen) May 18 16:51:09.150458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 18 16:51:09.150458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application yield resource May 18 16:51:09.150458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 16:51:09.150458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application next(self.gen) May 18 16:51:09.150458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 18 16:51:09.150458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.session.rollback() May 18 16:51:09.150458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 18 16:51:09.150458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.force_reraise() May 18 16:51:09.150458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 18 16:51:09.150458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise self.value May 18 16:51:09.150458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 18 16:51:09.150458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 18 16:51:09.150458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 18 16:51:09.150458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application session.commit() May 18 16:51:09.150458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 18 16:51:09.150458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 18 16:51:09.150458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 18 16:51:09.151310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._prepare_impl() May 18 16:51:09.151310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 18 16:51:09.151310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.session.flush() May 18 16:51:09.151310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 18 16:51:09.151310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._flush(objects) May 18 16:51:09.151310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 18 16:51:09.151310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 18 16:51:09.151310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 18 16:51:09.151310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application compat.raise_( May 18 16:51:09.151310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 16:51:09.151310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception May 18 16:51:09.151310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 18 16:51:09.151310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application flush_context.execute() May 18 16:51:09.151310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 18 16:51:09.151310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rec.execute(self) May 18 16:51:09.151310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 18 16:51:09.151310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 18 16:51:09.154108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 18 16:51:09.154108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application _emit_insert_statements( May 18 16:51:09.154108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 18 16:51:09.154108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application c = connection._execute_20( May 18 16:51:09.154108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 18 16:51:09.154108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 18 16:51:09.154108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 18 16:51:09.154108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 18 16:51:09.154108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 18 16:51:09.154108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ret = self._execute_context( May 18 16:51:09.154108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 18 16:51:09.154108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 18 16:51:09.154108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 18 16:51:09.154108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 18 16:51:09.154108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 16:51:09.154108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception May 18 16:51:09.156100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 16:51:09.156100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 16:51:09.156100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 16:51:09.156100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 16:51:09.156100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 16:51:09.156100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application result = self._query(query) May 18 16:51:09.156100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 16:51:09.156100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application conn.query(q) May 18 16:51:09.156100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 16:51:09.156100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 16:51:09.156100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 16:51:09.156100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application result.read() May 18 16:51:09.156100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 16:51:09.156100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 16:51:09.156100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 16:51:09.156100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 16:51:09.165154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 16:51:09.165154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 16:51:09.165154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 16:51:09.165154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 16:51:09.165154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 18 16:51:09.165154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 18 16:51:09.165154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [parameters: {'id': '44b9e40cb88d49dcb1ad628389522598', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 18 16:51:09.165154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 18 16:51:09.165154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:09.165154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:51:09.165154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:09.165154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:09.165154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:09.165154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:09.165154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:09.165154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:09.166112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:09.166112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:09.166112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:09.166112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:09.166112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:09.166112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:09.166112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 18 16:51:09.166112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 18 16:51:09.166112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:09.166112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:09.166112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 18 16:51:09.166112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 18 16:51:09.166112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 18 16:51:09.166112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 18 16:51:09.166112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 18 16:51:09.166112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:09.166917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953962d-9936-47f6-a920-fbc6129fd439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:09.167006 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 235/477] 10.222.0.49 () {60 vars in 1131 bytes} [Wed May 18 16:51:08 2022] POST /identity/v3/roles => generated 144 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:09.167074 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953962d-9936-47f6-a920-fbc6129fd439 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:09.167074 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953962d-9936-47f6-a920-fbc6129fd439 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:09.167074 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953962d-9936-47f6-a920-fbc6129fd439 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:09.167074 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953962d-9936-47f6-a920-fbc6129fd439 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:09.167314 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d9325-23b1-447b-ac9f-e9b1f030c869 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:09.167380 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953962d-9936-47f6-a920-fbc6129fd439 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:09.196081 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 243/478] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 18 16:51:08 2022] POST /identity/v3/users => generated 249 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:51:09.278507 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:09.286385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d9325-23b1-447b-ac9f-e9b1f030c869 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:09.327218 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cacae3-1de9-46fc-a30e-266813d4963c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:09.328049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cacae3-1de9-46fc-a30e-266813d4963c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:09.328427 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cacae3-1de9-46fc-a30e-266813d4963c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:09.328728 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cacae3-1de9-46fc-a30e-266813d4963c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:09.342850 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cacae3-1de9-46fc-a30e-266813d4963c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:09.351766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-62cacae3-1de9-46fc-a30e-266813d4963c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:51:09.351766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:09.351766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:09.351766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:09.351766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:09.351766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:09.351766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:09.351766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:09.351766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:09.351766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:09.351766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:09.351766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:09.351766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:09.351766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:09.351766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:09.351766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:09.352755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:09.352755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:09.352755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:09.352755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:09.352755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:09.352755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:09.352755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:09.352755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:09.352755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:09.352755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:09.352755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:09.352755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:09.352755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:09.352755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:09.352755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:09.352755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:09.353569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:09.353569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:09.353569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:09.353569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:09.353569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:09.353569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:09.353569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:09.353569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:09.353569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:09.353569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:09.353569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 18 16:51:09.353569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:09.357769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 236/479] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:51:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:09.359527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953962d-9936-47f6-a920-fbc6129fd439 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:09.492423 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953962d-9936-47f6-a920-fbc6129fd439 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:09.494124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:09.532352 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c23d3-033e-419a-8b9a-4b3a168ca348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:09.532961 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c23d3-033e-419a-8b9a-4b3a168ca348 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:09.533247 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c23d3-033e-419a-8b9a-4b3a168ca348 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:09.533527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c23d3-033e-419a-8b9a-4b3a168ca348 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:09.534323 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c23d3-033e-419a-8b9a-4b3a168ca348 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:09.534638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c23d3-033e-419a-8b9a-4b3a168ca348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:09.536039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c23d3-033e-419a-8b9a-4b3a168ca348 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:09.547254 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 244/480] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:11.068927 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd10c79-77d5-4112-886d-dd5e1e423a83 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:11.069313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd10c79-77d5-4112-886d-dd5e1e423a83 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:11.069572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd10c79-77d5-4112-886d-dd5e1e423a83 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:11.072089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 237/481] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:11.078271 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9844f64-4aa0-4463-af2b-faec5618bda9 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:11.078271 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9844f64-4aa0-4463-af2b-faec5618bda9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:11.078271 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9844f64-4aa0-4463-af2b-faec5618bda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:11.105769 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d9844f64-4aa0-4463-af2b-faec5618bda9 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:11.107726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d9844f64-4aa0-4463-af2b-faec5618bda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:11.202809 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 245/482] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:11.238278 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd10c79-77d5-4112-886d-dd5e1e423a83 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:11.337913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8840116-669b-4502-939a-5d109ef4ed48 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:11.338209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8840116-669b-4502-939a-5d109ef4ed48 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:11.338388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8840116-669b-4502-939a-5d109ef4ed48 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:11.340361 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 246/483] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:51:11.346892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cbea1-ac48-4e9f-a4a2-788e97dd1907 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:11.347179 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cbea1-ac48-4e9f-a4a2-788e97dd1907 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:11.347456 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cbea1-ac48-4e9f-a4a2-788e97dd1907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:11.367310 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f92cbea1-ac48-4e9f-a4a2-788e97dd1907 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:11.369031 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f92cbea1-ac48-4e9f-a4a2-788e97dd1907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:11.407331 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd10c79-77d5-4112-886d-dd5e1e423a83 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:11.473514 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 247/484] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:51:11.479121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a6659-c400-4c7a-b1e5-d1fdbce46622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:11.480006 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a6659-c400-4c7a-b1e5-d1fdbce46622 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:11.480296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a6659-c400-4c7a-b1e5-d1fdbce46622 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:11.480568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a6659-c400-4c7a-b1e5-d1fdbce46622 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:11.496985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a6659-c400-4c7a-b1e5-d1fdbce46622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:11.504825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-254a6659-c400-4c7a-b1e5-d1fdbce46622 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:11.504825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:11.504825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:11.504825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:11.504825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:11.504825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:11.504825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:11.504825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:11.504825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:11.504825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:11.504825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:11.504825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:11.504825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:11.504825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:11.504825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:11.504825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:11.506567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:11.506567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:11.506567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:11.506567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:11.506567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:11.506567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:11.506567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:11.506567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:11.506567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:11.506567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:11.506567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:11.506567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:11.506567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:11.506567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:11.506567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:11.506567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:11.507370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:11.507370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:11.507370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:11.507370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:11.507370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:11.507370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:11.507370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:11.507370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:11.507370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:11.507370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:11.507370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:11.507370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:11.507370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 238/485] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:11.514833 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cbea1-ac48-4e9f-a4a2-788e97dd1907 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:11.529315 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a6659-c400-4c7a-b1e5-d1fdbce46622 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:11.562020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:11.563759 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:11.701230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cbea1-ac48-4e9f-a4a2-788e97dd1907 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:11.741386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3da3f4-f75e-4052-93ad-5fbaa97a2b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:11.742221 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a6659-c400-4c7a-b1e5-d1fdbce46622 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:11.742697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3da3f4-f75e-4052-93ad-5fbaa97a2b38 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:11.743191 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3da3f4-f75e-4052-93ad-5fbaa97a2b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:11.743658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3da3f4-f75e-4052-93ad-5fbaa97a2b38 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:11.744603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3da3f4-f75e-4052-93ad-5fbaa97a2b38 None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:11.745101 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3da3f4-f75e-4052-93ad-5fbaa97a2b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:11.747605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3da3f4-f75e-4052-93ad-5fbaa97a2b38 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:11.762280 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 248/486] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:51:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:11.772003 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3da3f4-f75e-4052-93ad-5fbaa97a2b38 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:11.799981 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52919689-94e9-4dfe-9b65-e52d924cf5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:11.800804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52919689-94e9-4dfe-9b65-e52d924cf5db None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:11.801091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52919689-94e9-4dfe-9b65-e52d924cf5db None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:11.801365 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52919689-94e9-4dfe-9b65-e52d924cf5db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:11.828532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52919689-94e9-4dfe-9b65-e52d924cf5db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:11.846551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-52919689-94e9-4dfe-9b65-e52d924cf5db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:11.846551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:11.846551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:11.846551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:11.846551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:11.846551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:11.846551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:11.846551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:11.846551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:11.846551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:11.846551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:11.846551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:11.846551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:11.846551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:11.846551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:11.846551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:11.847529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:11.847529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:11.847529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:11.847529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:11.847529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:11.847529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:11.847529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:11.847529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:11.847529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:11.847529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:11.847529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:11.847529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:11.847529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:11.847529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:11.847529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:11.847529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:11.848320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:11.848320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:11.848320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:11.848320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:11.848320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:11.848320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:11.848320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:11.848320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:11.848320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:11.848320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:11.848320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:11.848320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:11.848940 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 239/487] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:11.856715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52919689-94e9-4dfe-9b65-e52d924cf5db None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:11.957284 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:11.989376 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3da3f4-f75e-4052-93ad-5fbaa97a2b38 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:12.013694 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:12.040420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35324024-f0db-433d-bd12-6c4bef48f9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:12.041604 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35324024-f0db-433d-bd12-6c4bef48f9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:12.042149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35324024-f0db-433d-bd12-6c4bef48f9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:12.042639 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35324024-f0db-433d-bd12-6c4bef48f9e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:12.047549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52919689-94e9-4dfe-9b65-e52d924cf5db None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:12.054956 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35324024-f0db-433d-bd12-6c4bef48f9e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:12.056653 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35324024-f0db-433d-bd12-6c4bef48f9e0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:12.083281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-35324024-f0db-433d-bd12-6c4bef48f9e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:12.083281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:12.083281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:12.083281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:12.083281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:12.083281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:12.083281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:12.083281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:12.083281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:12.083281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:12.083281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:12.083281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:12.083281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:12.083281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:12.083281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:12.085293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:12.085293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:12.085293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:12.085293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:12.085293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:12.085293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:12.085293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:12.085293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:12.085293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:12.085293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:12.085293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:12.085293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:12.085293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:12.085293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:12.085293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:12.085293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:12.085293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:12.086188 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:12.086188 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:12.086188 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:12.086188 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:12.086188 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 249/488] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:12.086986 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369ba44-0c76-48a9-b940-3a30f27d5798 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:12.087276 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369ba44-0c76-48a9-b940-3a30f27d5798 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:12.087556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369ba44-0c76-48a9-b940-3a30f27d5798 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:12.089146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 250/489] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:12.090587 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369ba44-0c76-48a9-b940-3a30f27d5798 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:12.108878 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d7e72-7e73-4259-8354-f30f0cce432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:12.109579 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d7e72-7e73-4259-8354-f30f0cce432e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:12.109878 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d7e72-7e73-4259-8354-f30f0cce432e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:12.110153 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d7e72-7e73-4259-8354-f30f0cce432e None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:12.111008 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d7e72-7e73-4259-8354-f30f0cce432e None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:12.111315 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d7e72-7e73-4259-8354-f30f0cce432e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:12.112860 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d7e72-7e73-4259-8354-f30f0cce432e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:12.127761 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 240/490] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:51:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:12.127761 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7c0cd-3897-4f22-aaa5-968a438dbf15 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:12.127761 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7c0cd-3897-4f22-aaa5-968a438dbf15 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:12.127761 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7c0cd-3897-4f22-aaa5-968a438dbf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:12.143207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b9c7c0cd-3897-4f22-aaa5-968a438dbf15 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:12.144413 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b9c7c0cd-3897-4f22-aaa5-968a438dbf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:12.227242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369ba44-0c76-48a9-b940-3a30f27d5798 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:12.233428 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 241/491] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:12.234442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7c0cd-3897-4f22-aaa5-968a438dbf15 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:12.265076 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13360d-4315-4ebf-813d-15aadbe8ca68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:12.266126 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13360d-4315-4ebf-813d-15aadbe8ca68 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:12.266690 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13360d-4315-4ebf-813d-15aadbe8ca68 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:12.267166 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13360d-4315-4ebf-813d-15aadbe8ca68 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:12.268169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13360d-4315-4ebf-813d-15aadbe8ca68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:12.268686 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13360d-4315-4ebf-813d-15aadbe8ca68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:12.270492 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13360d-4315-4ebf-813d-15aadbe8ca68 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:12.280658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:12.287841 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 251/492] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:12.289120 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13360d-4315-4ebf-813d-15aadbe8ca68 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:12.328781 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:12.372268 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7c0cd-3897-4f22-aaa5-968a438dbf15 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:12.409775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0a442-a734-4a05-8c5a-65abdd99b799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:12.410574 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0a442-a734-4a05-8c5a-65abdd99b799 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:12.410847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13360d-4315-4ebf-813d-15aadbe8ca68 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:12.410977 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0a442-a734-4a05-8c5a-65abdd99b799 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:12.411131 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0a442-a734-4a05-8c5a-65abdd99b799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:12.424617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0a442-a734-4a05-8c5a-65abdd99b799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:12.426143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0a442-a734-4a05-8c5a-65abdd99b799 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:12.445124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-2da0a442-a734-4a05-8c5a-65abdd99b799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:12.445124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:12.445124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:12.445124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:12.445124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:12.445124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:12.445124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:12.445124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:12.445124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:12.445124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:12.445124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:12.445124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:12.445124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:12.445124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:12.445124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:12.446333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:12.446333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:12.446333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:12.446333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:12.446333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:12.446333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:12.446333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:12.446333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:12.446333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:12.446333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:12.446333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:12.446333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:12.446333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:12.446333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:12.446333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:12.446333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:12.446333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:12.447743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:12.447743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:12.447743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:12.447743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:12.447743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 242/493] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:12.447743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0a442-a734-4a05-8c5a-65abdd99b799 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:12.453736 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f88b2f-b372-4e6b-86c1-971c974d2d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:12.454546 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f88b2f-b372-4e6b-86c1-971c974d2d3c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:12.454826 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f88b2f-b372-4e6b-86c1-971c974d2d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:12.455353 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f88b2f-b372-4e6b-86c1-971c974d2d3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:12.466584 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f88b2f-b372-4e6b-86c1-971c974d2d3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:12.474978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-e0f88b2f-b372-4e6b-86c1-971c974d2d3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:12.474978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:12.474978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:12.474978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:12.474978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:12.474978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:12.474978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:12.474978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:12.474978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:12.474978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:12.474978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:12.474978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:12.474978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:12.474978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:12.474978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:12.474978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:12.476057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:12.476057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:12.476057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:12.476057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:12.476057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:12.476057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:12.476057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:12.476057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:12.476057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:12.476057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:12.476057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:12.476057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:12.476057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:12.476057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:12.476057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:12.476057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:12.476957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:12.476957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:12.476957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:12.476957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:12.476957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:12.476957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:12.476957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:12.476957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:12.476957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:12.476957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:12.476957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:12.476957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:12.476957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 252/494] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:12.478514 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869e435-d64d-48bc-ae40-a96b7fe22439 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:12.478514 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869e435-d64d-48bc-ae40-a96b7fe22439 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:12.478514 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869e435-d64d-48bc-ae40-a96b7fe22439 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:12.479410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 253/495] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:12.480159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869e435-d64d-48bc-ae40-a96b7fe22439 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:12.553546 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:12.562739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0a442-a734-4a05-8c5a-65abdd99b799 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:12.580774 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:12.598371 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53f85b-e5dd-44c0-a361-8692cebfb3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:12.599237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53f85b-e5dd-44c0-a361-8692cebfb3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:12.599530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53f85b-e5dd-44c0-a361-8692cebfb3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:12.599802 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53f85b-e5dd-44c0-a361-8692cebfb3b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:12.600684 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869e435-d64d-48bc-ae40-a96b7fe22439 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:12.607006 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53f85b-e5dd-44c0-a361-8692cebfb3b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:12.608451 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53f85b-e5dd-44c0-a361-8692cebfb3b3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:12.623987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-9f53f85b-e5dd-44c0-a361-8692cebfb3b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 16:51:12.623987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:12.623987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:12.623987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:12.623987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:12.623987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:12.623987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:12.623987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:12.623987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:12.623987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:12.623987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:12.623987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:12.623987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:12.623987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:12.623987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:12.623987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:12.624925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:12.624925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:12.624925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:12.624925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:12.624925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:12.624925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:12.624925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:12.624925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:12.624925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:12.624925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:12.624925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:12.624925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:12.624925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:12.624925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:12.624925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:12.624925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:12.624925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:12.624925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:12.625867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:12.625867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:12.625867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:12.625867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:12.625867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:12.625867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:12.625867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:12.625867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:12.625867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 16:51:12.625867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:12.625867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 243/496] 10.222.0.49 () {56 vars in 1093 bytes} [Wed May 18 16:51:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:12.626453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53f85b-e5dd-44c0-a361-8692cebfb3b3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:12.640801 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c75b0-3947-4a81-807d-bab53d779020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:12.641472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c75b0-3947-4a81-807d-bab53d779020 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:12.641777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c75b0-3947-4a81-807d-bab53d779020 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:12.642056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c75b0-3947-4a81-807d-bab53d779020 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:12.642793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c75b0-3947-4a81-807d-bab53d779020 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:12.643087 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c75b0-3947-4a81-807d-bab53d779020 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:12.644457 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c75b0-3947-4a81-807d-bab53d779020 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:12.657380 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 254/497] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:12.658656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0f101-70a4-45e6-97ba-5ebe28daa7fd None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:12.658941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0f101-70a4-45e6-97ba-5ebe28daa7fd None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:12.659223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0f101-70a4-45e6-97ba-5ebe28daa7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:12.674999 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4fa0f101-70a4-45e6-97ba-5ebe28daa7fd None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:12.676198 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4fa0f101-70a4-45e6-97ba-5ebe28daa7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:12.730184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53f85b-e5dd-44c0-a361-8692cebfb3b3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:12.744023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 255/498] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:12.745679 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b7a44-6f86-4f19-bb51-22984ea05309 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:12.745986 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b7a44-6f86-4f19-bb51-22984ea05309 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:12.746269 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b7a44-6f86-4f19-bb51-22984ea05309 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:12.747551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 256/499] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:12.748369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b7a44-6f86-4f19-bb51-22984ea05309 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:12.769449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731753f-e89e-4550-9a8d-1f4df33e7796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:12.770158 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731753f-e89e-4550-9a8d-1f4df33e7796 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:12.770452 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731753f-e89e-4550-9a8d-1f4df33e7796 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:12.770724 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731753f-e89e-4550-9a8d-1f4df33e7796 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:12.772425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731753f-e89e-4550-9a8d-1f4df33e7796 None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:12.772987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731753f-e89e-4550-9a8d-1f4df33e7796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:12.774514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731753f-e89e-4550-9a8d-1f4df33e7796 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:12.783190 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 244/500] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:51:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:12.784083 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731753f-e89e-4550-9a8d-1f4df33e7796 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:12.810122 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:12.837869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:12.870563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b7a44-6f86-4f19-bb51-22984ea05309 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:12.906366 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731753f-e89e-4550-9a8d-1f4df33e7796 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:12.908715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a984bf3-71d0-4b5c-8722-af039dfecbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:12.909404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a984bf3-71d0-4b5c-8722-af039dfecbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:12.909738 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a984bf3-71d0-4b5c-8722-af039dfecbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:12.909999 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a984bf3-71d0-4b5c-8722-af039dfecbe4 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:12.910838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a984bf3-71d0-4b5c-8722-af039dfecbe4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:12.911150 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a984bf3-71d0-4b5c-8722-af039dfecbe4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:12.913379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a984bf3-71d0-4b5c-8722-af039dfecbe4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:12.942618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100e03b-6d50-48e8-9c10-ae5fb430983e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:12.943964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100e03b-6d50-48e8-9c10-ae5fb430983e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:12.944241 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100e03b-6d50-48e8-9c10-ae5fb430983e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:12.944511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100e03b-6d50-48e8-9c10-ae5fb430983e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:12.952394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100e03b-6d50-48e8-9c10-ae5fb430983e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:12.953450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 257/501] 10.222.0.49 () {56 vars in 1133 bytes} [Wed May 18 16:51:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:12.953890 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100e03b-6d50-48e8-9c10-ae5fb430983e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:12.954984 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852d9e4-9bf8-4ff6-a5da-9c360583abcb None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:12.955533 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852d9e4-9bf8-4ff6-a5da-9c360583abcb None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:12.955934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852d9e4-9bf8-4ff6-a5da-9c360583abcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:12.969189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-f100e03b-6d50-48e8-9c10-ae5fb430983e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 18 16:51:12.969189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:12.969189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:12.969189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:12.969189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:12.969189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:12.969189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:12.969189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:12.969189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:12.969189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:12.969189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:12.969189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:12.969189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:12.969189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:12.969189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:12.969189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:12.970201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:12.970201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:12.970201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:12.970201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:12.970201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:12.970201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:12.970201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:12.970201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:12.970201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:12.970201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:12.970201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:12.970201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:12.970201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:12.970201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:12.970201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:12.970201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:12.970201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:12.970201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:12.971092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:12.971092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:12.971092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:12.971092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:12.971092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:12.971092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:12.971092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:12.971092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:12.971092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 18 16:51:12.971092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:12.971092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 245/502] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:51:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:12.971750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100e03b-6d50-48e8-9c10-ae5fb430983e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:12.974250 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-8852d9e4-9bf8-4ff6-a5da-9c360583abcb None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:12.975634 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8852d9e4-9bf8-4ff6-a5da-9c360583abcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:13.047164 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 258/503] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:13.047929 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852d9e4-9bf8-4ff6-a5da-9c360583abcb None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:13.081334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:13.085352 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100e03b-6d50-48e8-9c10-ae5fb430983e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:13.091089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:13.121409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d5350-b431-4719-9f36-964ca6ac208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:13.122230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d5350-b431-4719-9f36-964ca6ac208a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:13.122517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d5350-b431-4719-9f36-964ca6ac208a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:13.122794 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d5350-b431-4719-9f36-964ca6ac208a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:13.134007 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d5350-b431-4719-9f36-964ca6ac208a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:13.141757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-0e2d5350-b431-4719-9f36-964ca6ac208a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:13.141757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:13.141757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:13.141757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:13.141757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:13.141757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:13.141757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:13.141757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:13.141757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:13.141757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:13.141757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:13.141757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:13.141757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:13.141757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:13.141757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:13.141757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:13.142776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:13.142776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:13.142776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:13.142776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:13.142776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:13.142776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:13.142776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:13.142776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:13.142776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:13.142776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:13.142776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:13.142776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:13.142776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:13.142776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:13.142776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:13.142776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:13.143569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:13.143569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:13.143569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:13.143569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:13.143569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:13.143569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:13.143569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:13.143569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:13.143569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:13.143569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:13.143569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:13.143569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:13.143569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 246/504] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:13.144252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d5350-b431-4719-9f36-964ca6ac208a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:13.162790 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852d9e4-9bf8-4ff6-a5da-9c360583abcb None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:13.197901 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f7d0a-da5f-4b85-ad7b-d5c27668acc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:13.198698 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f7d0a-da5f-4b85-ad7b-d5c27668acc9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:13.198985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f7d0a-da5f-4b85-ad7b-d5c27668acc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:13.199257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f7d0a-da5f-4b85-ad7b-d5c27668acc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:13.210465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f7d0a-da5f-4b85-ad7b-d5c27668acc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:13.211957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f7d0a-da5f-4b85-ad7b-d5c27668acc9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:13.231721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-987f7d0a-da5f-4b85-ad7b-d5c27668acc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:13.231721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:13.231721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:13.231721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:13.231721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:13.231721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:13.231721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:13.231721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:13.231721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:13.231721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:13.231721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:13.231721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:13.231721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:13.231721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:13.231721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:13.233084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:13.233084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:13.233084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:13.233084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:13.233084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:13.233084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:13.233084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:13.233084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:13.233084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:13.233084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:13.233084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:13.233084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:13.233084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:13.233084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:13.233084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:13.233084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:13.233084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:13.234384 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:13.234384 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:13.234384 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:13.234384 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:13.234384 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 259/505] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:13.234384 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f7d0a-da5f-4b85-ad7b-d5c27668acc9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:13.254148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d5350-b431-4719-9f36-964ca6ac208a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:13.288937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845e1eb-11e6-42eb-9aa7-5e7d0519be40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:13.289586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845e1eb-11e6-42eb-9aa7-5e7d0519be40 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:13.289922 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845e1eb-11e6-42eb-9aa7-5e7d0519be40 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:13.290204 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845e1eb-11e6-42eb-9aa7-5e7d0519be40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:13.317558 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:13.321616 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:13.335221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f7d0a-da5f-4b85-ad7b-d5c27668acc9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:13.360610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845e1eb-11e6-42eb-9aa7-5e7d0519be40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:13.362136 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845e1eb-11e6-42eb-9aa7-5e7d0519be40 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:13.369954 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad01d5-664a-46f7-b4de-a7318709f5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:13.370628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad01d5-664a-46f7-b4de-a7318709f5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:13.370909 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad01d5-664a-46f7-b4de-a7318709f5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:13.371183 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad01d5-664a-46f7-b4de-a7318709f5e0 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:13.372020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad01d5-664a-46f7-b4de-a7318709f5e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:13.372330 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad01d5-664a-46f7-b4de-a7318709f5e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:13.373797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad01d5-664a-46f7-b4de-a7318709f5e0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:13.391716 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 260/506] 10.222.0.49 () {56 vars in 1137 bytes} [Wed May 18 16:51:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:13.392622 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad01d5-664a-46f7-b4de-a7318709f5e0 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:13.469088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 247/507] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:51:13.470066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845e1eb-11e6-42eb-9aa7-5e7d0519be40 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:13.499019 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad01d5-664a-46f7-b4de-a7318709f5e0 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:13.532114 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:13.535453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6dc1a-8851-4400-a0fa-ff161b3d454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:13.536322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6dc1a-8851-4400-a0fa-ff161b3d454b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:13.536567 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6dc1a-8851-4400-a0fa-ff161b3d454b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:13.536867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6dc1a-8851-4400-a0fa-ff161b3d454b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:13.547568 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6dc1a-8851-4400-a0fa-ff161b3d454b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:13.549141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6dc1a-8851-4400-a0fa-ff161b3d454b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:13.556490 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:13.569342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-25b6dc1a-8851-4400-a0fa-ff161b3d454b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:13.569342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:13.569342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:13.569342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:13.569342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:13.569342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:13.569342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:13.569342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:13.569342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:13.569342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:13.569342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:13.569342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:13.569342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:13.569342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:13.569342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:13.570431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:13.570431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:13.570431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:13.570431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:13.570431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:13.570431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:13.570431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:13.570431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:13.570431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:13.570431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:13.570431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:13.570431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:13.570431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:13.570431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:13.570431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:13.570431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:13.570431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:13.571338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:13.571338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:13.571338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:13.571338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:13.571338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 261/508] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:13.571338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6dc1a-8851-4400-a0fa-ff161b3d454b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:13.577467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845e1eb-11e6-42eb-9aa7-5e7d0519be40 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:13.612815 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580e91c-b1bd-4163-aa2d-abc402d36a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:13.613481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580e91c-b1bd-4163-aa2d-abc402d36a5d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:13.613804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580e91c-b1bd-4163-aa2d-abc402d36a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:13.614081 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580e91c-b1bd-4163-aa2d-abc402d36a5d None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:13.614864 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580e91c-b1bd-4163-aa2d-abc402d36a5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:13.615174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580e91c-b1bd-4163-aa2d-abc402d36a5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:13.616542 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580e91c-b1bd-4163-aa2d-abc402d36a5d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:13.624585 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 248/509] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:51:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:13.625521 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580e91c-b1bd-4163-aa2d-abc402d36a5d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:13.673086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6dc1a-8851-4400-a0fa-ff161b3d454b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:13.709629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc4618-c5d8-4883-87c2-a5169b507fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:13.710325 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc4618-c5d8-4883-87c2-a5169b507fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:13.710607 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc4618-c5d8-4883-87c2-a5169b507fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:13.710880 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc4618-c5d8-4883-87c2-a5169b507fa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:13.711606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc4618-c5d8-4883-87c2-a5169b507fa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:13.711913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc4618-c5d8-4883-87c2-a5169b507fa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:13.713311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc4618-c5d8-4883-87c2-a5169b507fa2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:13.724969 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 262/510] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:13.726029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc4618-c5d8-4883-87c2-a5169b507fa2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:13.729161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580e91c-b1bd-4163-aa2d-abc402d36a5d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:13.753920 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:13.766513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7c524-32da-402c-9adb-3a538331cca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:13.767156 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7c524-32da-402c-9adb-3a538331cca2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:13.767465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7c524-32da-402c-9adb-3a538331cca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:13.767707 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7c524-32da-402c-9adb-3a538331cca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:13.785571 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:13.828747 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc4618-c5d8-4883-87c2-a5169b507fa2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:13.836535 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7c524-32da-402c-9adb-3a538331cca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:13.838021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7c524-32da-402c-9adb-3a538331cca2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:13.862978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006b7cb-69ab-4a69-bb4c-ac69c54c2512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:13.863772 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006b7cb-69ab-4a69-bb4c-ac69c54c2512 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:13.864055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006b7cb-69ab-4a69-bb4c-ac69c54c2512 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:13.864333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006b7cb-69ab-4a69-bb4c-ac69c54c2512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:13.876076 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006b7cb-69ab-4a69-bb4c-ac69c54c2512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:13.877539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006b7cb-69ab-4a69-bb4c-ac69c54c2512 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:13.896411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-2006b7cb-69ab-4a69-bb4c-ac69c54c2512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:13.896411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:13.896411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:13.896411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:13.896411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:13.896411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:13.896411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:13.896411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:13.896411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:13.896411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:13.896411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:13.896411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:13.896411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:13.896411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:13.896411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:13.898167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:13.898167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:13.898167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:13.898167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:13.898167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:13.898167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:13.898167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:13.898167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:13.898167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:13.898167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:13.898167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:13.898167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:13.898167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:13.898167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:13.898167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:13.898167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:13.898167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:13.899908 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:13.899908 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:13.899908 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:13.899908 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:13.899908 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 263/511] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:13.899908 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006b7cb-69ab-4a69-bb4c-ac69c54c2512 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:13.949550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 249/512] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:51:13.950511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7c524-32da-402c-9adb-3a538331cca2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:13.975844 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:14.006422 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006b7cb-69ab-4a69-bb4c-ac69c54c2512 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:14.016908 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:14.041862 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fa410-928f-4146-8a78-491edf8edcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:14.042539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fa410-928f-4146-8a78-491edf8edcc1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:14.042819 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fa410-928f-4146-8a78-491edf8edcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:14.043102 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fa410-928f-4146-8a78-491edf8edcc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:14.043825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6fa410-928f-4146-8a78-491edf8edcc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:14.044138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6fa410-928f-4146-8a78-491edf8edcc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:14.045514 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6fa410-928f-4146-8a78-491edf8edcc1 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:14.055519 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7c524-32da-402c-9adb-3a538331cca2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:14.059942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 264/513] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:14.060884 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fa410-928f-4146-8a78-491edf8edcc1 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:14.101570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2c5f7-19a5-448b-8a53-994167976040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:14.102660 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2c5f7-19a5-448b-8a53-994167976040 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:14.102957 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2c5f7-19a5-448b-8a53-994167976040 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:14.103236 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2c5f7-19a5-448b-8a53-994167976040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:14.113891 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2c5f7-19a5-448b-8a53-994167976040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:14.116437 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2c5f7-19a5-448b-8a53-994167976040 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:14.135040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a1e2c5f7-19a5-448b-8a53-994167976040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:14.135040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:14.135040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:14.135040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:14.135040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:14.135040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:14.135040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:14.135040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:14.135040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:14.135040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:14.135040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:14.135040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:14.135040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:14.135040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:14.135040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:14.136533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:14.136533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:14.136533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:14.136533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:14.136533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:14.136533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:14.136533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:14.136533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:14.136533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:14.136533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:14.136533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:14.136533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:14.136533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:14.136533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:14.136533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:14.136533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:14.136533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:14.137610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:14.137610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:14.137610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:14.137610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:14.140941 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 250/514] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:14.141852 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2c5f7-19a5-448b-8a53-994167976040 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:14.174466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fa410-928f-4146-8a78-491edf8edcc1 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:14.209180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efbd37-3b8c-45f1-9fb3-9190c8844d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:14.210009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efbd37-3b8c-45f1-9fb3-9190c8844d62 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:14.210293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efbd37-3b8c-45f1-9fb3-9190c8844d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:14.210627 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efbd37-3b8c-45f1-9fb3-9190c8844d62 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:14.221676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efbd37-3b8c-45f1-9fb3-9190c8844d62 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:14.224707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efbd37-3b8c-45f1-9fb3-9190c8844d62 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:14.227028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:14.244429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-c8efbd37-3b8c-45f1-9fb3-9190c8844d62 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 18 16:51:14.244429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:14.244429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:14.244429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:14.244429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:14.244429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:14.244429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:14.244429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:14.244429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:14.244429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:14.244429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:14.244429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:14.244429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:14.244429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:14.244429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:14.244429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:14.245398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:14.245398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:14.245398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:14.245398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:14.245398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:14.245398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:14.245398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:14.245398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:14.245398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:14.245398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:14.245398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:14.245398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:14.245398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:14.245398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:14.245398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:14.245398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:14.245398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:14.245398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:14.246368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:14.246368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:14.246368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:14.246368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:14.246368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:14.246368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:14.246368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:14.246368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:14.246368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 18 16:51:14.246368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:14.246368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 265/515] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:51:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:14.246927 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efbd37-3b8c-45f1-9fb3-9190c8844d62 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:14.257451 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2c5f7-19a5-448b-8a53-994167976040 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:14.276978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:14.293880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d698eb-5da1-4a5d-a5a3-9595317e13f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:14.294544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d698eb-5da1-4a5d-a5a3-9595317e13f4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:14.294831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d698eb-5da1-4a5d-a5a3-9595317e13f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:14.295103 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d698eb-5da1-4a5d-a5a3-9595317e13f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:14.295831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d698eb-5da1-4a5d-a5a3-9595317e13f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:14.296135 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d698eb-5da1-4a5d-a5a3-9595317e13f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:14.297498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d698eb-5da1-4a5d-a5a3-9595317e13f4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:14.309186 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 251/516] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:14.310003 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d698eb-5da1-4a5d-a5a3-9595317e13f4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:14.355055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efbd37-3b8c-45f1-9fb3-9190c8844d62 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:14.390047 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181091e4-86de-4da6-9586-6e8bc710ab90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:14.390840 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181091e4-86de-4da6-9586-6e8bc710ab90 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:14.391119 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181091e4-86de-4da6-9586-6e8bc710ab90 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:14.391391 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181091e4-86de-4da6-9586-6e8bc710ab90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:14.401995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181091e4-86de-4da6-9586-6e8bc710ab90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:14.403481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181091e4-86de-4da6-9586-6e8bc710ab90 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:14.411153 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d698eb-5da1-4a5d-a5a3-9595317e13f4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:14.423156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-181091e4-86de-4da6-9586-6e8bc710ab90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:14.423156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:14.423156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:14.423156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:14.423156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:14.423156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:14.423156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:14.423156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:14.423156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:14.423156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:14.423156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:14.423156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:14.423156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:14.423156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:14.423156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:14.424220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:14.424220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:14.424220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:14.424220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:14.424220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:14.424220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:14.424220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:14.424220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:14.424220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:14.424220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:14.424220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:14.424220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:14.424220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:14.424220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:14.424220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:14.424220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:14.424220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:14.425209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:14.425209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:14.425209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:14.425209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:14.425953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 266/517] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:14.426748 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181091e4-86de-4da6-9586-6e8bc710ab90 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:14.445846 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb739b-932d-446f-a43f-8317adeae05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:14.446510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb739b-932d-446f-a43f-8317adeae05c None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:14.446792 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb739b-932d-446f-a43f-8317adeae05c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:14.447069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb739b-932d-446f-a43f-8317adeae05c None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:14.447787 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb739b-932d-446f-a43f-8317adeae05c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:14.449265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb739b-932d-446f-a43f-8317adeae05c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:14.456836 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:14.471038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 252/518] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 18 16:51:14 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:51:14.472036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb739b-932d-446f-a43f-8317adeae05c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:14.541444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:14.566935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181091e4-86de-4da6-9586-6e8bc710ab90 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:14.602635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb739b-932d-446f-a43f-8317adeae05c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:14.608170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bd0a9-a39e-41fa-839b-773f22e1ef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:14.608775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bd0a9-a39e-41fa-839b-773f22e1ef01 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:14.609063 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bd0a9-a39e-41fa-839b-773f22e1ef01 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:14.609339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3bd0a9-a39e-41fa-839b-773f22e1ef01 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:14.610112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bd0a9-a39e-41fa-839b-773f22e1ef01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:14.610425 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bd0a9-a39e-41fa-839b-773f22e1ef01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:14.611869 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3bd0a9-a39e-41fa-839b-773f22e1ef01 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:14.629483 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 267/519] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:14.629483 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bd0a9-a39e-41fa-839b-773f22e1ef01 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:14.649300 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf25273-8082-4818-be53-5e09d6510997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:14.650134 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf25273-8082-4818-be53-5e09d6510997 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:14.650488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf25273-8082-4818-be53-5e09d6510997 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:14.650836 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf25273-8082-4818-be53-5e09d6510997 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:14.651788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf25273-8082-4818-be53-5e09d6510997 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:14.652242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf25273-8082-4818-be53-5e09d6510997 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:14.653859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf25273-8082-4818-be53-5e09d6510997 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:14.698994 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 253/520] 10.222.0.49 () {56 vars in 1137 bytes} [Wed May 18 16:51:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:14.699876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf25273-8082-4818-be53-5e09d6510997 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:14.759297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:14.761868 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3bd0a9-a39e-41fa-839b-773f22e1ef01 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:14.798936 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ff5bb-546a-48dc-9614-ca5561c8ecb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:14.799740 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ff5bb-546a-48dc-9614-ca5561c8ecb9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:14.800023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ff5bb-546a-48dc-9614-ca5561c8ecb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:14.800296 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ff5bb-546a-48dc-9614-ca5561c8ecb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:14.809934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ff5bb-546a-48dc-9614-ca5561c8ecb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:14.811396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ff5bb-546a-48dc-9614-ca5561c8ecb9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:14.823147 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf25273-8082-4818-be53-5e09d6510997 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:14.827935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-bf0ff5bb-546a-48dc-9614-ca5561c8ecb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:14.827935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:14.827935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:14.827935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:14.827935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:14.827935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:14.827935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:14.827935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:14.827935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:14.827935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:14.827935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:14.827935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:14.827935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:14.827935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:14.827935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:14.828830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:14.828830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:14.828830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:14.828830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:14.828830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:14.828830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:14.828830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:14.828830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:14.828830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:14.828830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:14.828830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:14.828830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:14.828830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:14.828830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:14.828830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:14.828830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:14.828830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:14.835815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:14.835815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:14.835815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:14.835815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:14.835815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:14.835815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:14.835815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:14.835815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:14.835815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 268/521] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:14.835815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ff5bb-546a-48dc-9614-ca5561c8ecb9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:14.838710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:14.869371 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f5947-a08b-4c58-991f-8234f59b509d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:14.870073 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f5947-a08b-4c58-991f-8234f59b509d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:14.870429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f5947-a08b-4c58-991f-8234f59b509d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:14.870778 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f5947-a08b-4c58-991f-8234f59b509d None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:14.871592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f5947-a08b-4c58-991f-8234f59b509d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:14.871997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f5947-a08b-4c58-991f-8234f59b509d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:14.873431 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f5947-a08b-4c58-991f-8234f59b509d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:14.890005 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 254/522] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:14.891963 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f5947-a08b-4c58-991f-8234f59b509d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:14.951972 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ff5bb-546a-48dc-9614-ca5561c8ecb9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:15.001250 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bafe1a-5374-4c1b-8359-32e9e6ff0387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:15.002093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bafe1a-5374-4c1b-8359-32e9e6ff0387 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:15.002377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bafe1a-5374-4c1b-8359-32e9e6ff0387 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:15.002658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bafe1a-5374-4c1b-8359-32e9e6ff0387 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:15.006798 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f5947-a08b-4c58-991f-8234f59b509d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:15.014425 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bafe1a-5374-4c1b-8359-32e9e6ff0387 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:15.015951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bafe1a-5374-4c1b-8359-32e9e6ff0387 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:15.019346 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:15.032205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-c7bafe1a-5374-4c1b-8359-32e9e6ff0387 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 18 16:51:15.032205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:15.032205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:15.032205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:15.032205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:15.032205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:15.032205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:15.032205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:15.032205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:15.032205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:15.032205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:15.032205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:15.032205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:15.032205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:15.032205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:15.032205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:15.033159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:15.033159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:15.033159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:15.033159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:15.033159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:15.033159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:15.033159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:15.033159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:15.033159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:15.033159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:15.033159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:15.033159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:15.033159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:15.033159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:15.033159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:15.033159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:15.033159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:15.033159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:15.035057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:15.035057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:15.035057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:15.035057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:15.035057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:15.035057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:15.035057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:15.035057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:15.035057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 18 16:51:15.035057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:15.035057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 269/523] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:15.035057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bafe1a-5374-4c1b-8359-32e9e6ff0387 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:15.052271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1036dc-e6d4-4218-aabd-2958e9bc5710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:15.053406 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1036dc-e6d4-4218-aabd-2958e9bc5710 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:15.053745 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1036dc-e6d4-4218-aabd-2958e9bc5710 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:15.054032 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1036dc-e6d4-4218-aabd-2958e9bc5710 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:15.111940 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:15.130840 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1036dc-e6d4-4218-aabd-2958e9bc5710 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:15.132326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1036dc-e6d4-4218-aabd-2958e9bc5710 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:15.155962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bafe1a-5374-4c1b-8359-32e9e6ff0387 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:15.196193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15444-a4f5-4696-9965-b427b3874401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:15.197130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15444-a4f5-4696-9965-b427b3874401 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:15.197130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15444-a4f5-4696-9965-b427b3874401 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:15.197413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15444-a4f5-4696-9965-b427b3874401 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:15.198245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15444-a4f5-4696-9965-b427b3874401 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:15.198558 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15444-a4f5-4696-9965-b427b3874401 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:15.200139 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15444-a4f5-4696-9965-b427b3874401 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:15.219989 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 270/524] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:15.220665 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15444-a4f5-4696-9965-b427b3874401 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:15.253337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 255/525] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:51:15.253337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1036dc-e6d4-4218-aabd-2958e9bc5710 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:15.262657 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:15.352057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15444-a4f5-4696-9965-b427b3874401 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:15.361898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1036dc-e6d4-4218-aabd-2958e9bc5710 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:15.377964 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:15.391884 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe693b-e98c-4c59-b780-e04adfe78437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:15.392603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe693b-e98c-4c59-b780-e04adfe78437 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:15.392890 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe693b-e98c-4c59-b780-e04adfe78437 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:15.393346 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe693b-e98c-4c59-b780-e04adfe78437 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:15.401517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe693b-e98c-4c59-b780-e04adfe78437 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:15.401796 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e56290-d038-4bc3-8835-851c595cf58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:15.402472 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e56290-d038-4bc3-8835-851c595cf58f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:15.402760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e56290-d038-4bc3-8835-851c595cf58f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:15.403020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe693b-e98c-4c59-b780-e04adfe78437 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:15.403114 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e56290-d038-4bc3-8835-851c595cf58f None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:15.403881 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e56290-d038-4bc3-8835-851c595cf58f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:15.404194 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e56290-d038-4bc3-8835-851c595cf58f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:15.405678 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e56290-d038-4bc3-8835-851c595cf58f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:15.418749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-5cfe693b-e98c-4c59-b780-e04adfe78437 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:15.418749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:15.418749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:15.418749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:15.418749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:15.418749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:15.418749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:15.418749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:15.418749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:15.418749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:15.418749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:15.418749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:15.418749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:15.418749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:15.418749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:15.419643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:15.419643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:15.419643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:15.419643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:15.419643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:15.419643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:15.419643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:15.419643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:15.419643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:15.419643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:15.419643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:15.419643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:15.419643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:15.419643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:15.419643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:15.419643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:15.419643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:15.425321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:15.425321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:15.425321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:15.425321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:15.425321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:15.425321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:15.425321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:15.425321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:15.425321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 271/526] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:15.425321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe693b-e98c-4c59-b780-e04adfe78437 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:15.430631 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 256/527] 10.222.0.49 () {56 vars in 1139 bytes} [Wed May 18 16:51:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:15.431288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e56290-d038-4bc3-8835-851c595cf58f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:15.503352 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:15.544530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e56290-d038-4bc3-8835-851c595cf58f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:15.544865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe693b-e98c-4c59-b780-e04adfe78437 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:15.582155 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fe8ac-a9d1-4aa1-9d27-4cc88a2d266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:15.582828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fe8ac-a9d1-4aa1-9d27-4cc88a2d266d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:15.583109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fe8ac-a9d1-4aa1-9d27-4cc88a2d266d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:15.583421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fe8ac-a9d1-4aa1-9d27-4cc88a2d266d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:15.584990 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fe8ac-a9d1-4aa1-9d27-4cc88a2d266d None admin] RBAC: Adding query filter params (role.id=c6328736ee34470cb87aa31dea4530bf, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=c9e3c0ef5ed943d183b064f383fc01f3) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:15.585308 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fe8ac-a9d1-4aa1-9d27-4cc88a2d266d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:15.585413 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b799b12-afe3-4e8b-a689-b429dcf0437c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:15.586134 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b799b12-afe3-4e8b-a689-b429dcf0437c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:15.586425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b799b12-afe3-4e8b-a689-b429dcf0437c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:15.586703 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b799b12-afe3-4e8b-a689-b429dcf0437c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:15.586794 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1fe8ac-a9d1-4aa1-9d27-4cc88a2d266d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:15.601765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 272/528] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:51:15 2022] GET /identity/v3/role_assignments?user.id=c9e3c0ef5ed943d183b064f383fc01f3&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=c6328736ee34470cb87aa31dea4530bf => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:15.601765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fe8ac-a9d1-4aa1-9d27-4cc88a2d266d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:15.607966 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b799b12-afe3-4e8b-a689-b429dcf0437c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:15.610395 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b799b12-afe3-4e8b-a689-b429dcf0437c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:15.636289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-8b799b12-afe3-4e8b-a689-b429dcf0437c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:15.636289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:15.636289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:15.636289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:15.636289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:15.636289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:15.636289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:15.636289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:15.636289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:15.636289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:15.636289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:15.636289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:15.636289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:15.636289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:15.636289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:15.637230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:15.637230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:15.637230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:15.637230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:15.637230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:15.637230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:15.637230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:15.637230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:15.637230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:15.637230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:15.637230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:15.637230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:15.637230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:15.637230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:15.637230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:15.637230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:15.637230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:15.638126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:15.638126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:15.638126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:15.638126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:15.642355 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 257/529] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:15.643289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b799b12-afe3-4e8b-a689-b429dcf0437c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:15.657961 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:15.748170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fe8ac-a9d1-4aa1-9d27-4cc88a2d266d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:15.770380 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b799b12-afe3-4e8b-a689-b429dcf0437c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:15.790057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:15.791873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a276c8-9557-4eb5-bf67-e66028780de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:15.793030 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a276c8-9557-4eb5-bf67-e66028780de3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:15.794470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a276c8-9557-4eb5-bf67-e66028780de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:15.794944 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a276c8-9557-4eb5-bf67-e66028780de3 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:15.795812 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a276c8-9557-4eb5-bf67-e66028780de3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:15.796131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a276c8-9557-4eb5-bf67-e66028780de3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:15.797642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a276c8-9557-4eb5-bf67-e66028780de3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:15.811352 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe427b-3dcd-45b1-ab15-96a3a304fa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:15.812461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe427b-3dcd-45b1-ab15-96a3a304fa68 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:15.812956 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe427b-3dcd-45b1-ab15-96a3a304fa68 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:15.813433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe427b-3dcd-45b1-ab15-96a3a304fa68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:15.820869 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 273/530] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:15.823714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a276c8-9557-4eb5-bf67-e66028780de3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:15.894994 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe427b-3dcd-45b1-ab15-96a3a304fa68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:15.897082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe427b-3dcd-45b1-ab15-96a3a304fa68 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:15.929112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a276c8-9557-4eb5-bf67-e66028780de3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:15.954120 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:15.967281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b22fab-566a-4c15-8f6d-21ed0ba4494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:15.968141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b22fab-566a-4c15-8f6d-21ed0ba4494f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:15.968432 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b22fab-566a-4c15-8f6d-21ed0ba4494f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:15.969209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b22fab-566a-4c15-8f6d-21ed0ba4494f None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:15.970016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b22fab-566a-4c15-8f6d-21ed0ba4494f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:15.970628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b22fab-566a-4c15-8f6d-21ed0ba4494f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:15.972217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b22fab-566a-4c15-8f6d-21ed0ba4494f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:15.988971 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 274/531] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:15.990313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b22fab-566a-4c15-8f6d-21ed0ba4494f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:16.006658 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 258/532] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:51:16.007604 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe427b-3dcd-45b1-ab15-96a3a304fa68 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:16.028722 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:16.106156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b22fab-566a-4c15-8f6d-21ed0ba4494f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:16.122305 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe427b-3dcd-45b1-ab15-96a3a304fa68 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:16.145120 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d631c3-898e-489f-85e9-20b58888059d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:16.145755 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d631c3-898e-489f-85e9-20b58888059d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:16.146092 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d631c3-898e-489f-85e9-20b58888059d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:16.146559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d631c3-898e-489f-85e9-20b58888059d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:16.147749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d631c3-898e-489f-85e9-20b58888059d None admin] RBAC: Adding query filter params (role.id=c6328736ee34470cb87aa31dea4530bf, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=0d69d99d980744fba12a6b38586e7bf3) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:16.147971 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d631c3-898e-489f-85e9-20b58888059d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:16.150089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d631c3-898e-489f-85e9-20b58888059d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:16.159183 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 275/533] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:51:15 2022] GET /identity/v3/role_assignments?user.id=0d69d99d980744fba12a6b38586e7bf3&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=c6328736ee34470cb87aa31dea4530bf => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:16.159892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d631c3-898e-489f-85e9-20b58888059d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:16.164787 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209143a6-0ee7-4a78-a3fb-effc04815c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:16.166153 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209143a6-0ee7-4a78-a3fb-effc04815c58 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:16.166737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209143a6-0ee7-4a78-a3fb-effc04815c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:16.167226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209143a6-0ee7-4a78-a3fb-effc04815c58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:16.178225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209143a6-0ee7-4a78-a3fb-effc04815c58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:16.180330 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209143a6-0ee7-4a78-a3fb-effc04815c58 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:16.201157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-209143a6-0ee7-4a78-a3fb-effc04815c58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:16.201157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:16.201157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:16.201157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:16.201157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:16.201157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:16.201157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:16.201157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:16.201157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:16.201157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:16.201157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:16.201157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:16.201157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:16.201157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:16.201157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:16.202104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:16.202104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:16.202104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:16.202104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:16.202104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:16.202104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:16.202104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:16.202104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:16.202104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:16.202104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:16.202104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:16.202104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:16.202104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:16.202104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:16.202104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:16.202104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:16.202104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:16.202960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:16.202960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:16.202960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:16.202960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:16.202960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:16.202960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:16.202960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:16.202960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:16.203350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:16.206403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 259/534] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:16.212104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209143a6-0ee7-4a78-a3fb-effc04815c58 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:16.315853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:16.344326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209143a6-0ee7-4a78-a3fb-effc04815c58 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:16.382507 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d631c3-898e-489f-85e9-20b58888059d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:16.384988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e129e3-70e5-4e02-b8e9-d3ae3e1764fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:16.385803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e129e3-70e5-4e02-b8e9-d3ae3e1764fe None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:16.386198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e129e3-70e5-4e02-b8e9-d3ae3e1764fe None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:16.386578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e129e3-70e5-4e02-b8e9-d3ae3e1764fe None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:16.387485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e129e3-70e5-4e02-b8e9-d3ae3e1764fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:16.387898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e129e3-70e5-4e02-b8e9-d3ae3e1764fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:16.389440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e129e3-70e5-4e02-b8e9-d3ae3e1764fe None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:16.410239 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 260/535] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:16.416971 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e129e3-70e5-4e02-b8e9-d3ae3e1764fe None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:16.431507 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b683f-2f0c-4a1b-add3-186b7ca8dad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:16.433549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b683f-2f0c-4a1b-add3-186b7ca8dad8 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:16.434094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b683f-2f0c-4a1b-add3-186b7ca8dad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:16.434597 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b683f-2f0c-4a1b-add3-186b7ca8dad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:16.447775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b683f-2f0c-4a1b-add3-186b7ca8dad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:16.449710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b683f-2f0c-4a1b-add3-186b7ca8dad8 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:16.469442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-bd3b683f-2f0c-4a1b-add3-186b7ca8dad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:16.469442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:16.469442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:16.469442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:16.469442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:16.469442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:16.469442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:16.469442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:16.469442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:16.469442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:16.469442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:16.469442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:16.469442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:16.469442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:16.469442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:16.470472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:16.470472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:16.470472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:16.470472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:16.470472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:16.470472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:16.470472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:16.470472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:16.470472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:16.470472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:16.470472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:16.470472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:16.470472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:16.470472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:16.470472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:16.470472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:16.470472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:16.471316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:16.471316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:16.471316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:16.471316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:16.473711 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 276/536] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:16.479855 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b683f-2f0c-4a1b-add3-186b7ca8dad8 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:16.631960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e129e3-70e5-4e02-b8e9-d3ae3e1764fe None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:16.649638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:16.685002 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b683f-2f0c-4a1b-add3-186b7ca8dad8 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:16.697850 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2f0d3-6516-4618-8a22-bff19e660473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:16.698663 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2f0d3-6516-4618-8a22-bff19e660473 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:16.698955 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2f0d3-6516-4618-8a22-bff19e660473 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:16.699237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2f0d3-6516-4618-8a22-bff19e660473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:16.700095 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2f0d3-6516-4618-8a22-bff19e660473 None admin] RBAC: Adding query filter params (role.id=c6328736ee34470cb87aa31dea4530bf, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=102a6c55061040129802a9739f43036a) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:16.700413 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2f0d3-6516-4618-8a22-bff19e660473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:16.701888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2f0d3-6516-4618-8a22-bff19e660473 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:16.711087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 261/537] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:51:16 2022] GET /identity/v3/role_assignments?user.id=102a6c55061040129802a9739f43036a&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=c6328736ee34470cb87aa31dea4530bf => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:16.735205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62300411-8e56-4818-9598-80abf9c8c186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:16.735895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62300411-8e56-4818-9598-80abf9c8c186 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:16.736183 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62300411-8e56-4818-9598-80abf9c8c186 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:16.736462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62300411-8e56-4818-9598-80abf9c8c186 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:16.737212 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62300411-8e56-4818-9598-80abf9c8c186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:16.737523 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62300411-8e56-4818-9598-80abf9c8c186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:16.738990 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62300411-8e56-4818-9598-80abf9c8c186 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:16.753921 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 277/538] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:16.759671 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2f0d3-6516-4618-8a22-bff19e660473 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:16.780769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:16.933689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2f0d3-6516-4618-8a22-bff19e660473 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:16.989795 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239f77a-8231-4fa9-92ce-f882b67af95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:16.990538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239f77a-8231-4fa9-92ce-f882b67af95e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:16.990821 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239f77a-8231-4fa9-92ce-f882b67af95e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:16.991095 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239f77a-8231-4fa9-92ce-f882b67af95e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:17.006262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239f77a-8231-4fa9-92ce-f882b67af95e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:17.006678 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239f77a-8231-4fa9-92ce-f882b67af95e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:17.011969 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cb9d4-fe6d-4f0f-8d4a-4cd15f08a454 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:17.012261 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cb9d4-fe6d-4f0f-8d4a-4cd15f08a454 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:17.012545 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cb9d4-fe6d-4f0f-8d4a-4cd15f08a454 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:17.013935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 278/539] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:51:17.021724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6c25c-dc90-42d1-869d-f884be2ff001 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:17.022014 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6c25c-dc90-42d1-869d-f884be2ff001 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:17.022294 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6c25c-dc90-42d1-869d-f884be2ff001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:17.030744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-7239f77a-8231-4fa9-92ce-f882b67af95e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:17.030744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:17.030744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:17.030744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:17.030744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:17.030744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:17.030744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:17.030744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:17.030744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:17.030744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:17.030744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:17.030744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:17.030744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:17.030744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:17.030744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:17.031587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:17.031587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:17.031587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:17.031587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:17.031587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:17.031587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:17.031587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:17.031587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:17.031587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:17.031587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:17.031587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:17.031587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:17.031587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:17.031587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:17.031587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:17.031587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:17.031587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:17.032430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:17.032430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:17.032430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:17.032430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:17.032430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:17.032430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:17.032430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:17.032430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:17.032430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 262/540] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:17.042778 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239f77a-8231-4fa9-92ce-f882b67af95e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:17.043955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-42d6c25c-dc90-42d1-869d-f884be2ff001 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:17.045272 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-42d6c25c-dc90-42d1-869d-f884be2ff001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:17.150242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:17.165720 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 279/541] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:51:17.207165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239f77a-8231-4fa9-92ce-f882b67af95e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:17.209881 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6c25c-dc90-42d1-869d-f884be2ff001 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:17.254657 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963421e-88fa-4361-848d-c0dec156cb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:17.256305 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963421e-88fa-4361-848d-c0dec156cb5c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:17.256731 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963421e-88fa-4361-848d-c0dec156cb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:17.257163 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963421e-88fa-4361-848d-c0dec156cb5c None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:17.258289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963421e-88fa-4361-848d-c0dec156cb5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:17.258737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963421e-88fa-4361-848d-c0dec156cb5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:17.260896 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963421e-88fa-4361-848d-c0dec156cb5c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:17.275842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 263/542] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:17.281262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963421e-88fa-4361-848d-c0dec156cb5c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:17.364002 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:17.402433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963421e-88fa-4361-848d-c0dec156cb5c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:17.438061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:17.451219 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d104f-83a7-4501-9ab5-5eff41c74803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:17.451854 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6c25c-dc90-42d1-869d-f884be2ff001 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:17.451992 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d104f-83a7-4501-9ab5-5eff41c74803 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:17.452175 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d104f-83a7-4501-9ab5-5eff41c74803 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:17.452417 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d104f-83a7-4501-9ab5-5eff41c74803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:17.453288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d104f-83a7-4501-9ab5-5eff41c74803 None admin] RBAC: Adding query filter params (role.id=c6328736ee34470cb87aa31dea4530bf, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=d35f21c5cc7c433882eb5fbe9a8072f6) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:17.453890 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d104f-83a7-4501-9ab5-5eff41c74803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:17.455592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d104f-83a7-4501-9ab5-5eff41c74803 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:17.462841 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 264/543] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:51:17 2022] GET /identity/v3/role_assignments?user.id=d35f21c5cc7c433882eb5fbe9a8072f6&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=c6328736ee34470cb87aa31dea4530bf => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:17.510139 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e6f87-09ed-4e88-adda-4a34b526196f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:17.511278 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e6f87-09ed-4e88-adda-4a34b526196f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:17.511696 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e6f87-09ed-4e88-adda-4a34b526196f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:17.512113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e6f87-09ed-4e88-adda-4a34b526196f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:17.538616 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e6f87-09ed-4e88-adda-4a34b526196f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:17.552677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-637e6f87-09ed-4e88-adda-4a34b526196f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:17.552677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:17.552677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:17.552677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:17.552677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:17.552677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:17.552677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:17.552677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:17.552677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:17.552677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:17.552677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:17.552677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:17.552677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:17.552677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:17.552677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:17.552677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:17.554089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:17.554089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:17.554089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:17.554089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:17.554089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:17.554089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:17.554089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:17.554089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:17.554089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:17.554089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:17.554089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:17.554089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:17.554089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:17.554089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:17.554089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:17.554089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:17.554878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:17.554878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:17.554878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:17.554878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:17.554878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:17.554878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:17.554878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:17.554878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:17.554878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:17.554878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:17.554878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:17.554878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:17.554878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 280/544] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:17.560431 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d104f-83a7-4501-9ab5-5eff41c74803 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:17.698684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d104f-83a7-4501-9ab5-5eff41c74803 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:17.745377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b7958-72da-452c-bdab-f806faa88c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:17.746088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b7958-72da-452c-bdab-f806faa88c97 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:17.746373 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b7958-72da-452c-bdab-f806faa88c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:17.746647 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b7958-72da-452c-bdab-f806faa88c97 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:17.747413 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b7958-72da-452c-bdab-f806faa88c97 None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:17.747713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b7958-72da-452c-bdab-f806faa88c97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:17.749084 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b7958-72da-452c-bdab-f806faa88c97 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:17.759657 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 265/545] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:51:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:17.765175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e6f87-09ed-4e88-adda-4a34b526196f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:17.888911 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e6f87-09ed-4e88-adda-4a34b526196f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:17.922194 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:17.929482 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf0344-e3ff-4d73-81ee-5d4462560efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:17.930340 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf0344-e3ff-4d73-81ee-5d4462560efc None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:17.930624 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf0344-e3ff-4d73-81ee-5d4462560efc None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:17.930903 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf0344-e3ff-4d73-81ee-5d4462560efc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:17.942616 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf0344-e3ff-4d73-81ee-5d4462560efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:17.944700 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf0344-e3ff-4d73-81ee-5d4462560efc None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:17.963048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-91cf0344-e3ff-4d73-81ee-5d4462560efc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:17.963048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:17.963048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:17.963048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:17.963048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:17.963048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:17.963048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:17.963048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:17.963048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:17.963048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:17.963048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:17.963048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:17.963048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:17.963048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:17.963048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:17.965039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:17.965039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:17.965039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:17.965039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:17.965039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:17.965039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:17.965039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:17.965039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:17.965039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:17.965039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:17.965039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:17.965039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:17.965039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:17.965039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:17.965039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:17.965039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:17.965039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:17.966369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:17.966369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:17.966369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:17.966369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:17.966369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 281/546] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:17.970060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b7958-72da-452c-bdab-f806faa88c97 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:18.023181 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:18.101620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b7958-72da-452c-bdab-f806faa88c97 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:18.140038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4979e12-7d89-425b-8262-0b3519da84b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:18.140711 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4979e12-7d89-425b-8262-0b3519da84b2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:18.140999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4979e12-7d89-425b-8262-0b3519da84b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:18.141280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4979e12-7d89-425b-8262-0b3519da84b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:18.142046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4979e12-7d89-425b-8262-0b3519da84b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:18.142673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4979e12-7d89-425b-8262-0b3519da84b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:18.144045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4979e12-7d89-425b-8262-0b3519da84b2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:18.158660 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 266/547] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:18.166307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf0344-e3ff-4d73-81ee-5d4462560efc None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:18.284252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf0344-e3ff-4d73-81ee-5d4462560efc None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:18.325203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d7ca6-98d6-4103-abd8-34597263370e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:18.326036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d7ca6-98d6-4103-abd8-34597263370e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:18.326318 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d7ca6-98d6-4103-abd8-34597263370e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:18.326589 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d7ca6-98d6-4103-abd8-34597263370e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:18.335929 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d7ca6-98d6-4103-abd8-34597263370e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:18.337423 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d7ca6-98d6-4103-abd8-34597263370e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:18.357029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-dc6d7ca6-98d6-4103-abd8-34597263370e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 16:51:18.357029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:18.357029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:18.357029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:18.357029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:18.357029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:18.357029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:18.357029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:18.357029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:18.357029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:18.357029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:18.357029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:18.357029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:18.357029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:18.357029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:18.357029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:18.358579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:18.358579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:18.358579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:18.358579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:18.358579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:18.358579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:18.358579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:18.358579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:18.358579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:18.358579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:18.358579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:18.358579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:18.358579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:18.358579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:18.358579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:18.358579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:18.358579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:18.358579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:18.359697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:18.359697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:18.359697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:18.359697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:18.359697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:18.359697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:18.359697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:18.359697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:18.359697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 16:51:18.359697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:18.362724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 282/548] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:51:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:18.369724 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4979e12-7d89-425b-8262-0b3519da84b2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:18.467622 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0f8ae-90d2-46f6-b1eb-7bbd70a06ed2 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:18.467973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0f8ae-90d2-46f6-b1eb-7bbd70a06ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:18.468349 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0f8ae-90d2-46f6-b1eb-7bbd70a06ed2 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:18.470256 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 283/549] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:51:18.490137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f49db4-ebc8-43d4-a706-4217ea25fd1e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:18.490471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f49db4-ebc8-43d4-a706-4217ea25fd1e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:18.490721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f49db4-ebc8-43d4-a706-4217ea25fd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:18.529956 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-76f49db4-ebc8-43d4-a706-4217ea25fd1e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:18.532388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-76f49db4-ebc8-43d4-a706-4217ea25fd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:18.607162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4979e12-7d89-425b-8262-0b3519da84b2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:18.620953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:18.625060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:18.679772 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 284/550] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:51:18.680769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8b53e-6343-4950-81d8-bb7fc26d842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:18.681761 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8b53e-6343-4950-81d8-bb7fc26d842b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:18.682263 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8b53e-6343-4950-81d8-bb7fc26d842b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:18.682752 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8b53e-6343-4950-81d8-bb7fc26d842b None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:18.683815 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8b53e-6343-4950-81d8-bb7fc26d842b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:18.684341 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8b53e-6343-4950-81d8-bb7fc26d842b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:18.686014 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8b53e-6343-4950-81d8-bb7fc26d842b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:18.706747 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f49db4-ebc8-43d4-a706-4217ea25fd1e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:18.706956 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 267/551] 10.222.0.49 () {56 vars in 1135 bytes} [Wed May 18 16:51:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:18.712947 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8b53e-6343-4950-81d8-bb7fc26d842b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:18.885773 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f49db4-ebc8-43d4-a706-4217ea25fd1e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:18.917271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8b53e-6343-4950-81d8-bb7fc26d842b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:18.957836 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e7616-4cd4-403f-a5ba-c37f12a93a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:18.959373 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e7616-4cd4-403f-a5ba-c37f12a93a64 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:18.960738 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e7616-4cd4-403f-a5ba-c37f12a93a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:18.961997 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e7616-4cd4-403f-a5ba-c37f12a93a64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:18.982682 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e7616-4cd4-403f-a5ba-c37f12a93a64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:18.996095 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b770d-fa28-4276-82b8-44bbaf57d49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:18.997118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b770d-fa28-4276-82b8-44bbaf57d49f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:18.997610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b770d-fa28-4276-82b8-44bbaf57d49f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:18.998136 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b770d-fa28-4276-82b8-44bbaf57d49f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:18.999706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-e52e7616-4cd4-403f-a5ba-c37f12a93a64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:18.999706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:18.999706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:18.999706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:18.999706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:18.999706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:18.999706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:18.999706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:18.999706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:18.999706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:18.999706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:18.999706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:18.999706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:18.999706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:18.999706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:18.999706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:19.000715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:19.000715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:19.000715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:19.000715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:19.000715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:19.000715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:19.000715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:19.000715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:19.000715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:19.000715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:19.000715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:19.000715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:19.000715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:19.000715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:19.000715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:19.000715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:19.001551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:19.001551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:19.001551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:19.001551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:19.001551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:19.001551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:19.001551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:19.001551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:19.001551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:19.001551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:19.001551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:19.001551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:19.004367 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 285/552] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:19.011918 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e7616-4cd4-403f-a5ba-c37f12a93a64 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:19.051857 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:19.082874 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:19.106766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b770d-fa28-4276-82b8-44bbaf57d49f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:19.108378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b770d-fa28-4276-82b8-44bbaf57d49f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:19.158428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e7616-4cd4-403f-a5ba-c37f12a93a64 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:19.195618 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d27a5b-2cf6-4298-a1b6-c343b88441a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:19.196295 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d27a5b-2cf6-4298-a1b6-c343b88441a3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:19.196581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d27a5b-2cf6-4298-a1b6-c343b88441a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:19.196855 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d27a5b-2cf6-4298-a1b6-c343b88441a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:19.197608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d27a5b-2cf6-4298-a1b6-c343b88441a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:19.197945 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d27a5b-2cf6-4298-a1b6-c343b88441a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:19.199340 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d27a5b-2cf6-4298-a1b6-c343b88441a3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:19.209365 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 286/553] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:51:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:19.210821 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199088be-caa2-4226-a5e0-a59cfc265e02 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:19.211108 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199088be-caa2-4226-a5e0-a59cfc265e02 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:19.211383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199088be-caa2-4226-a5e0-a59cfc265e02 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:19.212892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 287/554] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:19.215620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199088be-caa2-4226-a5e0-a59cfc265e02 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:19.234832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 268/555] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 18 16:51:19.236339 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c85a7d-dab7-4b33-99f7-a54ea07311c1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:19.236637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c85a7d-dab7-4b33-99f7-a54ea07311c1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:19.236909 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c85a7d-dab7-4b33-99f7-a54ea07311c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:19.259659 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f4c85a7d-dab7-4b33-99f7-a54ea07311c1 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:19.261041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f4c85a7d-dab7-4b33-99f7-a54ea07311c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:19.326505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:19.335134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199088be-caa2-4226-a5e0-a59cfc265e02 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:19.348426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:19.365683 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 269/556] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:19.365683 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c85a7d-dab7-4b33-99f7-a54ea07311c1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:19.400923 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5ebd7-dde0-4932-b7d1-e96d620802e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:19.402844 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5ebd7-dde0-4932-b7d1-e96d620802e9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:19.403645 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5ebd7-dde0-4932-b7d1-e96d620802e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:19.404169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5ebd7-dde0-4932-b7d1-e96d620802e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:19.422059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5ebd7-dde0-4932-b7d1-e96d620802e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:19.424637 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5ebd7-dde0-4932-b7d1-e96d620802e9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:19.451865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-86d5ebd7-dde0-4932-b7d1-e96d620802e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:19.451865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:19.451865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:19.451865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:19.451865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:19.451865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:19.451865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:19.451865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:19.451865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:19.451865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:19.451865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:19.451865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:19.451865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:19.451865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:19.451865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:19.452815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:19.452815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:19.452815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:19.452815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:19.452815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:19.452815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:19.452815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:19.452815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:19.452815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:19.452815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:19.452815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:19.452815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:19.452815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:19.452815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:19.452815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:19.452815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:19.452815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:19.453742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:19.453742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:19.453742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:19.453742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:19.454604 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 288/557] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:19.456490 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5ebd7-dde0-4932-b7d1-e96d620802e9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:19.490937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c85a7d-dab7-4b33-99f7-a54ea07311c1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:19.530545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc9e8e-474f-46b5-8425-f4a3c90b1c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:19.531337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc9e8e-474f-46b5-8425-f4a3c90b1c1c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:19.531832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc9e8e-474f-46b5-8425-f4a3c90b1c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:19.531947 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc9e8e-474f-46b5-8425-f4a3c90b1c1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:19.544959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc9e8e-474f-46b5-8425-f4a3c90b1c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:19.546475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc9e8e-474f-46b5-8425-f4a3c90b1c1c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:19.564769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-20bc9e8e-474f-46b5-8425-f4a3c90b1c1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:19.564769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:19.564769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:19.564769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:19.564769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:19.564769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:19.564769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:19.564769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:19.564769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:19.564769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:19.564769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:19.564769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:19.564769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:19.564769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:19.564769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:19.566381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:19.566381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:19.566381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:19.566381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:19.566381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:19.566381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:19.566381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:19.566381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:19.566381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:19.566381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:19.566381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:19.566381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:19.566381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:19.566381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:19.566381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:19.566381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:19.566381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:19.567927 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:19.567927 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:19.567927 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:19.567927 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:19.567927 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 270/558] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:19.567927 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25755b0-cde6-406a-9ff6-5a1129fcdd4a None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:19.567927 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25755b0-cde6-406a-9ff6-5a1129fcdd4a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:19.567927 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25755b0-cde6-406a-9ff6-5a1129fcdd4a None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:19.573118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 271/559] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:19.574223 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25755b0-cde6-406a-9ff6-5a1129fcdd4a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:19.581459 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5ebd7-dde0-4932-b7d1-e96d620802e9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:19.621204 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecf5f0-8a2c-4092-b431-8e9460e9f1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:19.622039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecf5f0-8a2c-4092-b431-8e9460e9f1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:19.622325 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecf5f0-8a2c-4092-b431-8e9460e9f1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:19.622592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecf5f0-8a2c-4092-b431-8e9460e9f1c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:19.631606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:19.634164 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecf5f0-8a2c-4092-b431-8e9460e9f1c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:19.642378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-68ecf5f0-8a2c-4092-b431-8e9460e9f1c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:19.642378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:19.642378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:19.642378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:19.642378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:19.642378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:19.642378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:19.642378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:19.642378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:19.642378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:19.642378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:19.642378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:19.642378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:19.642378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:19.642378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:19.642378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:19.643396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:19.643396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:19.643396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:19.643396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:19.643396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:19.643396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:19.643396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:19.643396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:19.643396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:19.643396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:19.643396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:19.643396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:19.643396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:19.643396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:19.643396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:19.643396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:19.650398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:19.650398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:19.650398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:19.650398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:19.650398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:19.650398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:19.650398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:19.650398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:19.650398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:19.650398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:19.650398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:19.650398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:19.650398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 289/560] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:19.650398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecf5f0-8a2c-4092-b431-8e9460e9f1c5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:19.664934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:19.704562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25755b0-cde6-406a-9ff6-5a1129fcdd4a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:19.744418 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe853cf-a658-4b3a-ade2-de3e32e47017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:19.745096 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe853cf-a658-4b3a-ade2-de3e32e47017 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:19.745390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe853cf-a658-4b3a-ade2-de3e32e47017 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:19.745727 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe853cf-a658-4b3a-ade2-de3e32e47017 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:19.746436 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe853cf-a658-4b3a-ade2-de3e32e47017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:19.746996 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe853cf-a658-4b3a-ade2-de3e32e47017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:19.748147 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe853cf-a658-4b3a-ade2-de3e32e47017 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:19.761380 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 272/561] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:19.762517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154d856-db54-4b96-8fbf-bebbc584d77b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:19.762810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154d856-db54-4b96-8fbf-bebbc584d77b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:19.763088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154d856-db54-4b96-8fbf-bebbc584d77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:19.772048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecf5f0-8a2c-4092-b431-8e9460e9f1c5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:19.780676 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9154d856-db54-4b96-8fbf-bebbc584d77b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:19.782159 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9154d856-db54-4b96-8fbf-bebbc584d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:19.810727 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587cce1-22ca-4179-a309-e97317a61be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:19.811333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587cce1-22ca-4179-a309-e97317a61be5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:19.811618 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587cce1-22ca-4179-a309-e97317a61be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:19.811951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587cce1-22ca-4179-a309-e97317a61be5 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:19.812632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587cce1-22ca-4179-a309-e97317a61be5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:19.812942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587cce1-22ca-4179-a309-e97317a61be5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:19.814370 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587cce1-22ca-4179-a309-e97317a61be5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:19.827729 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 290/562] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:19.828555 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587cce1-22ca-4179-a309-e97317a61be5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:19.867461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 273/563] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:19.867461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154d856-db54-4b96-8fbf-bebbc584d77b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:19.905967 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:19.919247 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:19.959117 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587cce1-22ca-4179-a309-e97317a61be5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:19.972446 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154d856-db54-4b96-8fbf-bebbc584d77b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:19.998517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461cf30-f4fd-4808-af6d-19f5fd51cc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:19.999194 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461cf30-f4fd-4808-af6d-19f5fd51cc76 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:19.999482 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461cf30-f4fd-4808-af6d-19f5fd51cc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:19.999764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461cf30-f4fd-4808-af6d-19f5fd51cc76 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:20.000511 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461cf30-f4fd-4808-af6d-19f5fd51cc76 None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:20.000819 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461cf30-f4fd-4808-af6d-19f5fd51cc76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:20.002477 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461cf30-f4fd-4808-af6d-19f5fd51cc76 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:20.010856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5c55f-a93c-44cd-82bd-006ba9ce56c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:20.016080 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 291/564] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:51:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:20.016235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5c55f-a93c-44cd-82bd-006ba9ce56c4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:20.016235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5c55f-a93c-44cd-82bd-006ba9ce56c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:20.016387 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461cf30-f4fd-4808-af6d-19f5fd51cc76 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:20.016466 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b5c55f-a93c-44cd-82bd-006ba9ce56c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:20.024950 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5c55f-a93c-44cd-82bd-006ba9ce56c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:20.026657 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b5c55f-a93c-44cd-82bd-006ba9ce56c4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:20.043568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-b5b5c55f-a93c-44cd-82bd-006ba9ce56c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 16:51:20.043568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:20.043568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:20.043568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:20.043568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:20.043568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:20.043568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:20.043568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:20.043568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:20.043568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:20.043568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:20.043568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:20.043568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:20.043568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:20.043568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:20.043568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:20.044799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:20.044799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:20.044799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:20.044799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:20.044799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:20.044799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:20.044799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:20.044799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:20.044799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:20.044799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:20.044799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:20.044799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:20.044799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:20.044799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:20.044799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:20.044799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:20.044799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:20.044799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:20.045796 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:20.045796 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:20.045796 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:20.045796 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:20.045796 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:20.045796 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:20.045796 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:20.045796 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:20.045796 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 16:51:20.045796 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:20.045796 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 274/565] 10.222.0.49 () {56 vars in 1093 bytes} [Wed May 18 16:51:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:20.046433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5c55f-a93c-44cd-82bd-006ba9ce56c4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:20.142449 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461cf30-f4fd-4808-af6d-19f5fd51cc76 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:20.165621 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:20.171600 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b5c55f-a93c-44cd-82bd-006ba9ce56c4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:20.183532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:20.191253 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4338cc0-e9a3-4215-bbe6-dffc0a89957f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:20.192439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4338cc0-e9a3-4215-bbe6-dffc0a89957f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:20.192756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4338cc0-e9a3-4215-bbe6-dffc0a89957f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:20.193166 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4338cc0-e9a3-4215-bbe6-dffc0a89957f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:20.200470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4338cc0-e9a3-4215-bbe6-dffc0a89957f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:20.201971 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4338cc0-e9a3-4215-bbe6-dffc0a89957f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:20.215022 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c39aa-d12a-4d4f-a9c1-b591a0604496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:20.215743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c39aa-d12a-4d4f-a9c1-b591a0604496 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:20.216026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c39aa-d12a-4d4f-a9c1-b591a0604496 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:20.216297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c39aa-d12a-4d4f-a9c1-b591a0604496 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:20.217951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-b4338cc0-e9a3-4215-bbe6-dffc0a89957f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:20.217951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:20.217951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:20.217951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:20.217951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:20.217951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:20.217951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:20.217951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:20.217951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:20.217951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:20.217951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:20.217951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:20.217951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:20.217951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:20.217951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:20.218941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:20.218941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:20.218941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:20.218941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:20.218941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:20.218941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:20.218941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:20.218941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:20.218941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:20.218941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:20.218941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:20.218941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:20.218941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:20.218941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:20.218941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:20.218941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:20.218941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:20.219847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:20.219847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:20.219847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:20.219847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:20.219847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:20.219847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:20.219847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:20.219847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:20.219847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 292/566] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:20.220357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4338cc0-e9a3-4215-bbe6-dffc0a89957f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:20.233719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c39aa-d12a-4d4f-a9c1-b591a0604496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:20.242831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ca7c39aa-d12a-4d4f-a9c1-b591a0604496 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:20.242831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:20.242831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:20.242831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:20.242831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:20.242831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:20.242831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:20.242831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:20.242831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:20.242831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:20.242831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:20.242831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:20.242831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:20.242831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:20.242831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:20.242831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:20.243888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:20.243888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:20.243888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:20.243888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:20.243888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:20.243888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:20.243888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:20.243888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:20.243888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:20.243888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:20.243888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:20.243888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:20.243888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:20.243888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:20.243888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:20.243888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:20.244719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:20.244719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:20.244719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:20.244719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:20.244719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:20.244719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:20.244719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:20.244719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:20.244719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:20.244719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:20.244719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:20.244719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:20.244719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 275/567] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:20.245465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c39aa-d12a-4d4f-a9c1-b591a0604496 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:20.347260 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4338cc0-e9a3-4215-bbe6-dffc0a89957f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:20.350379 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c39aa-d12a-4d4f-a9c1-b591a0604496 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:20.383799 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471f432-64dc-45bd-8488-d45280796fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:20.384582 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48ae48-bcb5-4095-b0a2-27bf57c73a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:20.384870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471f432-64dc-45bd-8488-d45280796fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:20.384870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471f432-64dc-45bd-8488-d45280796fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:20.385226 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471f432-64dc-45bd-8488-d45280796fe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:20.385339 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48ae48-bcb5-4095-b0a2-27bf57c73a7c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:20.385619 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48ae48-bcb5-4095-b0a2-27bf57c73a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:20.385868 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48ae48-bcb5-4095-b0a2-27bf57c73a7c None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:20.386639 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48ae48-bcb5-4095-b0a2-27bf57c73a7c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:20.386953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48ae48-bcb5-4095-b0a2-27bf57c73a7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:20.388526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48ae48-bcb5-4095-b0a2-27bf57c73a7c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:20.396288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471f432-64dc-45bd-8488-d45280796fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:20.398017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471f432-64dc-45bd-8488-d45280796fe5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:20.406448 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 276/568] 10.222.0.49 () {56 vars in 1133 bytes} [Wed May 18 16:51:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:20.407268 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48ae48-bcb5-4095-b0a2-27bf57c73a7c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:20.418162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-d471f432-64dc-45bd-8488-d45280796fe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:20.418162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:20.418162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:20.418162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:20.418162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:20.418162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:20.418162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:20.418162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:20.418162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:20.418162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:20.418162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:20.418162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:20.418162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:20.418162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:20.418162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:20.419211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:20.419211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:20.419211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:20.419211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:20.419211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:20.419211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:20.419211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:20.419211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:20.419211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:20.419211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:20.419211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:20.419211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:20.419211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:20.419211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:20.419211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:20.419211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:20.419211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:20.420107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:20.420107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:20.420107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:20.420107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:20.420107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 293/569] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:20.420749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a62ca-fcd6-4330-b008-bdbb232bd153 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:20.420995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a62ca-fcd6-4330-b008-bdbb232bd153 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:20.421271 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a62ca-fcd6-4330-b008-bdbb232bd153 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:20.422573 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 294/570] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:20.423697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a62ca-fcd6-4330-b008-bdbb232bd153 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:20.430585 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:20.474024 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:20.524541 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48ae48-bcb5-4095-b0a2-27bf57c73a7c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:20.541561 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a62ca-fcd6-4330-b008-bdbb232bd153 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:20.561812 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767db598-823e-4fa0-b748-9ba72f23ad60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:20.562467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767db598-823e-4fa0-b748-9ba72f23ad60 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:20.562741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767db598-823e-4fa0-b748-9ba72f23ad60 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:20.563010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767db598-823e-4fa0-b748-9ba72f23ad60 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:20.563799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767db598-823e-4fa0-b748-9ba72f23ad60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:20.564099 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767db598-823e-4fa0-b748-9ba72f23ad60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:20.565520 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767db598-823e-4fa0-b748-9ba72f23ad60 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:20.579075 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb64c9b-acbb-4d55-a377-7a89a494eb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:20.579752 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb64c9b-acbb-4d55-a377-7a89a494eb6a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:20.580036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb64c9b-acbb-4d55-a377-7a89a494eb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:20.580564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb64c9b-acbb-4d55-a377-7a89a494eb6a None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:20.581316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb64c9b-acbb-4d55-a377-7a89a494eb6a None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:20.581621 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb64c9b-acbb-4d55-a377-7a89a494eb6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:20.587208 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 277/571] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:20.587463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb64c9b-acbb-4d55-a377-7a89a494eb6a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:20.587554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767db598-823e-4fa0-b748-9ba72f23ad60 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:20.592053 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 295/572] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:51:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:20.592903 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb64c9b-acbb-4d55-a377-7a89a494eb6a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:20.669564 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:20.698200 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767db598-823e-4fa0-b748-9ba72f23ad60 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:20.701894 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb64c9b-acbb-4d55-a377-7a89a494eb6a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:20.704315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:20.733415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157851e9-9dea-412c-ae78-3a308ba1f953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:20.734149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157851e9-9dea-412c-ae78-3a308ba1f953 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:20.734433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157851e9-9dea-412c-ae78-3a308ba1f953 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:20.734706 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157851e9-9dea-412c-ae78-3a308ba1f953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:20.736996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6649ba-76d3-49f7-b9a6-c570b26d6d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:20.737998 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6649ba-76d3-49f7-b9a6-c570b26d6d78 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:20.738281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6649ba-76d3-49f7-b9a6-c570b26d6d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:20.738557 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6649ba-76d3-49f7-b9a6-c570b26d6d78 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:20.739281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6649ba-76d3-49f7-b9a6-c570b26d6d78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:20.740152 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6649ba-76d3-49f7-b9a6-c570b26d6d78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:20.741532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6649ba-76d3-49f7-b9a6-c570b26d6d78 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:20.746021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157851e9-9dea-412c-ae78-3a308ba1f953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:20.747452 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157851e9-9dea-412c-ae78-3a308ba1f953 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:20.753448 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 296/573] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:20.754748 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132c30d-8e16-4776-9b8a-0b01c0c0f214 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:20.755031 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132c30d-8e16-4776-9b8a-0b01c0c0f214 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:20.755467 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132c30d-8e16-4776-9b8a-0b01c0c0f214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:20.770394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-157851e9-9dea-412c-ae78-3a308ba1f953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:20.770394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:20.770394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:20.770394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:20.770394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:20.770394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:20.770394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:20.770394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:20.770394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:20.770394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:20.770394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:20.770394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:20.770394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:20.770394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:20.770394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:20.772354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:20.772354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:20.772354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:20.772354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:20.772354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:20.772354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:20.772354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:20.772354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:20.772354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:20.772354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:20.772354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:20.772354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:20.772354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:20.772354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:20.772354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:20.772354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:20.772354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:20.774404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:20.774404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:20.774404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:20.774404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:20.774404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 278/574] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:20.774404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157851e9-9dea-412c-ae78-3a308ba1f953 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:20.775737 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b132c30d-8e16-4776-9b8a-0b01c0c0f214 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:20.776889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b132c30d-8e16-4776-9b8a-0b01c0c0f214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:20.845572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 297/575] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:20.846257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132c30d-8e16-4776-9b8a-0b01c0c0f214 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:20.888873 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157851e9-9dea-412c-ae78-3a308ba1f953 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:20.917467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:20.926066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c05741-0b23-4ebc-adaa-993737bca363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:20.926701 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c05741-0b23-4ebc-adaa-993737bca363 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:20.927028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c05741-0b23-4ebc-adaa-993737bca363 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:20.927811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c05741-0b23-4ebc-adaa-993737bca363 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:20.929337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c05741-0b23-4ebc-adaa-993737bca363 None admin] RBAC: Adding query filter params (role.id=c6328736ee34470cb87aa31dea4530bf, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=b712c7f5fce54fe2a89d63863f3845f0) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:20.929678 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c05741-0b23-4ebc-adaa-993737bca363 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:20.931140 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c05741-0b23-4ebc-adaa-993737bca363 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:20.936885 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 279/576] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:51:20 2022] GET /identity/v3/role_assignments?user.id=b712c7f5fce54fe2a89d63863f3845f0&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=c6328736ee34470cb87aa31dea4530bf => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:20.937694 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c05741-0b23-4ebc-adaa-993737bca363 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:20.950237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:20.957985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132c30d-8e16-4776-9b8a-0b01c0c0f214 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:21.000014 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7d655-8009-48ad-811f-c25b7a5410df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:21.000754 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7d655-8009-48ad-811f-c25b7a5410df None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:21.001044 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7d655-8009-48ad-811f-c25b7a5410df None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:21.001323 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7d655-8009-48ad-811f-c25b7a5410df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:21.013231 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7d655-8009-48ad-811f-c25b7a5410df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:21.014762 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7d655-8009-48ad-811f-c25b7a5410df None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:21.034710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-87b7d655-8009-48ad-811f-c25b7a5410df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:21.034710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:21.034710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:21.034710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:21.034710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:21.034710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:21.034710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:21.034710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:21.034710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:21.034710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:21.034710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:21.034710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:21.034710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:21.034710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:21.034710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:21.035797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:21.035797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:21.035797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:21.035797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:21.035797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:21.035797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:21.035797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:21.035797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:21.035797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:21.035797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:21.035797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:21.035797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:21.035797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:21.035797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:21.035797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:21.035797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:21.035797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:21.037259 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:21.037259 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:21.037259 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:21.037259 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:21.037259 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 298/577] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:21.038090 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7d655-8009-48ad-811f-c25b7a5410df None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:21.078750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c05741-0b23-4ebc-adaa-993737bca363 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:21.125309 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241fc98-7da2-4793-8350-226e31e77a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:21.126143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241fc98-7da2-4793-8350-226e31e77a32 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:21.126427 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241fc98-7da2-4793-8350-226e31e77a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:21.126704 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241fc98-7da2-4793-8350-226e31e77a32 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:21.135038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241fc98-7da2-4793-8350-226e31e77a32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:21.136481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241fc98-7da2-4793-8350-226e31e77a32 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:21.151635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1241fc98-7da2-4793-8350-226e31e77a32 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 18 16:51:21.151635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:21.151635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:21.151635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:21.151635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:21.151635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:21.151635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:21.151635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:21.151635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:21.151635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:21.151635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:21.151635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:21.151635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:21.151635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:21.151635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:21.151635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:21.152620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:21.152620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:21.152620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:21.152620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:21.152620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:21.152620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:21.152620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:21.152620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:21.152620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:21.152620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:21.152620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:21.152620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:21.152620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:21.152620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:21.152620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:21.152620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:21.152620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:21.152620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:21.153554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:21.153554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:21.153554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:21.153554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:21.153554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:21.153554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:21.153554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:21.153554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:21.153554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 18 16:51:21.153554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:21.153554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 280/578] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:51:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:21.154819 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241fc98-7da2-4793-8350-226e31e77a32 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:21.165002 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7d655-8009-48ad-811f-c25b7a5410df None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:21.204902 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adb418-9a42-4378-94e1-e97561853af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:21.206026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adb418-9a42-4378-94e1-e97561853af6 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:21.206374 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adb418-9a42-4378-94e1-e97561853af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:21.206716 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adb418-9a42-4378-94e1-e97561853af6 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:21.207509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adb418-9a42-4378-94e1-e97561853af6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:21.207882 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adb418-9a42-4378-94e1-e97561853af6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:21.210523 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adb418-9a42-4378-94e1-e97561853af6 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:21.224966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 299/579] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:21.226013 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adb418-9a42-4378-94e1-e97561853af6 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:21.227503 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:21.241321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:21.285685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241fc98-7da2-4793-8350-226e31e77a32 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:21.322876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc1c1c-d5d5-4ed0-b8e3-e5bfb5bf5451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:21.323678 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc1c1c-d5d5-4ed0-b8e3-e5bfb5bf5451 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:21.323963 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc1c1c-d5d5-4ed0-b8e3-e5bfb5bf5451 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:21.324240 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc1c1c-d5d5-4ed0-b8e3-e5bfb5bf5451 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:21.338288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc1c1c-d5d5-4ed0-b8e3-e5bfb5bf5451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:21.353078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-66bc1c1c-d5d5-4ed0-b8e3-e5bfb5bf5451 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:21.353078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:21.353078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:21.353078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:21.353078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:21.353078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:21.353078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:21.353078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:21.353078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:21.353078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:21.353078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:21.353078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:21.353078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:21.353078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:21.353078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:21.353078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:21.354409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:21.354409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:21.354409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:21.354409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:21.354409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:21.354409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:21.354409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:21.354409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:21.354409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:21.354409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:21.354409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:21.354409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:21.354409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:21.354409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:21.354409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:21.354409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:21.355580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:21.355580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:21.355580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:21.355580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:21.355580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:21.355580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:21.355580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:21.355580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:21.355580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:21.355580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:21.355580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:21.355580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:21.355580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 281/580] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:21.356894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc1c1c-d5d5-4ed0-b8e3-e5bfb5bf5451 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:21.363462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adb418-9a42-4378-94e1-e97561853af6 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:21.404975 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88367d15-f034-4c8d-ad8c-4e0c49f1a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:21.405665 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88367d15-f034-4c8d-ad8c-4e0c49f1a112 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:21.405956 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88367d15-f034-4c8d-ad8c-4e0c49f1a112 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:21.406588 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88367d15-f034-4c8d-ad8c-4e0c49f1a112 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:21.407399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88367d15-f034-4c8d-ad8c-4e0c49f1a112 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:21.407937 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88367d15-f034-4c8d-ad8c-4e0c49f1a112 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:21.409621 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88367d15-f034-4c8d-ad8c-4e0c49f1a112 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:21.423540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 300/581] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:21.426023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88367d15-f034-4c8d-ad8c-4e0c49f1a112 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:21.479756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc1c1c-d5d5-4ed0-b8e3-e5bfb5bf5451 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:21.493430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:21.500267 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:21.518344 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a1624-3ee9-4e5e-bad4-a5f212f245ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:21.519014 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a1624-3ee9-4e5e-bad4-a5f212f245ea None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:21.519296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a1624-3ee9-4e5e-bad4-a5f212f245ea None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:21.519572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a1624-3ee9-4e5e-bad4-a5f212f245ea None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:21.520415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a1624-3ee9-4e5e-bad4-a5f212f245ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:21.521323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a1624-3ee9-4e5e-bad4-a5f212f245ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:21.523069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a1624-3ee9-4e5e-bad4-a5f212f245ea None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:21.541203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88367d15-f034-4c8d-ad8c-4e0c49f1a112 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:21.546918 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 282/582] 10.222.0.49 () {56 vars in 1137 bytes} [Wed May 18 16:51:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:21.546918 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a1624-3ee9-4e5e-bad4-a5f212f245ea None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:21.586671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c88f2e-7153-496d-880d-16ef2e47141c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:21.587499 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c88f2e-7153-496d-880d-16ef2e47141c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:21.587780 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c88f2e-7153-496d-880d-16ef2e47141c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:21.588056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c88f2e-7153-496d-880d-16ef2e47141c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:21.595650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c88f2e-7153-496d-880d-16ef2e47141c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:21.597119 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c88f2e-7153-496d-880d-16ef2e47141c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:21.611285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-99c88f2e-7153-496d-880d-16ef2e47141c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:21.611285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:21.611285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:21.611285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:21.611285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:21.611285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:21.611285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:21.611285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:21.611285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:21.611285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:21.611285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:21.611285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:21.611285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:21.611285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:21.611285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:21.612220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:21.612220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:21.612220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:21.612220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:21.612220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:21.612220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:21.612220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:21.612220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:21.612220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:21.612220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:21.612220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:21.612220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:21.612220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:21.612220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:21.612220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:21.612220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:21.612220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:21.613137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:21.613137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:21.613137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:21.613137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:21.613137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:21.613137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:21.613137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:21.613137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:21.613137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 301/583] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:21.614382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c88f2e-7153-496d-880d-16ef2e47141c None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:21.663462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a1624-3ee9-4e5e-bad4-a5f212f245ea None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:21.700408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff8642-b0d2-4408-891e-ab254c5e661b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:21.701092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff8642-b0d2-4408-891e-ab254c5e661b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:21.701354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff8642-b0d2-4408-891e-ab254c5e661b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:21.701635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff8642-b0d2-4408-891e-ab254c5e661b None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:21.702442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff8642-b0d2-4408-891e-ab254c5e661b None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:21.702731 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff8642-b0d2-4408-891e-ab254c5e661b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:21.704110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff8642-b0d2-4408-891e-ab254c5e661b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:21.718093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 283/584] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:51:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:21.718093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff8642-b0d2-4408-891e-ab254c5e661b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:21.739402 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c88f2e-7153-496d-880d-16ef2e47141c None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:21.748602 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:21.769900 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:21.780844 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0342e-2661-497b-8c13-c2795f7b81d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:21.781674 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0342e-2661-497b-8c13-c2795f7b81d1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:21.781976 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0342e-2661-497b-8c13-c2795f7b81d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:21.782249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0342e-2661-497b-8c13-c2795f7b81d1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:21.791736 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0342e-2661-497b-8c13-c2795f7b81d1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:21.793114 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0342e-2661-497b-8c13-c2795f7b81d1 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:21.809233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-50e0342e-2661-497b-8c13-c2795f7b81d1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 18 16:51:21.809233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:21.809233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:21.809233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:21.809233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:21.809233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:21.809233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:21.809233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:21.809233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:21.809233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:21.809233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:21.809233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:21.809233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:21.809233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:21.809233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:21.809233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:21.810322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:21.810322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:21.810322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:21.810322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:21.810322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:21.810322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:21.810322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:21.810322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:21.810322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:21.810322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:21.810322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:21.810322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:21.810322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:21.810322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:21.810322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:21.810322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:21.810322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:21.810322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:21.811282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:21.811282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:21.811282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:21.811282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:21.811282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:21.811282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:21.811282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:21.811282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:21.811282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 18 16:51:21.811282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:21.811282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 302/585] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:51:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:21.811282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0342e-2661-497b-8c13-c2795f7b81d1 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:21.831239 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff8642-b0d2-4408-891e-ab254c5e661b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:21.866799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1421d5-6a10-47d9-b42f-cecc31781659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:21.867622 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1421d5-6a10-47d9-b42f-cecc31781659 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:21.867905 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1421d5-6a10-47d9-b42f-cecc31781659 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:21.868174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1421d5-6a10-47d9-b42f-cecc31781659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:21.879607 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1421d5-6a10-47d9-b42f-cecc31781659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:21.881689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1421d5-6a10-47d9-b42f-cecc31781659 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:21.899508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1e1421d5-6a10-47d9-b42f-cecc31781659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:21.899508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:21.899508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:21.899508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:21.899508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:21.899508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:21.899508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:21.899508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:21.899508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:21.899508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:21.899508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:21.899508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:21.899508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:21.899508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:21.899508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:21.900468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:21.900468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:21.900468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:21.900468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:21.900468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:21.900468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:21.900468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:21.900468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:21.900468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:21.900468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:21.900468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:21.900468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:21.900468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:21.900468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:21.900468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:21.900468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:21.900468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:21.901359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:21.901359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:21.901359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:21.901359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:21.901359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 284/586] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:21.901635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1421d5-6a10-47d9-b42f-cecc31781659 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:21.924074 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0342e-2661-497b-8c13-c2795f7b81d1 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:21.963183 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2b974-ed81-42af-b438-2535d29e8c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:21.963882 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2b974-ed81-42af-b438-2535d29e8c63 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:21.964166 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2b974-ed81-42af-b438-2535d29e8c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:21.964437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2b974-ed81-42af-b438-2535d29e8c63 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:21.965266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2b974-ed81-42af-b438-2535d29e8c63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:21.965631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2b974-ed81-42af-b438-2535d29e8c63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:21.967093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2b974-ed81-42af-b438-2535d29e8c63 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:21.986288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 303/587] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:21.986288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2b974-ed81-42af-b438-2535d29e8c63 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:21.999527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:22.023410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1421d5-6a10-47d9-b42f-cecc31781659 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:22.046779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:22.072540 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac17f71-a43c-4103-b813-2e10c4e74000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:22.073700 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac17f71-a43c-4103-b813-2e10c4e74000 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:22.073971 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac17f71-a43c-4103-b813-2e10c4e74000 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:22.074286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac17f71-a43c-4103-b813-2e10c4e74000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:22.089826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac17f71-a43c-4103-b813-2e10c4e74000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:22.091435 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac17f71-a43c-4103-b813-2e10c4e74000 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:22.111077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-2ac17f71-a43c-4103-b813-2e10c4e74000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:22.111077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:22.111077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:22.111077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:22.111077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:22.111077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:22.111077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:22.111077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:22.111077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:22.111077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:22.111077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:22.111077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:22.111077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:22.111077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:22.111077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:22.112058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:22.112058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:22.112058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:22.112058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:22.112058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:22.112058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:22.112058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:22.112058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:22.112058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:22.112058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:22.112058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:22.112058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:22.112058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:22.112058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:22.112058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:22.112058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:22.112058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:22.112942 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:22.112942 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:22.112942 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:22.112942 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:22.112942 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 285/588] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:22.113225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac17f71-a43c-4103-b813-2e10c4e74000 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:22.131956 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2b974-ed81-42af-b438-2535d29e8c63 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:22.172590 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddc736-807a-4196-a10e-66930d84f1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:22.173588 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddc736-807a-4196-a10e-66930d84f1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:22.174112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddc736-807a-4196-a10e-66930d84f1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:22.174574 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fddc736-807a-4196-a10e-66930d84f1e9 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:22.175596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddc736-807a-4196-a10e-66930d84f1e9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:22.176116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddc736-807a-4196-a10e-66930d84f1e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:22.178626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fddc736-807a-4196-a10e-66930d84f1e9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:22.199079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 304/589] 10.222.0.49 () {56 vars in 1137 bytes} [Wed May 18 16:51:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:22.200272 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddc736-807a-4196-a10e-66930d84f1e9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:22.238300 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac17f71-a43c-4103-b813-2e10c4e74000 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:22.277768 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2784db0-641b-4ee5-801a-fe03cab55b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:22.278538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2784db0-641b-4ee5-801a-fe03cab55b4b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:22.278821 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2784db0-641b-4ee5-801a-fe03cab55b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:22.279148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2784db0-641b-4ee5-801a-fe03cab55b4b None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:22.279877 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2784db0-641b-4ee5-801a-fe03cab55b4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:22.280182 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2784db0-641b-4ee5-801a-fe03cab55b4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:22.281548 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2784db0-641b-4ee5-801a-fe03cab55b4b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:22.284763 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:22.300372 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 286/590] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:22.301208 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2784db0-641b-4ee5-801a-fe03cab55b4b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:22.315050 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fddc736-807a-4196-a10e-66930d84f1e9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:22.317300 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:22.357306 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbdd36-6eb6-40af-9d40-4ba100d26eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:22.358438 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbdd36-6eb6-40af-9d40-4ba100d26eeb None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:22.359004 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbdd36-6eb6-40af-9d40-4ba100d26eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:22.359291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbdd36-6eb6-40af-9d40-4ba100d26eeb None admin] PATH_INFO: `/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/c9e3c0ef5ed943d183b064f383fc01f3/roles/c6328736ee34470cb87aa31dea4530bf` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:22.378545 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbdd36-6eb6-40af-9d40-4ba100d26eeb None admin] RBAC: Authorizing `identity:create_grant(project_id=fcd3afbb3e384cb2939647002c60bbba, user_id=c9e3c0ef5ed943d183b064f383fc01f3, role_id=c6328736ee34470cb87aa31dea4530bf)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:22.381273 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbdd36-6eb6-40af-9d40-4ba100d26eeb None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:22.396432 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 305/591] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:51:22 2022] PUT /identity/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/c9e3c0ef5ed943d183b064f383fc01f3/roles/c6328736ee34470cb87aa31dea4530bf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:51:22.397517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbdd36-6eb6-40af-9d40-4ba100d26eeb None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:22.426762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2784db0-641b-4ee5-801a-fe03cab55b4b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:22.468605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd6681-c504-4f77-8dc6-860af8ded845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:22.469691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd6681-c504-4f77-8dc6-860af8ded845 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:22.470194 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd6681-c504-4f77-8dc6-860af8ded845 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:22.470725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd6681-c504-4f77-8dc6-860af8ded845 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:22.471726 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd6681-c504-4f77-8dc6-860af8ded845 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:22.472253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd6681-c504-4f77-8dc6-860af8ded845 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:22.474079 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd6681-c504-4f77-8dc6-860af8ded845 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:22.488182 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 287/592] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:22.489374 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd6681-c504-4f77-8dc6-860af8ded845 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:22.548982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbdd36-6eb6-40af-9d40-4ba100d26eeb None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:22.559776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:22.604522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbaf9a8-32c1-4eb5-bead-ede68a7d868d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:22.605802 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaf9a8-32c1-4eb5-bead-ede68a7d868d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:22.606252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaf9a8-32c1-4eb5-bead-ede68a7d868d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:22.606703 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaf9a8-32c1-4eb5-bead-ede68a7d868d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:22.621328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbaf9a8-32c1-4eb5-bead-ede68a7d868d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:22.623084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbaf9a8-32c1-4eb5-bead-ede68a7d868d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:22.624228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd6681-c504-4f77-8dc6-860af8ded845 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:22.643211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-ccbaf9a8-32c1-4eb5-bead-ede68a7d868d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:22.643211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:22.643211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:22.643211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:22.643211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:22.643211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:22.643211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:22.643211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:22.643211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:22.643211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:22.643211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:22.643211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:22.643211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:22.643211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:22.643211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:22.644193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:22.644193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:22.644193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:22.644193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:22.644193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:22.644193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:22.644193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:22.644193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:22.644193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:22.644193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:22.644193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:22.644193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:22.644193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:22.644193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:22.644193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:22.644193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:22.644193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:22.645517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:22.645517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:22.645517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:22.645517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:22.645517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 306/593] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:22.645517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbaf9a8-32c1-4eb5-bead-ede68a7d868d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:22.659125 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:22.665386 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc1570-c90d-4d52-a13e-87df2823d7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:22.666466 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc1570-c90d-4d52-a13e-87df2823d7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:22.666716 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc1570-c90d-4d52-a13e-87df2823d7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:22.667151 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc1570-c90d-4d52-a13e-87df2823d7b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:22.676297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc1570-c90d-4d52-a13e-87df2823d7b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:22.678134 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc1570-c90d-4d52-a13e-87df2823d7b0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:22.698109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-33fc1570-c90d-4d52-a13e-87df2823d7b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:22.698109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:22.698109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:22.698109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:22.698109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:22.698109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:22.698109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:22.698109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:22.698109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:22.698109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:22.698109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:22.698109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:22.698109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:22.698109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:22.698109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:22.699250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:22.699250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:22.699250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:22.699250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:22.699250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:22.699250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:22.699250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:22.699250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:22.699250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:22.699250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:22.699250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:22.699250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:22.699250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:22.699250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:22.699250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:22.699250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:22.699250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:22.700238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:22.700238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:22.700238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:22.700238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:22.700238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:22.700238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:22.700238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:22.700238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:22.700238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 288/594] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:22.701162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc1570-c90d-4d52-a13e-87df2823d7b0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:22.788669 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbaf9a8-32c1-4eb5-bead-ede68a7d868d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:22.840873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1f86e-7941-4634-81f9-ad67dab126dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:22.842071 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1f86e-7941-4634-81f9-ad67dab126dc None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:22.843019 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1f86e-7941-4634-81f9-ad67dab126dc None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:22.843926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1f86e-7941-4634-81f9-ad67dab126dc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:22.846537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc1570-c90d-4d52-a13e-87df2823d7b0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:22.855093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1f86e-7941-4634-81f9-ad67dab126dc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:22.857565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1f86e-7941-4634-81f9-ad67dab126dc None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:22.867102 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:22.884187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-42b1f86e-7941-4634-81f9-ad67dab126dc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 18 16:51:22.884187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:22.884187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:22.884187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:22.884187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:22.884187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:22.884187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:22.884187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:22.884187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:22.884187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:22.884187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:22.884187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:22.884187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:22.884187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:22.884187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:22.884187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:22.885389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:22.885389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:22.885389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:22.885389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:22.885389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:22.885389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:22.885389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:22.885389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:22.885389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:22.885389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:22.885389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:22.885389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:22.885389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:22.885389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:22.885389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:22.885389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:22.885389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:22.885389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:22.886581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:22.886581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:22.886581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:22.886581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:22.886581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:22.886581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:22.886581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:22.886581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:22.886581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 18 16:51:22.886581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:22.888902 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 307/595] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:22.889983 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1f86e-7941-4634-81f9-ad67dab126dc None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:22.890906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d03336-3740-4c9e-9c02-6142db07f8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:22.891741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d03336-3740-4c9e-9c02-6142db07f8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:22.892119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d03336-3740-4c9e-9c02-6142db07f8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:22.892494 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d03336-3740-4c9e-9c02-6142db07f8b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:22.893500 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d03336-3740-4c9e-9c02-6142db07f8b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:22.894052 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d03336-3740-4c9e-9c02-6142db07f8b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:22.896475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d03336-3740-4c9e-9c02-6142db07f8b6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:22.909568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 289/596] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:22.914246 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d03336-3740-4c9e-9c02-6142db07f8b6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:22.981632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:23.024021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1f86e-7941-4634-81f9-ad67dab126dc None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:23.025427 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d03336-3740-4c9e-9c02-6142db07f8b6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:23.065486 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdf0f9-b463-4d28-90e3-1a3c6747f9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:23.065908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cd755-30c2-45c0-88cc-0d7b2ff21d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:23.066695 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdf0f9-b463-4d28-90e3-1a3c6747f9cf None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:23.066964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cd755-30c2-45c0-88cc-0d7b2ff21d83 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:23.067304 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdf0f9-b463-4d28-90e3-1a3c6747f9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:23.067415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cd755-30c2-45c0-88cc-0d7b2ff21d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:23.067976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cd755-30c2-45c0-88cc-0d7b2ff21d83 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:23.068539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdf0f9-b463-4d28-90e3-1a3c6747f9cf None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:23.069612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdf0f9-b463-4d28-90e3-1a3c6747f9cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:23.070141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdf0f9-b463-4d28-90e3-1a3c6747f9cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:23.071201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064cd755-30c2-45c0-88cc-0d7b2ff21d83 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:23.071633 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064cd755-30c2-45c0-88cc-0d7b2ff21d83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:23.072364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdf0f9-b463-4d28-90e3-1a3c6747f9cf None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:23.073341 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064cd755-30c2-45c0-88cc-0d7b2ff21d83 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:23.087702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 308/597] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:23.088832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdf0f9-b463-4d28-90e3-1a3c6747f9cf None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:23.101744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 290/598] 10.222.0.49 () {56 vars in 1139 bytes} [Wed May 18 16:51:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:23.103015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cd755-30c2-45c0-88cc-0d7b2ff21d83 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:23.144739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:23.206683 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdf0f9-b463-4d28-90e3-1a3c6747f9cf None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:23.221108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cd755-30c2-45c0-88cc-0d7b2ff21d83 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:23.236690 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:23.247466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a58812-0282-4b16-899e-2ce1962884a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:23.248515 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a58812-0282-4b16-899e-2ce1962884a1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:23.248981 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a58812-0282-4b16-899e-2ce1962884a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:23.249401 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a58812-0282-4b16-899e-2ce1962884a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:23.257455 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a58812-0282-4b16-899e-2ce1962884a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:23.259139 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a58812-0282-4b16-899e-2ce1962884a1 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:23.260788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184de059-103b-4276-b357-6d23a027d4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:23.261824 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184de059-103b-4276-b357-6d23a027d4e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:23.262211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184de059-103b-4276-b357-6d23a027d4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:23.262610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184de059-103b-4276-b357-6d23a027d4e4 None admin] PATH_INFO: `/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/0d69d99d980744fba12a6b38586e7bf3/roles/c6328736ee34470cb87aa31dea4530bf` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:23.276016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-51a58812-0282-4b16-899e-2ce1962884a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:23.276016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:23.276016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:23.276016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:23.276016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:23.276016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:23.276016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:23.276016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:23.276016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:23.276016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:23.276016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:23.276016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:23.276016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:23.276016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:23.276016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:23.277140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:23.277140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:23.277140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:23.277140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:23.277140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:23.277140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:23.277140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:23.277140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:23.277140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:23.277140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:23.277140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:23.277140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:23.277140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:23.277140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:23.277140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:23.277140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:23.277140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:23.278209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:23.278209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:23.278209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:23.278209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:23.278209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:23.278209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:23.278209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:23.278209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:23.279237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184de059-103b-4276-b357-6d23a027d4e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcd3afbb3e384cb2939647002c60bbba, user_id=0d69d99d980744fba12a6b38586e7bf3, role_id=c6328736ee34470cb87aa31dea4530bf)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:23.284978 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184de059-103b-4276-b357-6d23a027d4e4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:23.285140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 309/599] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:23.285140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a58812-0282-4b16-899e-2ce1962884a1 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:23.296066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 291/600] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:51:23 2022] PUT /identity/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/0d69d99d980744fba12a6b38586e7bf3/roles/c6328736ee34470cb87aa31dea4530bf => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:51:23.299068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610a274-b8fe-48aa-ab81-c2561dcbab15 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:23.299353 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610a274-b8fe-48aa-ab81-c2561dcbab15 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:23.299633 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610a274-b8fe-48aa-ab81-c2561dcbab15 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:23.301282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 292/601] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:23.303298 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610a274-b8fe-48aa-ab81-c2561dcbab15 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:23.420195 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a58812-0282-4b16-899e-2ce1962884a1 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:23.456838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:23.465375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6ca1e-8095-45a9-a947-9c138de6812d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:23.466240 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ca1e-8095-45a9-a947-9c138de6812d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:23.466534 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ca1e-8095-45a9-a947-9c138de6812d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:23.466813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ca1e-8095-45a9-a947-9c138de6812d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:23.479514 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6ca1e-8095-45a9-a947-9c138de6812d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:23.480992 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6ca1e-8095-45a9-a947-9c138de6812d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:23.484320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610a274-b8fe-48aa-ab81-c2561dcbab15 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:23.506513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-0ba6ca1e-8095-45a9-a947-9c138de6812d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:23.506513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:23.506513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:23.506513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:23.506513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:23.506513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:23.506513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:23.506513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:23.506513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:23.506513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:23.506513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:23.506513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:23.506513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:23.506513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:23.506513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:23.507605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:23.507605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:23.507605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:23.507605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:23.507605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:23.507605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:23.507605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:23.507605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:23.507605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:23.507605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:23.507605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:23.507605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:23.507605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:23.507605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:23.507605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:23.507605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:23.507605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:23.508513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:23.508513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:23.508513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:23.508513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:23.508513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 310/602] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:23.510170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e8489-5886-476f-99db-e5deec442378 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:23.510170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e8489-5886-476f-99db-e5deec442378 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:23.510170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e8489-5886-476f-99db-e5deec442378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:23.529611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d25e8489-5886-476f-99db-e5deec442378 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:23.531209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d25e8489-5886-476f-99db-e5deec442378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:23.535605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a31fd-c912-4ebf-8609-8222ec86720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:23.536273 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a31fd-c912-4ebf-8609-8222ec86720c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:23.537226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a31fd-c912-4ebf-8609-8222ec86720c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:23.537504 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a31fd-c912-4ebf-8609-8222ec86720c None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:23.538420 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a31fd-c912-4ebf-8609-8222ec86720c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:23.538735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a31fd-c912-4ebf-8609-8222ec86720c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:23.540279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a31fd-c912-4ebf-8609-8222ec86720c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:23.557516 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 293/603] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:23.558647 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a31fd-c912-4ebf-8609-8222ec86720c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:23.578257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:23.629685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 311/604] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:23.629685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e8489-5886-476f-99db-e5deec442378 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:23.720411 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a31fd-c912-4ebf-8609-8222ec86720c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:23.737015 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e8489-5886-476f-99db-e5deec442378 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:23.761135 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05271d-0f05-48e6-9ab9-8b42473e6967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:23.762253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05271d-0f05-48e6-9ab9-8b42473e6967 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:23.762693 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05271d-0f05-48e6-9ab9-8b42473e6967 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:23.763219 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05271d-0f05-48e6-9ab9-8b42473e6967 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:23.764120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05271d-0f05-48e6-9ab9-8b42473e6967 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:23.764610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05271d-0f05-48e6-9ab9-8b42473e6967 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:23.766404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05271d-0f05-48e6-9ab9-8b42473e6967 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:23.776732 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f233d-3b53-4edc-a0b4-ac7b01513e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:23.777638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f233d-3b53-4edc-a0b4-ac7b01513e65 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:23.777969 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f233d-3b53-4edc-a0b4-ac7b01513e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:23.778252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f233d-3b53-4edc-a0b4-ac7b01513e65 None admin] PATH_INFO: `/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/102a6c55061040129802a9739f43036a/roles/c6328736ee34470cb87aa31dea4530bf` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:23.788654 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 294/605] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:23.789929 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05271d-0f05-48e6-9ab9-8b42473e6967 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:23.794225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:23.798739 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f233d-3b53-4edc-a0b4-ac7b01513e65 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcd3afbb3e384cb2939647002c60bbba, user_id=102a6c55061040129802a9739f43036a, role_id=c6328736ee34470cb87aa31dea4530bf)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:23.800232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7f233d-3b53-4edc-a0b4-ac7b01513e65 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:23.824530 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 312/606] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:51:23 2022] PUT /identity/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/102a6c55061040129802a9739f43036a/roles/c6328736ee34470cb87aa31dea4530bf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:51:23.824530 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f233d-3b53-4edc-a0b4-ac7b01513e65 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:23.848073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:23.979612 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05271d-0f05-48e6-9ab9-8b42473e6967 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:24.023106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7225633-70ff-4591-82ca-5349f501f889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:24.024232 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7225633-70ff-4591-82ca-5349f501f889 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:24.024629 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7225633-70ff-4591-82ca-5349f501f889 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:24.025016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7225633-70ff-4591-82ca-5349f501f889 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:24.038525 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7225633-70ff-4591-82ca-5349f501f889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:24.047637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a7225633-70ff-4591-82ca-5349f501f889 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:24.047637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:24.047637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:24.047637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:24.047637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:24.047637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:24.047637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:24.047637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:24.047637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:24.047637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:24.047637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:24.047637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:24.047637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:24.047637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:24.047637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:24.047637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:24.048876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:24.048876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:24.048876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:24.048876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:24.048876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:24.048876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:24.048876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:24.048876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:24.048876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:24.048876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:24.048876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:24.048876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:24.048876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:24.048876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:24.048876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:24.048876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:24.049904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:24.049904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:24.049904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:24.049904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:24.049904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:24.049904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:24.049904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:24.049904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:24.049904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:24.049904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:24.049904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:24.049904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:24.051228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 295/607] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:24.060141 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7225633-70ff-4591-82ca-5349f501f889 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:24.061439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7f233d-3b53-4edc-a0b4-ac7b01513e65 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:24.126744 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99c207-7ecd-4410-8bf8-b4b27ce731c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:24.127607 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99c207-7ecd-4410-8bf8-b4b27ce731c2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:24.127941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99c207-7ecd-4410-8bf8-b4b27ce731c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:24.128228 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99c207-7ecd-4410-8bf8-b4b27ce731c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:24.138469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99c207-7ecd-4410-8bf8-b4b27ce731c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:24.139950 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99c207-7ecd-4410-8bf8-b4b27ce731c2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:24.148342 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:24.158420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-fe99c207-7ecd-4410-8bf8-b4b27ce731c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:24.158420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:24.158420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:24.158420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:24.158420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:24.158420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:24.158420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:24.158420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:24.158420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:24.158420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:24.158420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:24.158420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:24.158420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:24.158420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:24.158420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:24.159388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:24.159388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:24.159388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:24.159388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:24.159388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:24.159388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:24.159388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:24.159388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:24.159388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:24.159388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:24.159388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:24.159388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:24.159388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:24.159388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:24.159388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:24.159388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:24.159388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:24.160383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:24.160383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:24.160383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:24.160383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:24.160383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:24.160383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:24.160383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:24.160383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:24.164062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 313/608] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:24.174225 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99c207-7ecd-4410-8bf8-b4b27ce731c2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:24.193827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7225633-70ff-4591-82ca-5349f501f889 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:24.237765 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80691fb-cbfa-43a6-be73-5fb190b5b2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:24.237765 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80691fb-cbfa-43a6-be73-5fb190b5b2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:24.237765 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80691fb-cbfa-43a6-be73-5fb190b5b2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:24.237765 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80691fb-cbfa-43a6-be73-5fb190b5b2d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:24.238160 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80691fb-cbfa-43a6-be73-5fb190b5b2d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:24.238160 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80691fb-cbfa-43a6-be73-5fb190b5b2d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:24.238160 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80691fb-cbfa-43a6-be73-5fb190b5b2d8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:24.248086 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 296/609] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:51:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:24.253420 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80691fb-cbfa-43a6-be73-5fb190b5b2d8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:24.339616 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:24.394975 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80691fb-cbfa-43a6-be73-5fb190b5b2d8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:24.408075 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99c207-7ecd-4410-8bf8-b4b27ce731c2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:24.425818 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:24.437284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1287835-2b5a-4580-9bd9-93e2020e7b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:24.438468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1287835-2b5a-4580-9bd9-93e2020e7b85 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:24.438963 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1287835-2b5a-4580-9bd9-93e2020e7b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:24.439471 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1287835-2b5a-4580-9bd9-93e2020e7b85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:24.452304 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1287835-2b5a-4580-9bd9-93e2020e7b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:24.454181 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1287835-2b5a-4580-9bd9-93e2020e7b85 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:24.473715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e1287835-2b5a-4580-9bd9-93e2020e7b85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:24.473715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:24.473715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:24.473715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:24.473715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:24.473715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:24.473715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:24.473715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:24.473715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:24.473715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:24.473715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:24.473715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:24.473715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:24.473715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:24.473715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:24.475646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:24.475646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:24.475646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:24.475646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:24.475646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:24.475646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:24.475646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:24.475646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:24.475646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:24.475646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:24.475646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:24.475646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:24.475646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:24.475646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:24.475646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:24.475646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:24.475646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:24.476528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:24.476528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:24.476528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:24.476528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:24.478911 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 297/610] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:24.484742 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1287835-2b5a-4580-9bd9-93e2020e7b85 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:24.502731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296a60b-37be-4349-a55d-f264bffe3f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:24.504136 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296a60b-37be-4349-a55d-f264bffe3f4f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:24.504653 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296a60b-37be-4349-a55d-f264bffe3f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:24.505702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296a60b-37be-4349-a55d-f264bffe3f4f None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:24.506947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296a60b-37be-4349-a55d-f264bffe3f4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:24.508787 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296a60b-37be-4349-a55d-f264bffe3f4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:24.510205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296a60b-37be-4349-a55d-f264bffe3f4f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:24.543236 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 314/611] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:24.546440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296a60b-37be-4349-a55d-f264bffe3f4f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:24.709579 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1287835-2b5a-4580-9bd9-93e2020e7b85 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:24.756645 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296a60b-37be-4349-a55d-f264bffe3f4f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:24.764942 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2429d-20a3-4afa-a2ec-ba4806dbaa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:24.765495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2429d-20a3-4afa-a2ec-ba4806dbaa8f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:24.765717 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2429d-20a3-4afa-a2ec-ba4806dbaa8f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:24.765969 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2429d-20a3-4afa-a2ec-ba4806dbaa8f None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:24.766704 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2429d-20a3-4afa-a2ec-ba4806dbaa8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:24.767076 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2429d-20a3-4afa-a2ec-ba4806dbaa8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:24.768657 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2429d-20a3-4afa-a2ec-ba4806dbaa8f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:24.782349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 298/612] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:24.791454 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2429d-20a3-4afa-a2ec-ba4806dbaa8f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:24.810113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e92128-5c3d-4ea8-8be8-f28cc56da69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:24.811396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e92128-5c3d-4ea8-8be8-f28cc56da69f None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:24.811914 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e92128-5c3d-4ea8-8be8-f28cc56da69f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:24.812396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e92128-5c3d-4ea8-8be8-f28cc56da69f None admin] PATH_INFO: `/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/d35f21c5cc7c433882eb5fbe9a8072f6/roles/c6328736ee34470cb87aa31dea4530bf` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:24.832604 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:24.846469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e92128-5c3d-4ea8-8be8-f28cc56da69f None admin] RBAC: Authorizing `identity:create_grant(project_id=fcd3afbb3e384cb2939647002c60bbba, user_id=d35f21c5cc7c433882eb5fbe9a8072f6, role_id=c6328736ee34470cb87aa31dea4530bf)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:24.848598 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e92128-5c3d-4ea8-8be8-f28cc56da69f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:24.874171 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 315/613] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:51:24 2022] PUT /identity/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/d35f21c5cc7c433882eb5fbe9a8072f6/roles/c6328736ee34470cb87aa31dea4530bf => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:51:24.877235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:24.918455 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b667f-6535-40f2-9079-0e1b86e9c516 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:24.919122 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b667f-6535-40f2-9079-0e1b86e9c516 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:24.919608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b667f-6535-40f2-9079-0e1b86e9c516 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:24.921297 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 316/614] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:51:24.927551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489ba0e-81c1-433f-b9fa-ce0b1851fddc None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:24.927861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489ba0e-81c1-433f-b9fa-ce0b1851fddc None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:24.928107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489ba0e-81c1-433f-b9fa-ce0b1851fddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:24.948758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6489ba0e-81c1-433f-b9fa-ce0b1851fddc None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:24.950047 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6489ba0e-81c1-433f-b9fa-ce0b1851fddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:24.992957 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2429d-20a3-4afa-a2ec-ba4806dbaa8f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:25.033440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa10c5f-4782-43f4-96ab-db01d71ddad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:25.034675 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa10c5f-4782-43f4-96ab-db01d71ddad1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:25.035176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa10c5f-4782-43f4-96ab-db01d71ddad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:25.035681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa10c5f-4782-43f4-96ab-db01d71ddad1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:25.044768 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa10c5f-4782-43f4-96ab-db01d71ddad1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:25.046853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa10c5f-4782-43f4-96ab-db01d71ddad1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:25.074951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-4fa10c5f-4782-43f4-96ab-db01d71ddad1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 16:51:25.074951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:25.074951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:25.074951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:25.074951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:25.074951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:25.074951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:25.074951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:25.074951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:25.074951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:25.074951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:25.074951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:25.074951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:25.074951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:25.074951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:25.074951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:25.075954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:25.075954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:25.075954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:25.075954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:25.075954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:25.075954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:25.075954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:25.075954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:25.075954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:25.075954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:25.075954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:25.075954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:25.075954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:25.075954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:25.075954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:25.075954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:25.075954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:25.075954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:25.076897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:25.076897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:25.076897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:25.076897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:25.076897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:25.076897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:25.076897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:25.076897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:25.076897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 16:51:25.076897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:25.079556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 299/615] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:51:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:25.087786 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa10c5f-4782-43f4-96ab-db01d71ddad1 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:25.112739 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 317/616] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:51:25.141432 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489ba0e-81c1-433f-b9fa-ce0b1851fddc None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:25.284990 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:25.295372 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa10c5f-4782-43f4-96ab-db01d71ddad1 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:25.356945 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489ba0e-81c1-433f-b9fa-ce0b1851fddc None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:25.377861 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de54301-111d-44d0-80c9-2aa3a220dcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:25.378750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:25.378864 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de54301-111d-44d0-80c9-2aa3a220dcce None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:25.379596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de54301-111d-44d0-80c9-2aa3a220dcce None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:25.379884 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de54301-111d-44d0-80c9-2aa3a220dcce None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:25.381322 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de54301-111d-44d0-80c9-2aa3a220dcce None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:25.381637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de54301-111d-44d0-80c9-2aa3a220dcce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:25.383151 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de54301-111d-44d0-80c9-2aa3a220dcce None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:25.403768 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d74fe6-4a82-42b1-8bed-5dda4929a428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:25.404979 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d74fe6-4a82-42b1-8bed-5dda4929a428 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:25.405490 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d74fe6-4a82-42b1-8bed-5dda4929a428 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:25.405985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d74fe6-4a82-42b1-8bed-5dda4929a428 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:25.406091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 300/617] 10.222.0.49 () {56 vars in 1135 bytes} [Wed May 18 16:51:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:25.415056 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de54301-111d-44d0-80c9-2aa3a220dcce None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:25.419959 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d74fe6-4a82-42b1-8bed-5dda4929a428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:25.436676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-46d74fe6-4a82-42b1-8bed-5dda4929a428 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:25.436676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:25.436676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:25.436676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:25.436676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:25.436676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:25.436676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:25.436676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:25.436676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:25.436676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:25.436676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:25.436676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:25.436676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:25.436676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:25.436676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:25.436676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:25.438872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:25.438872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:25.438872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:25.438872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:25.438872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:25.438872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:25.438872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:25.438872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:25.438872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:25.438872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:25.438872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:25.438872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:25.438872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:25.438872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:25.438872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:25.438872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:25.440363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:25.440363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:25.440363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:25.440363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:25.440363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:25.440363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:25.440363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:25.440363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:25.440363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:25.440363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:25.440363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:25.440363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:25.446669 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 318/618] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:25.454287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d74fe6-4a82-42b1-8bed-5dda4929a428 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:25.601437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d74fe6-4a82-42b1-8bed-5dda4929a428 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:25.666405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468be1f2-fe99-4aeb-988d-127e7faa952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:25.667105 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468be1f2-fe99-4aeb-988d-127e7faa952b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:25.667395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468be1f2-fe99-4aeb-988d-127e7faa952b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:25.667676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468be1f2-fe99-4aeb-988d-127e7faa952b None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:25.668441 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468be1f2-fe99-4aeb-988d-127e7faa952b None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:25.668751 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468be1f2-fe99-4aeb-988d-127e7faa952b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:25.670186 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468be1f2-fe99-4aeb-988d-127e7faa952b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:25.680560 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de54301-111d-44d0-80c9-2aa3a220dcce None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:25.689869 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 319/619] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:51:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:25.710838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468be1f2-fe99-4aeb-988d-127e7faa952b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:25.740779 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ce349-45cc-47a5-ad1e-542127e057b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:25.741646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ce349-45cc-47a5-ad1e-542127e057b7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:25.741958 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ce349-45cc-47a5-ad1e-542127e057b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:25.742235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ce349-45cc-47a5-ad1e-542127e057b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:25.766649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ce349-45cc-47a5-ad1e-542127e057b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:25.768131 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ce349-45cc-47a5-ad1e-542127e057b7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:25.796142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-6e9ce349-45cc-47a5-ad1e-542127e057b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:25.796142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:25.796142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:25.796142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:25.796142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:25.796142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:25.796142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:25.796142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:25.796142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:25.796142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:25.796142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:25.796142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:25.796142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:25.796142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:25.796142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:25.797121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:25.797121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:25.797121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:25.797121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:25.797121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:25.797121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:25.797121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:25.797121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:25.797121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:25.797121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:25.797121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:25.797121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:25.797121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:25.797121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:25.797121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:25.797121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:25.797121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:25.798016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:25.798016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:25.798016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:25.798016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:25.798016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 301/620] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:25.803544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ce349-45cc-47a5-ad1e-542127e057b7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:25.822025 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:25.823587 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:25.931827 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468be1f2-fe99-4aeb-988d-127e7faa952b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:25.983769 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68fe94-00ea-450e-a066-89331d6143de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:25.984583 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68fe94-00ea-450e-a066-89331d6143de None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:25.984864 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68fe94-00ea-450e-a066-89331d6143de None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:25.985138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68fe94-00ea-450e-a066-89331d6143de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:26.000778 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ce349-45cc-47a5-ad1e-542127e057b7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:26.019661 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68fe94-00ea-450e-a066-89331d6143de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:26.021031 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68fe94-00ea-450e-a066-89331d6143de None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:26.049578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-ea68fe94-00ea-450e-a066-89331d6143de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:26.049578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:26.049578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:26.049578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:26.049578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:26.049578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:26.049578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:26.049578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:26.049578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:26.049578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:26.049578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:26.049578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:26.049578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:26.049578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:26.049578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:26.050563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:26.050563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:26.050563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:26.050563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:26.050563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:26.050563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:26.050563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:26.050563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:26.050563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:26.050563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:26.050563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:26.050563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:26.050563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:26.050563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:26.050563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:26.050563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:26.050563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:26.051440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:26.051440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:26.051440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:26.051440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:26.053139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be38ab5-da06-473e-a3a4-950e80c13aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:26.054117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be38ab5-da06-473e-a3a4-950e80c13aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:26.054603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be38ab5-da06-473e-a3a4-950e80c13aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:26.055508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be38ab5-da06-473e-a3a4-950e80c13aa3 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:26.056463 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be38ab5-da06-473e-a3a4-950e80c13aa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:26.056993 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be38ab5-da06-473e-a3a4-950e80c13aa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:26.058655 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be38ab5-da06-473e-a3a4-950e80c13aa3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:26.068870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 320/621] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:26.076305 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68fe94-00ea-450e-a066-89331d6143de None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:26.077051 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 302/622] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:26.080998 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be38ab5-da06-473e-a3a4-950e80c13aa3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:26.187833 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:26.237413 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be38ab5-da06-473e-a3a4-950e80c13aa3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:26.238017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:26.251220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68fe94-00ea-450e-a066-89331d6143de None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:26.296459 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c528d2-e661-47b2-9b86-95d1e09ab28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:26.297358 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73a41c-31a4-4072-b3a1-f3ad742c1b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:26.297613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c528d2-e661-47b2-9b86-95d1e09ab28e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:26.298065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c528d2-e661-47b2-9b86-95d1e09ab28e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:26.298501 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73a41c-31a4-4072-b3a1-f3ad742c1b0f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:26.298632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c528d2-e661-47b2-9b86-95d1e09ab28e None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:26.299119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73a41c-31a4-4072-b3a1-f3ad742c1b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:26.299494 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73a41c-31a4-4072-b3a1-f3ad742c1b0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:26.299806 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c528d2-e661-47b2-9b86-95d1e09ab28e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:26.300254 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c528d2-e661-47b2-9b86-95d1e09ab28e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:26.302272 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c528d2-e661-47b2-9b86-95d1e09ab28e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:26.308675 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73a41c-31a4-4072-b3a1-f3ad742c1b0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:26.310351 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73a41c-31a4-4072-b3a1-f3ad742c1b0f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:26.318245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 321/623] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:26.319844 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd0ad4-e9c7-4103-9b65-ebcdbb8169dc None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:26.320279 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd0ad4-e9c7-4103-9b65-ebcdbb8169dc None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:26.320721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd0ad4-e9c7-4103-9b65-ebcdbb8169dc None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:26.322417 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 322/624] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:26.323245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd0ad4-e9c7-4103-9b65-ebcdbb8169dc None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:26.330038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-4f73a41c-31a4-4072-b3a1-f3ad742c1b0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:26.330038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:26.330038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:26.330038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:26.330038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:26.330038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:26.330038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:26.330038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:26.330038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:26.330038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:26.330038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:26.330038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:26.330038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:26.330038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:26.330038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:26.331335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:26.331335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:26.331335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:26.331335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:26.331335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:26.331335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:26.331335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:26.331335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:26.331335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:26.331335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:26.331335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:26.331335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:26.331335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:26.331335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:26.331335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:26.331335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:26.331335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:26.332394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:26.332394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:26.332394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:26.332394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:26.332394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:26.332394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:26.332394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:26.332394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:26.335167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 303/625] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:26.336608 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e244c0-cf4f-4bd2-97d3-b00d5bf24e73 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:26.337072 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e244c0-cf4f-4bd2-97d3-b00d5bf24e73 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:26.337344 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e244c0-cf4f-4bd2-97d3-b00d5bf24e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:26.358034 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-44e244c0-cf4f-4bd2-97d3-b00d5bf24e73 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:26.359238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-44e244c0-cf4f-4bd2-97d3-b00d5bf24e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:26.440617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 304/626] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:26.441877 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e244c0-cf4f-4bd2-97d3-b00d5bf24e73 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:26.461169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd0ad4-e9c7-4103-9b65-ebcdbb8169dc None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:26.501111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb5c28-3f3d-429d-a9f4-99a5fe05b30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:26.501970 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb5c28-3f3d-429d-a9f4-99a5fe05b30d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:26.502254 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb5c28-3f3d-429d-a9f4-99a5fe05b30d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:26.502560 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb5c28-3f3d-429d-a9f4-99a5fe05b30d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:26.512079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb5c28-3f3d-429d-a9f4-99a5fe05b30d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:26.513912 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb5c28-3f3d-429d-a9f4-99a5fe05b30d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:26.522030 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:26.531554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-ccdb5c28-3f3d-429d-a9f4-99a5fe05b30d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 16:51:26.531554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:26.531554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:26.531554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:26.531554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:26.531554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:26.531554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:26.531554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:26.531554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:26.531554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:26.531554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:26.531554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:26.531554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:26.531554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:26.531554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:26.531554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:26.532596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:26.532596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:26.532596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:26.532596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:26.532596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:26.532596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:26.532596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:26.532596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:26.532596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:26.532596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:26.532596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:26.532596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:26.532596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:26.532596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:26.532596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:26.532596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:26.532596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:26.532596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:26.533565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:26.533565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:26.533565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:26.533565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:26.533565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:26.533565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:26.533565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:26.533565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:26.533565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 16:51:26.533565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:26.533565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 323/627] 10.222.0.49 () {56 vars in 1093 bytes} [Wed May 18 16:51:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:26.534790 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb5c28-3f3d-429d-a9f4-99a5fe05b30d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:26.557086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:26.581958 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e244c0-cf4f-4bd2-97d3-b00d5bf24e73 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:26.623652 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde24d69-db87-4690-9e29-9feedb09e0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:26.624493 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde24d69-db87-4690-9e29-9feedb09e0ec None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:26.624878 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde24d69-db87-4690-9e29-9feedb09e0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:26.625259 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde24d69-db87-4690-9e29-9feedb09e0ec None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:26.626482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde24d69-db87-4690-9e29-9feedb09e0ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:26.626794 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde24d69-db87-4690-9e29-9feedb09e0ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:26.628255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde24d69-db87-4690-9e29-9feedb09e0ec None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:26.646011 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 305/628] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:26.646774 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde24d69-db87-4690-9e29-9feedb09e0ec None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:26.669114 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb5c28-3f3d-429d-a9f4-99a5fe05b30d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:26.713444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961e5bb-76e4-4915-8213-68c0f94efb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:26.714210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961e5bb-76e4-4915-8213-68c0f94efb83 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:26.714577 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961e5bb-76e4-4915-8213-68c0f94efb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:26.714883 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961e5bb-76e4-4915-8213-68c0f94efb83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:26.726894 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961e5bb-76e4-4915-8213-68c0f94efb83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:26.734685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-0961e5bb-76e4-4915-8213-68c0f94efb83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:26.734685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:26.734685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:26.734685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:26.734685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:26.734685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:26.734685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:26.734685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:26.734685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:26.734685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:26.734685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:26.734685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:26.734685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:26.734685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:26.734685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:26.734685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:26.735782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:26.735782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:26.735782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:26.735782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:26.735782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:26.735782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:26.735782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:26.735782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:26.735782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:26.735782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:26.735782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:26.735782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:26.735782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:26.735782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:26.735782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:26.735782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:26.737920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:26.737920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:26.737920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:26.737920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:26.737920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:26.737920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:26.737920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:26.737920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:26.737920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:26.737920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:26.737920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:26.737920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:26.737920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 324/629] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:26.737920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aa28c-82f1-4e82-8be2-e5103b15fa42 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:26.738670 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aa28c-82f1-4e82-8be2-e5103b15fa42 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:26.738670 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aa28c-82f1-4e82-8be2-e5103b15fa42 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:26.739908 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 325/630] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:26.740521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3aa28c-82f1-4e82-8be2-e5103b15fa42 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:26.787046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde24d69-db87-4690-9e29-9feedb09e0ec None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:26.807462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:26.820667 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:26.834545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d081f9d-9d17-4119-bede-3152ca1a7172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:26.835699 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d081f9d-9d17-4119-bede-3152ca1a7172 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:26.836256 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d081f9d-9d17-4119-bede-3152ca1a7172 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:26.836538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d081f9d-9d17-4119-bede-3152ca1a7172 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:26.837568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d081f9d-9d17-4119-bede-3152ca1a7172 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:26.837902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d081f9d-9d17-4119-bede-3152ca1a7172 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:26.839676 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d081f9d-9d17-4119-bede-3152ca1a7172 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:26.854958 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3aa28c-82f1-4e82-8be2-e5103b15fa42 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:26.866180 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 306/631] 10.222.0.49 () {56 vars in 1133 bytes} [Wed May 18 16:51:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:26.866180 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d081f9d-9d17-4119-bede-3152ca1a7172 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:26.903719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4d699-6c63-45c6-ae28-68c658c108cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:26.904637 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4d699-6c63-45c6-ae28-68c658c108cd None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:26.904915 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4d699-6c63-45c6-ae28-68c658c108cd None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:26.905179 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4d699-6c63-45c6-ae28-68c658c108cd None admin] PATH_INFO: `/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/b712c7f5fce54fe2a89d63863f3845f0/roles/c6328736ee34470cb87aa31dea4530bf` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:26.923271 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4d699-6c63-45c6-ae28-68c658c108cd None admin] RBAC: Authorizing `identity:create_grant(project_id=fcd3afbb3e384cb2939647002c60bbba, user_id=b712c7f5fce54fe2a89d63863f3845f0, role_id=c6328736ee34470cb87aa31dea4530bf)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:26.924763 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4d699-6c63-45c6-ae28-68c658c108cd None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:26.943203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 326/632] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:51:26 2022] PUT /identity/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/b712c7f5fce54fe2a89d63863f3845f0/roles/c6328736ee34470cb87aa31dea4530bf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:51:26.944612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa32ae7-6f96-43fd-9ce2-7057e82bd0f5 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:26.944959 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa32ae7-6f96-43fd-9ce2-7057e82bd0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:26.945301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa32ae7-6f96-43fd-9ce2-7057e82bd0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:26.970093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-bfa32ae7-6f96-43fd-9ce2-7057e82bd0f5 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:26.971333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bfa32ae7-6f96-43fd-9ce2-7057e82bd0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:27.035017 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d081f9d-9d17-4119-bede-3152ca1a7172 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:27.060376 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 327/633] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:27.061511 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa32ae7-6f96-43fd-9ce2-7057e82bd0f5 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:27.094873 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2ddfe-8428-47ea-833f-9aa219b51f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:27.095137 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2ddfe-8428-47ea-833f-9aa219b51f4c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:27.095401 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2ddfe-8428-47ea-833f-9aa219b51f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:27.095809 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2ddfe-8428-47ea-833f-9aa219b51f4c None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:27.096619 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2ddfe-8428-47ea-833f-9aa219b51f4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:27.096933 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2ddfe-8428-47ea-833f-9aa219b51f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:27.098451 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2ddfe-8428-47ea-833f-9aa219b51f4c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:27.109606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 307/634] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:51:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:27.115602 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2ddfe-8428-47ea-833f-9aa219b51f4c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:27.136637 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:27.173822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:27.205429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa32ae7-6f96-43fd-9ce2-7057e82bd0f5 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:27.261374 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68437d9d-074c-400f-8973-aa95a47b6be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:27.262400 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68437d9d-074c-400f-8973-aa95a47b6be3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:27.262842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68437d9d-074c-400f-8973-aa95a47b6be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:27.263280 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68437d9d-074c-400f-8973-aa95a47b6be3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:27.272999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2ddfe-8428-47ea-833f-9aa219b51f4c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:27.331461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6022e1-0974-44ce-9e7f-340c370bf720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:27.332896 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6022e1-0974-44ce-9e7f-340c370bf720 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:27.334335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6022e1-0974-44ce-9e7f-340c370bf720 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:27.334819 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6022e1-0974-44ce-9e7f-340c370bf720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:27.351377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6022e1-0974-44ce-9e7f-340c370bf720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:27.353548 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6022e1-0974-44ce-9e7f-340c370bf720 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:27.359060 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68437d9d-074c-400f-8973-aa95a47b6be3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:27.360618 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68437d9d-074c-400f-8973-aa95a47b6be3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:27.378049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-7d6022e1-0974-44ce-9e7f-340c370bf720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:27.378049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:27.378049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:27.378049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:27.378049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:27.378049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:27.378049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:27.378049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:27.378049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:27.378049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:27.378049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:27.378049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:27.378049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:27.378049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:27.378049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:27.379207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:27.379207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:27.379207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:27.379207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:27.379207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:27.379207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:27.379207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:27.379207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:27.379207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:27.379207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:27.379207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:27.379207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:27.379207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:27.379207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:27.379207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:27.379207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:27.379207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:27.381103 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:27.381103 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:27.381103 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:27.381103 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:27.385571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 308/635] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:27.387178 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6022e1-0974-44ce-9e7f-340c370bf720 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:27.443461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:27.514127 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 328/636] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:51:27.515017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68437d9d-074c-400f-8973-aa95a47b6be3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:27.532408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:27.544762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6022e1-0974-44ce-9e7f-340c370bf720 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:27.586958 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f4e90-0f30-42a4-b7bc-58e78acffd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:27.588011 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f4e90-0f30-42a4-b7bc-58e78acffd60 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:27.588525 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f4e90-0f30-42a4-b7bc-58e78acffd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:27.589110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f4e90-0f30-42a4-b7bc-58e78acffd60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:27.601851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f4e90-0f30-42a4-b7bc-58e78acffd60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:27.609839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1a0f4e90-0f30-42a4-b7bc-58e78acffd60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:27.609839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:27.609839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:27.609839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:27.609839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:27.609839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:27.609839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:27.609839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:27.609839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:27.609839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:27.609839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:27.609839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:27.609839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:27.609839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:27.609839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:27.609839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:27.611069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:27.611069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:27.611069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:27.611069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:27.611069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:27.611069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:27.611069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:27.611069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:27.611069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:27.611069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:27.611069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:27.611069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:27.611069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:27.611069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:27.611069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:27.611069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:27.611953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:27.611953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:27.611953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:27.611953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:27.611953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:27.611953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:27.611953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:27.611953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:27.611953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:27.611953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:27.611953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:27.611953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:27.611953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 309/637] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:27.612656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926bdd6-2b57-46e8-8663-e686077392e5 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:27.612656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926bdd6-2b57-46e8-8663-e686077392e5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:27.613318 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926bdd6-2b57-46e8-8663-e686077392e5 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:27.614764 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 310/638] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:27.615350 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926bdd6-2b57-46e8-8663-e686077392e5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:27.641742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68437d9d-074c-400f-8973-aa95a47b6be3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:27.691191 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1318ab2-7e92-43b3-a87c-cd4fec8f533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:27.691853 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1318ab2-7e92-43b3-a87c-cd4fec8f533e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:27.692191 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1318ab2-7e92-43b3-a87c-cd4fec8f533e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:27.692404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1318ab2-7e92-43b3-a87c-cd4fec8f533e None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:27.693178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1318ab2-7e92-43b3-a87c-cd4fec8f533e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:27.693488 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1318ab2-7e92-43b3-a87c-cd4fec8f533e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:27.694916 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1318ab2-7e92-43b3-a87c-cd4fec8f533e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:27.712459 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 329/639] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:27.712459 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1318ab2-7e92-43b3-a87c-cd4fec8f533e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:27.728717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:27.738433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926bdd6-2b57-46e8-8663-e686077392e5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:27.778713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f0f00-a236-42be-aaa5-3514dd5e98e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:27.779426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f0f00-a236-42be-aaa5-3514dd5e98e5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:27.779714 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f0f00-a236-42be-aaa5-3514dd5e98e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:27.779999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f0f00-a236-42be-aaa5-3514dd5e98e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:27.792832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f0f00-a236-42be-aaa5-3514dd5e98e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:27.794335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f0f00-a236-42be-aaa5-3514dd5e98e5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:27.815183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ab3f0f00-a236-42be-aaa5-3514dd5e98e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:27.815183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:27.815183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:27.815183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:27.815183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:27.815183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:27.815183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:27.815183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:27.815183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:27.815183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:27.815183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:27.815183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:27.815183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:27.815183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:27.815183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:27.816167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:27.816167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:27.816167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:27.816167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:27.816167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:27.816167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:27.816167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:27.816167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:27.816167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:27.816167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:27.816167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:27.816167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:27.816167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:27.816167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:27.816167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:27.816167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:27.816167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:27.817073 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:27.817073 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:27.817073 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:27.817073 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:27.817073 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 311/640] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:27.818677 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5ffce-96c8-4396-9095-f630151656e0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:27.818954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5ffce-96c8-4396-9095-f630151656e0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:27.819429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5ffce-96c8-4396-9095-f630151656e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:27.824523 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:27.836174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1318ab2-7e92-43b3-a87c-cd4fec8f533e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:27.837837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-59f5ffce-96c8-4396-9095-f630151656e0 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:27.839063 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-59f5ffce-96c8-4396-9095-f630151656e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:27.872351 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc777f2-7735-43a5-b00b-2890213db625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:27.873027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc777f2-7735-43a5-b00b-2890213db625 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:27.873314 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc777f2-7735-43a5-b00b-2890213db625 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:27.873590 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc777f2-7735-43a5-b00b-2890213db625 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:27.874370 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc777f2-7735-43a5-b00b-2890213db625 None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:27.874678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc777f2-7735-43a5-b00b-2890213db625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:27.876055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc777f2-7735-43a5-b00b-2890213db625 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:27.886099 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 330/641] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:51:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:27.887013 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc777f2-7735-43a5-b00b-2890213db625 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:27.918378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 312/642] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:27.919254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5ffce-96c8-4396-9095-f630151656e0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:27.972343 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:28.000467 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc777f2-7735-43a5-b00b-2890213db625 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:28.023811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5ffce-96c8-4396-9095-f630151656e0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:28.035725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd348df-05a8-4d25-9c2f-fcd7ef65dde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:28.037059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd348df-05a8-4d25-9c2f-fcd7ef65dde8 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:28.037342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd348df-05a8-4d25-9c2f-fcd7ef65dde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:28.037618 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd348df-05a8-4d25-9c2f-fcd7ef65dde8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:28.045626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd348df-05a8-4d25-9c2f-fcd7ef65dde8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:28.047109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd348df-05a8-4d25-9c2f-fcd7ef65dde8 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:28.056877 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:28.062708 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d807c7-a660-426e-bde9-64a15a72f8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:28.063636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d807c7-a660-426e-bde9-64a15a72f8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:28.064147 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d807c7-a660-426e-bde9-64a15a72f8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:28.064647 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d807c7-a660-426e-bde9-64a15a72f8e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:28.065350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-6dd348df-05a8-4d25-9c2f-fcd7ef65dde8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 18 16:51:28.065350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:28.065350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:28.065350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:28.065350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:28.065350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:28.065350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:28.065350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:28.065350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:28.065350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:28.065350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:28.065350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:28.065350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:28.065350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:28.065350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:28.065350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:28.066369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:28.066369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:28.066369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:28.066369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:28.066369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:28.066369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:28.066369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:28.066369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:28.066369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:28.066369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:28.066369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:28.066369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:28.066369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:28.066369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:28.066369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:28.066369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:28.066369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:28.066369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:28.067389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:28.067389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:28.067389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:28.067389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:28.067389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:28.067389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:28.067389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:28.067389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:28.067389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 18 16:51:28.067389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:28.067389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 331/643] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:51:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:28.067389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd348df-05a8-4d25-9c2f-fcd7ef65dde8 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:28.070167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d807c7-a660-426e-bde9-64a15a72f8e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:28.070970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d807c7-a660-426e-bde9-64a15a72f8e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:28.073523 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d807c7-a660-426e-bde9-64a15a72f8e1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:28.088289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 313/644] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:28.089346 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d807c7-a660-426e-bde9-64a15a72f8e1 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:28.183786 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd348df-05a8-4d25-9c2f-fcd7ef65dde8 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:28.211650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d807c7-a660-426e-bde9-64a15a72f8e1 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:28.222989 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe5c8c-06e0-490a-9ed6-0415366460e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:28.224647 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe5c8c-06e0-490a-9ed6-0415366460e8 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:28.225030 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe5c8c-06e0-490a-9ed6-0415366460e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:28.225465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe5c8c-06e0-490a-9ed6-0415366460e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:28.227836 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:28.250096 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe5c8c-06e0-490a-9ed6-0415366460e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:28.251583 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe5c8c-06e0-490a-9ed6-0415366460e8 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:28.252450 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae2f41-cddd-4db5-948e-07e7f64fb976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:28.253259 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae2f41-cddd-4db5-948e-07e7f64fb976 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:28.253552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae2f41-cddd-4db5-948e-07e7f64fb976 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:28.253922 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae2f41-cddd-4db5-948e-07e7f64fb976 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:28.265348 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae2f41-cddd-4db5-948e-07e7f64fb976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:28.269942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-25fe5c8c-06e0-490a-9ed6-0415366460e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:28.269942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:28.269942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:28.269942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:28.269942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:28.269942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:28.269942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:28.269942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:28.269942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:28.269942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:28.269942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:28.269942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:28.269942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:28.269942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:28.269942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:28.270897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:28.270897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:28.270897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:28.270897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:28.270897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:28.270897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:28.270897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:28.270897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:28.270897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:28.270897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:28.270897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:28.270897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:28.270897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:28.270897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:28.270897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:28.270897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:28.270897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:28.271955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:28.271955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:28.271955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:28.271955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:28.271955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 332/645] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:28.272657 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe5c8c-06e0-490a-9ed6-0415366460e8 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:28.274749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-40ae2f41-cddd-4db5-948e-07e7f64fb976 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:28.274749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:28.274749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:28.274749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:28.274749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:28.274749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:28.274749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:28.274749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:28.274749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:28.274749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:28.274749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:28.274749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:28.274749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:28.274749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:28.274749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:28.274749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:28.275686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:28.275686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:28.275686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:28.275686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:28.275686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:28.275686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:28.275686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:28.275686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:28.275686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:28.275686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:28.275686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:28.275686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:28.275686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:28.275686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:28.275686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:28.275686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:28.276537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:28.276537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:28.276537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:28.276537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:28.276537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:28.276537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:28.276537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:28.276537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:28.276537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:28.276537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:28.276537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:28.276537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:28.279851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 314/646] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:28.280794 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae2f41-cddd-4db5-948e-07e7f64fb976 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:28.344456 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:28.398603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe5c8c-06e0-490a-9ed6-0415366460e8 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:28.412398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae2f41-cddd-4db5-948e-07e7f64fb976 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:28.437199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb851cf-6faa-4084-bc92-c98c2310794f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:28.438229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb851cf-6faa-4084-bc92-c98c2310794f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:28.438506 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb851cf-6faa-4084-bc92-c98c2310794f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:28.438784 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb851cf-6faa-4084-bc92-c98c2310794f None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:28.439615 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb851cf-6faa-4084-bc92-c98c2310794f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:28.439920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb851cf-6faa-4084-bc92-c98c2310794f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:28.441363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb851cf-6faa-4084-bc92-c98c2310794f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:28.451243 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee51d6-5eae-467f-8dbd-40cb49dcde22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:28.452471 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee51d6-5eae-467f-8dbd-40cb49dcde22 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:28.452995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee51d6-5eae-467f-8dbd-40cb49dcde22 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:28.453279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee51d6-5eae-467f-8dbd-40cb49dcde22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:28.462091 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 333/647] 10.222.0.49 () {56 vars in 1137 bytes} [Wed May 18 16:51:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:28.462379 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee51d6-5eae-467f-8dbd-40cb49dcde22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:28.463461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb851cf-6faa-4084-bc92-c98c2310794f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:28.464025 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee51d6-5eae-467f-8dbd-40cb49dcde22 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:28.481903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1fee51d6-5eae-467f-8dbd-40cb49dcde22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:28.481903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:28.481903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:28.481903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:28.481903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:28.481903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:28.481903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:28.481903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:28.481903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:28.481903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:28.481903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:28.481903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:28.481903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:28.481903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:28.481903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:28.482849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:28.482849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:28.482849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:28.482849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:28.482849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:28.482849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:28.482849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:28.482849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:28.482849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:28.482849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:28.482849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:28.482849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:28.482849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:28.482849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:28.482849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:28.482849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:28.482849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:28.483735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:28.483735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:28.483735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:28.483735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:28.483735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:28.483735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:28.483735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:28.483735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:28.485801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 315/648] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:28.487115 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee51d6-5eae-467f-8dbd-40cb49dcde22 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:28.518108 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:28.577223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb851cf-6faa-4084-bc92-c98c2310794f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:28.601378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee51d6-5eae-467f-8dbd-40cb49dcde22 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:28.615411 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:28.616017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5ecde-5080-4c3e-b13e-f081dfe85142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:28.617086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5ecde-5080-4c3e-b13e-f081dfe85142 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:28.617474 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5ecde-5080-4c3e-b13e-f081dfe85142 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:28.617902 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5ecde-5080-4c3e-b13e-f081dfe85142 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:28.618631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5ecde-5080-4c3e-b13e-f081dfe85142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:28.619140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5ecde-5080-4c3e-b13e-f081dfe85142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:28.620764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5ecde-5080-4c3e-b13e-f081dfe85142 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:28.639681 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 334/649] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:28.639681 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5ecde-5080-4c3e-b13e-f081dfe85142 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:28.641978 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b7899-ee30-4473-9aab-5b815e20381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:28.642728 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b7899-ee30-4473-9aab-5b815e20381c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:28.643176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b7899-ee30-4473-9aab-5b815e20381c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:28.643452 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b7899-ee30-4473-9aab-5b815e20381c None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:28.644212 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b7899-ee30-4473-9aab-5b815e20381c None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:28.644520 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b7899-ee30-4473-9aab-5b815e20381c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:28.645947 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b7899-ee30-4473-9aab-5b815e20381c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:28.658728 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 316/650] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:51:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:28.658728 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b7899-ee30-4473-9aab-5b815e20381c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:28.754995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5ecde-5080-4c3e-b13e-f081dfe85142 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:28.758285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:28.774200 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b7899-ee30-4473-9aab-5b815e20381c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:28.792629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9d0ef-1f35-4bf3-af77-baef8689ed21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:28.793284 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9d0ef-1f35-4bf3-af77-baef8689ed21 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:28.793569 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9d0ef-1f35-4bf3-af77-baef8689ed21 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:28.793876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae9d0ef-1f35-4bf3-af77-baef8689ed21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:28.810775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb98f0-c936-4e11-a302-42fa720d2aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:28.811435 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb98f0-c936-4e11-a302-42fa720d2aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:28.811714 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb98f0-c936-4e11-a302-42fa720d2aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:28.811984 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb98f0-c936-4e11-a302-42fa720d2aa2 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:28.812766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb98f0-c936-4e11-a302-42fa720d2aa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:28.813082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb98f0-c936-4e11-a302-42fa720d2aa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:28.814516 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb98f0-c936-4e11-a302-42fa720d2aa2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:28.833981 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 317/651] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:28.834914 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb98f0-c936-4e11-a302-42fa720d2aa2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:28.870397 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:28.873080 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9d0ef-1f35-4bf3-af77-baef8689ed21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:28.874706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae9d0ef-1f35-4bf3-af77-baef8689ed21 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:28.958191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb98f0-c936-4e11-a302-42fa720d2aa2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:28.995000 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 335/652] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:51:28.996170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9d0ef-1f35-4bf3-af77-baef8689ed21 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:29.001576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:29.003128 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739c711-f150-4678-a35d-ff8486f3ffb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:29.004210 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739c711-f150-4678-a35d-ff8486f3ffb0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:29.004576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739c711-f150-4678-a35d-ff8486f3ffb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:29.005014 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739c711-f150-4678-a35d-ff8486f3ffb0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:29.013426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739c711-f150-4678-a35d-ff8486f3ffb0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:29.014941 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739c711-f150-4678-a35d-ff8486f3ffb0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:29.030835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-7739c711-f150-4678-a35d-ff8486f3ffb0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 18 16:51:29.030835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:29.030835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:29.030835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:29.030835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:29.030835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:29.030835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:29.030835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:29.030835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:29.030835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:29.030835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:29.030835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:29.030835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:29.030835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:29.030835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:29.030835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:29.031867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:29.031867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:29.031867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:29.031867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:29.031867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:29.031867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:29.031867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:29.031867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:29.031867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:29.031867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:29.031867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:29.031867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:29.031867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:29.031867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:29.031867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:29.031867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:29.031867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:29.031867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:29.032823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:29.032823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:29.032823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:29.032823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:29.032823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:29.032823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:29.032823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:29.032823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:29.032823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 18 16:51:29.032823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:29.037312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 318/653] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:51:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:29.038428 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739c711-f150-4678-a35d-ff8486f3ffb0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:29.130786 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae9d0ef-1f35-4bf3-af77-baef8689ed21 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:29.146365 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:29.154544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739c711-f150-4678-a35d-ff8486f3ffb0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:29.172676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b8027-7353-4726-9091-e245e98abc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:29.173568 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b8027-7353-4726-9091-e245e98abc15 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:29.173769 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b8027-7353-4726-9091-e245e98abc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:29.174045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b8027-7353-4726-9091-e245e98abc15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:29.187145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b8027-7353-4726-9091-e245e98abc15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:29.188665 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b8027-7353-4726-9091-e245e98abc15 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:29.195728 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b7b1d-4064-4da5-8fd3-57c3ad0d4341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:29.196413 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b7b1d-4064-4da5-8fd3-57c3ad0d4341 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:29.196694 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b7b1d-4064-4da5-8fd3-57c3ad0d4341 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:29.196965 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b7b1d-4064-4da5-8fd3-57c3ad0d4341 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:29.197970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b7b1d-4064-4da5-8fd3-57c3ad0d4341 None admin] RBAC: Adding query filter params (role.id=c6328736ee34470cb87aa31dea4530bf, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=c9e3c0ef5ed943d183b064f383fc01f3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:29.198276 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b7b1d-4064-4da5-8fd3-57c3ad0d4341 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:29.199772 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b7b1d-4064-4da5-8fd3-57c3ad0d4341 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:29.207192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 319/654] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:51:29 2022] GET /identity/v3/role_assignments?user.id=c9e3c0ef5ed943d183b064f383fc01f3&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=c6328736ee34470cb87aa31dea4530bf => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:29.209505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b7b1d-4064-4da5-8fd3-57c3ad0d4341 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:29.210705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-f27b8027-7353-4726-9091-e245e98abc15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:29.210705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:29.210705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:29.210705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:29.210705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:29.210705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:29.210705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:29.210705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:29.210705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:29.210705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:29.210705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:29.210705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:29.210705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:29.210705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:29.210705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:29.211785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:29.211785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:29.211785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:29.211785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:29.211785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:29.211785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:29.211785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:29.211785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:29.211785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:29.211785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:29.211785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:29.211785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:29.211785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:29.211785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:29.211785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:29.211785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:29.211785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:29.212707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:29.212707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:29.212707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:29.212707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:29.214608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 336/655] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:29.215718 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b8027-7353-4726-9091-e245e98abc15 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:29.288786 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:29.339895 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b7b1d-4064-4da5-8fd3-57c3ad0d4341 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:29.360344 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b8027-7353-4726-9091-e245e98abc15 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:29.382494 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c633e0b-fe03-445c-9a54-b6d07b0b4543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:29.383110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c633e0b-fe03-445c-9a54-b6d07b0b4543 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:29.383392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c633e0b-fe03-445c-9a54-b6d07b0b4543 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:29.383666 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c633e0b-fe03-445c-9a54-b6d07b0b4543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:29.396410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c633e0b-fe03-445c-9a54-b6d07b0b4543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:29.398350 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c633e0b-fe03-445c-9a54-b6d07b0b4543 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:29.413943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367908fd-d1b4-4af1-89e6-31a68aac3088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:29.414929 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367908fd-d1b4-4af1-89e6-31a68aac3088 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:29.415367 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367908fd-d1b4-4af1-89e6-31a68aac3088 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:29.415794 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367908fd-d1b4-4af1-89e6-31a68aac3088 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:29.416816 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367908fd-d1b4-4af1-89e6-31a68aac3088 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:29.417292 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367908fd-d1b4-4af1-89e6-31a68aac3088 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:29.418963 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367908fd-d1b4-4af1-89e6-31a68aac3088 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:29.419284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-5c633e0b-fe03-445c-9a54-b6d07b0b4543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:29.419284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:29.419284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:29.419284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:29.419284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:29.419284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:29.419284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:29.419284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:29.419284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:29.419284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:29.419284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:29.419284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:29.419284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:29.419284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:29.419284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:29.420363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:29.420363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:29.420363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:29.420363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:29.420363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:29.420363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:29.420363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:29.420363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:29.420363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:29.420363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:29.420363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:29.420363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:29.420363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:29.420363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:29.420363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:29.420363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:29.420363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:29.421480 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:29.421480 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:29.421480 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:29.421480 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:29.425465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 320/656] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:29.426319 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c633e0b-fe03-445c-9a54-b6d07b0b4543 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:29.439928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:29.444906 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 337/657] 10.222.0.49 () {56 vars in 1137 bytes} [Wed May 18 16:51:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:29.446220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399bff1b-9f9d-4933-9877-95d22af4bf1d None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:29.446518 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399bff1b-9f9d-4933-9877-95d22af4bf1d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:29.446798 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399bff1b-9f9d-4933-9877-95d22af4bf1d None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:29.448044 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 338/658] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:29.448746 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399bff1b-9f9d-4933-9877-95d22af4bf1d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:29.562139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c633e0b-fe03-445c-9a54-b6d07b0b4543 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:29.572114 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399bff1b-9f9d-4933-9877-95d22af4bf1d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:29.588148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:29.597265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca029c8-fe2c-475e-beed-6bea2bd76069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:29.597961 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca029c8-fe2c-475e-beed-6bea2bd76069 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:29.598357 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca029c8-fe2c-475e-beed-6bea2bd76069 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:29.598632 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca029c8-fe2c-475e-beed-6bea2bd76069 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:29.600482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca029c8-fe2c-475e-beed-6bea2bd76069 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:29.600596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca029c8-fe2c-475e-beed-6bea2bd76069 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:29.601942 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca029c8-fe2c-475e-beed-6bea2bd76069 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:29.610637 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5a3ab-1e80-4e63-9ab0-5c1031bbc735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:29.611312 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5a3ab-1e80-4e63-9ab0-5c1031bbc735 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:29.612441 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5a3ab-1e80-4e63-9ab0-5c1031bbc735 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:29.612441 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5a3ab-1e80-4e63-9ab0-5c1031bbc735 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:29.613304 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5a3ab-1e80-4e63-9ab0-5c1031bbc735 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:29.613304 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5a3ab-1e80-4e63-9ab0-5c1031bbc735 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:29.614443 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5a3ab-1e80-4e63-9ab0-5c1031bbc735 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:29.618231 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 321/659] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:29.619270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca029c8-fe2c-475e-beed-6bea2bd76069 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:29.628107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 339/660] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:29.629382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31710fa2-7a8f-49a9-864d-76b66f88e66b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:29.629719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31710fa2-7a8f-49a9-864d-76b66f88e66b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:29.630617 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31710fa2-7a8f-49a9-864d-76b66f88e66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:29.648390 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-31710fa2-7a8f-49a9-864d-76b66f88e66b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:29.649631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-31710fa2-7a8f-49a9-864d-76b66f88e66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:29.707791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:29.729820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 340/661] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:29.729820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31710fa2-7a8f-49a9-864d-76b66f88e66b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:29.749476 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca029c8-fe2c-475e-beed-6bea2bd76069 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:29.785490 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782886eb-94c4-480f-8fde-663634230cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:29.787021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782886eb-94c4-480f-8fde-663634230cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:29.787635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782886eb-94c4-480f-8fde-663634230cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:29.787941 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782886eb-94c4-480f-8fde-663634230cc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:29.858354 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31710fa2-7a8f-49a9-864d-76b66f88e66b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:29.859926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782886eb-94c4-480f-8fde-663634230cc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:29.861459 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782886eb-94c4-480f-8fde-663634230cc2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:29.861597 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:29.898094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bcc2e-bf29-4af8-9893-3818936ec418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:29.899584 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bcc2e-bf29-4af8-9893-3818936ec418 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:29.899584 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bcc2e-bf29-4af8-9893-3818936ec418 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:29.899584 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bcc2e-bf29-4af8-9893-3818936ec418 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:29.907100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bcc2e-bf29-4af8-9893-3818936ec418 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:29.908594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bcc2e-bf29-4af8-9893-3818936ec418 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:29.923559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-203bcc2e-bf29-4af8-9893-3818936ec418 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 18 16:51:29.923559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:29.923559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:29.923559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:29.923559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:29.923559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:29.923559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:29.923559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:29.923559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:29.923559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:29.923559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:29.923559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:29.923559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:29.923559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:29.923559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:29.923559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:29.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:29.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:29.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:29.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:29.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:29.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:29.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:29.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:29.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:29.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:29.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:29.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:29.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:29.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:29.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:29.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:29.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:29.924625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:29.925572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:29.925572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:29.925572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:29.925572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:29.925572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:29.925572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:29.925572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:29.925572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:29.925572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 18 16:51:29.925572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:29.925572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 341/662] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:29.926230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bcc2e-bf29-4af8-9893-3818936ec418 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:29.946316 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:29.981266 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 322/663] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:51:29.986367 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782886eb-94c4-480f-8fde-663634230cc2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:30.033885 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bcc2e-bf29-4af8-9893-3818936ec418 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:30.074981 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6534fec-b35b-4492-86d7-0fe8946cf39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:30.075804 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6534fec-b35b-4492-86d7-0fe8946cf39a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:30.076085 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6534fec-b35b-4492-86d7-0fe8946cf39a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:30.076418 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6534fec-b35b-4492-86d7-0fe8946cf39a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:30.086076 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6534fec-b35b-4492-86d7-0fe8946cf39a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:30.087555 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6534fec-b35b-4492-86d7-0fe8946cf39a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:30.102007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-d6534fec-b35b-4492-86d7-0fe8946cf39a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:30.102007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:30.102007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:30.102007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:30.102007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:30.102007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:30.102007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:30.102007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:30.102007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:30.102007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:30.102007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:30.102007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:30.102007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:30.102007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:30.102007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:30.103094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:30.103094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:30.103094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:30.103094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:30.103094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:30.103094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:30.103094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:30.103094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:30.103094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:30.103094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:30.103094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:30.103094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:30.103094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:30.103094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:30.103094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:30.103094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:30.103094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:30.104011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:30.104011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:30.104011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:30.104011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:30.104011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:30.104011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:30.104011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:30.104011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:30.104011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 342/664] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:30.104011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6534fec-b35b-4492-86d7-0fe8946cf39a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:30.113093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782886eb-94c4-480f-8fde-663634230cc2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:30.132795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:30.151155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec1183-09af-437c-83b5-2737d735202c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:30.151968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec1183-09af-437c-83b5-2737d735202c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:30.152332 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec1183-09af-437c-83b5-2737d735202c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:30.152686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec1183-09af-437c-83b5-2737d735202c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:30.168118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec1183-09af-437c-83b5-2737d735202c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:30.175997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-69ec1183-09af-437c-83b5-2737d735202c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:30.175997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:30.175997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:30.175997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:30.175997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:30.175997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:30.175997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:30.175997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:30.175997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:30.175997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:30.175997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:30.175997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:30.175997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:30.175997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:30.175997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:30.175997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:30.177485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:30.177485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:30.177485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:30.177485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:30.177485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:30.177485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:30.177485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:30.177485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:30.177485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:30.177485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:30.177485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:30.177485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:30.177485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:30.177485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:30.177485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:30.177485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:30.178477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:30.178477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:30.178477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:30.178477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:30.178477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:30.178477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:30.178477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:30.178477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:30.178477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:30.178477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:30.178477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:30.178477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:30.182651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 323/665] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:30.183477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec1183-09af-437c-83b5-2737d735202c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:30.218665 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:30.223439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6534fec-b35b-4492-86d7-0fe8946cf39a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:30.261404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb0e7d-e699-4c93-90cf-59b60a2f9720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:30.262957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb0e7d-e699-4c93-90cf-59b60a2f9720 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:30.263699 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb0e7d-e699-4c93-90cf-59b60a2f9720 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:30.264195 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb0e7d-e699-4c93-90cf-59b60a2f9720 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:30.265884 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb0e7d-e699-4c93-90cf-59b60a2f9720 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:30.266449 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb0e7d-e699-4c93-90cf-59b60a2f9720 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:30.269262 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb0e7d-e699-4c93-90cf-59b60a2f9720 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:30.296734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec1183-09af-437c-83b5-2737d735202c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:30.297689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 343/666] 10.222.0.49 () {56 vars in 1139 bytes} [Wed May 18 16:51:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:30.298576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb0e7d-e699-4c93-90cf-59b60a2f9720 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:30.342732 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c05219-f75e-4499-8642-edcd7b9c023f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:30.343522 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c05219-f75e-4499-8642-edcd7b9c023f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:30.343797 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c05219-f75e-4499-8642-edcd7b9c023f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:30.344066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c05219-f75e-4499-8642-edcd7b9c023f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:30.354733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c05219-f75e-4499-8642-edcd7b9c023f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:30.356188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c05219-f75e-4499-8642-edcd7b9c023f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:30.373164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-77c05219-f75e-4499-8642-edcd7b9c023f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:30.373164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:30.373164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:30.373164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:30.373164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:30.373164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:30.373164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:30.373164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:30.373164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:30.373164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:30.373164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:30.373164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:30.373164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:30.373164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:30.373164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:30.374209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:30.374209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:30.374209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:30.374209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:30.374209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:30.374209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:30.374209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:30.374209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:30.374209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:30.374209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:30.374209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:30.374209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:30.374209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:30.374209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:30.374209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:30.374209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:30.374209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:30.375151 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:30.375151 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:30.375151 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:30.375151 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:30.375151 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 324/667] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:30.375461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c05219-f75e-4499-8642-edcd7b9c023f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:30.394858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:30.417589 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb0e7d-e699-4c93-90cf-59b60a2f9720 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:30.453747 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90bfdd-f70f-4c32-9c86-a18bfa8fde76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:30.454430 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90bfdd-f70f-4c32-9c86-a18bfa8fde76 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:30.454709 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90bfdd-f70f-4c32-9c86-a18bfa8fde76 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:30.454983 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90bfdd-f70f-4c32-9c86-a18bfa8fde76 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:30.456051 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90bfdd-f70f-4c32-9c86-a18bfa8fde76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:30.456357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90bfdd-f70f-4c32-9c86-a18bfa8fde76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:30.457847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90bfdd-f70f-4c32-9c86-a18bfa8fde76 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:30.471448 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 344/668] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:30.472351 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90bfdd-f70f-4c32-9c86-a18bfa8fde76 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:30.476690 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:30.503816 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c05219-f75e-4499-8642-edcd7b9c023f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:30.540799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324249b-1d6d-4aa4-9bc0-969b6110fa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:30.541563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324249b-1d6d-4aa4-9bc0-969b6110fa34 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:30.541887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324249b-1d6d-4aa4-9bc0-969b6110fa34 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:30.542164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324249b-1d6d-4aa4-9bc0-969b6110fa34 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:30.542925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324249b-1d6d-4aa4-9bc0-969b6110fa34 None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:30.543255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324249b-1d6d-4aa4-9bc0-969b6110fa34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:30.544615 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324249b-1d6d-4aa4-9bc0-969b6110fa34 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:30.554358 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 325/669] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:51:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:30.555393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324249b-1d6d-4aa4-9bc0-969b6110fa34 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:30.590347 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90bfdd-f70f-4c32-9c86-a18bfa8fde76 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:30.629394 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097447d-5220-48da-9db6-817240a069df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:30.630632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097447d-5220-48da-9db6-817240a069df None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:30.630969 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097447d-5220-48da-9db6-817240a069df None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:30.631334 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097447d-5220-48da-9db6-817240a069df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:30.644705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:30.667050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324249b-1d6d-4aa4-9bc0-969b6110fa34 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:30.703896 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da867a1c-6011-4c9e-ada6-a45368badee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:30.704488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da867a1c-6011-4c9e-ada6-a45368badee9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:30.704772 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da867a1c-6011-4c9e-ada6-a45368badee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:30.705049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da867a1c-6011-4c9e-ada6-a45368badee9 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:30.706071 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da867a1c-6011-4c9e-ada6-a45368badee9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:30.706379 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da867a1c-6011-4c9e-ada6-a45368badee9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:30.707757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da867a1c-6011-4c9e-ada6-a45368badee9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:30.712298 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097447d-5220-48da-9db6-817240a069df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:30.713952 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097447d-5220-48da-9db6-817240a069df None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:30.720984 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 326/670] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:30.721838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da867a1c-6011-4c9e-ada6-a45368badee9 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:30.729057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:30.831263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 345/671] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:51:30.831263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097447d-5220-48da-9db6-817240a069df None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:30.838572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da867a1c-6011-4c9e-ada6-a45368badee9 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:30.875892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:30.877531 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174d9d9-e86f-4a6b-89d7-4a846bb14b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:30.878479 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174d9d9-e86f-4a6b-89d7-4a846bb14b9d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:30.878769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174d9d9-e86f-4a6b-89d7-4a846bb14b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:30.879049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174d9d9-e86f-4a6b-89d7-4a846bb14b9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:30.879923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174d9d9-e86f-4a6b-89d7-4a846bb14b9d None admin] RBAC: Adding query filter params (role.id=c6328736ee34470cb87aa31dea4530bf, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=0d69d99d980744fba12a6b38586e7bf3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:30.880366 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174d9d9-e86f-4a6b-89d7-4a846bb14b9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:30.882069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174d9d9-e86f-4a6b-89d7-4a846bb14b9d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:30.888311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 327/672] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:51:30 2022] GET /identity/v3/role_assignments?user.id=0d69d99d980744fba12a6b38586e7bf3&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=c6328736ee34470cb87aa31dea4530bf => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:30.889121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174d9d9-e86f-4a6b-89d7-4a846bb14b9d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:30.960813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097447d-5220-48da-9db6-817240a069df None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:30.984667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:31.009024 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e65f9-5077-4e09-bded-1fb23634f519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:31.010427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e65f9-5077-4e09-bded-1fb23634f519 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:31.010715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e65f9-5077-4e09-bded-1fb23634f519 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:31.010997 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e65f9-5077-4e09-bded-1fb23634f519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:31.030090 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e65f9-5077-4e09-bded-1fb23634f519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:31.030420 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174d9d9-e86f-4a6b-89d7-4a846bb14b9d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:31.032505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e65f9-5077-4e09-bded-1fb23634f519 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:31.070010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842388a-e269-4d28-a82f-feab371bf0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:31.070833 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842388a-e269-4d28-a82f-feab371bf0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:31.071119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842388a-e269-4d28-a82f-feab371bf0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:31.071242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-df9e65f9-5077-4e09-bded-1fb23634f519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:31.071242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:31.071242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:31.071242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:31.071242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:31.071242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:31.071242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:31.071242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:31.071242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:31.071242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:31.071242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:31.071242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:31.071242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:31.071242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:31.071242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:31.072144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:31.072144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:31.072144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:31.072144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:31.072144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:31.072144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:31.072144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:31.072144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:31.072144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:31.072144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:31.072144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:31.072144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:31.072144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:31.072144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:31.072144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:31.072144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:31.072144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:31.073033 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:31.073033 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:31.073033 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:31.073033 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:31.073286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842388a-e269-4d28-a82f-feab371bf0f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:31.079716 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842388a-e269-4d28-a82f-feab371bf0f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:31.080582 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 346/673] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:31.081231 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842388a-e269-4d28-a82f-feab371bf0f5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:31.082020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e65f9-5077-4e09-bded-1fb23634f519 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:31.101155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-6842388a-e269-4d28-a82f-feab371bf0f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:31.101155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:31.101155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:31.101155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:31.101155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:31.101155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:31.101155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:31.101155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:31.101155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:31.101155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:31.101155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:31.101155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:31.101155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:31.101155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:31.101155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:31.102165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:31.102165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:31.102165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:31.102165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:31.102165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:31.102165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:31.102165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:31.102165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:31.102165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:31.102165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:31.102165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:31.102165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:31.102165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:31.102165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:31.102165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:31.102165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:31.102165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:31.103088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:31.103088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:31.103088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:31.103088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:31.103088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:31.103088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:31.103088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:31.103088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:31.104760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 328/674] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:31.105866 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842388a-e269-4d28-a82f-feab371bf0f5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:31.214595 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:31.226629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e65f9-5077-4e09-bded-1fb23634f519 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:31.234885 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842388a-e269-4d28-a82f-feab371bf0f5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:31.265388 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:31.275658 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17b965-0bfe-4722-be7b-b2fcce65e0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:31.276332 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17b965-0bfe-4722-be7b-b2fcce65e0fc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:31.276618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17b965-0bfe-4722-be7b-b2fcce65e0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:31.276898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17b965-0bfe-4722-be7b-b2fcce65e0fc None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:31.277636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17b965-0bfe-4722-be7b-b2fcce65e0fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:31.277973 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17b965-0bfe-4722-be7b-b2fcce65e0fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:31.279349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17b965-0bfe-4722-be7b-b2fcce65e0fc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:31.279841 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0dd043-d55c-46ab-841b-5f3d54d238fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:31.281138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0dd043-d55c-46ab-841b-5f3d54d238fe None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:31.282223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0dd043-d55c-46ab-841b-5f3d54d238fe None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:31.282722 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0dd043-d55c-46ab-841b-5f3d54d238fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:31.297162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 329/675] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:31.297162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17b965-0bfe-4722-be7b-b2fcce65e0fc None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:31.302525 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0dd043-d55c-46ab-841b-5f3d54d238fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:31.304039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0dd043-d55c-46ab-841b-5f3d54d238fe None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:31.322775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-dd0dd043-d55c-46ab-841b-5f3d54d238fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:31.322775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:31.322775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:31.322775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:31.322775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:31.322775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:31.322775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:31.322775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:31.322775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:31.322775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:31.322775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:31.322775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:31.322775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:31.322775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:31.322775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:31.323712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:31.323712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:31.323712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:31.323712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:31.323712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:31.323712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:31.323712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:31.323712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:31.323712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:31.323712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:31.323712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:31.323712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:31.323712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:31.323712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:31.323712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:31.323712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:31.323712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:31.324603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:31.324603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:31.324603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:31.324603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:31.324603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 347/676] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:31.325308 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0dd043-d55c-46ab-841b-5f3d54d238fe None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:31.438878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0dd043-d55c-46ab-841b-5f3d54d238fe None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:31.439481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17b965-0bfe-4722-be7b-b2fcce65e0fc None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:31.476742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4d0bf-5b53-4d1c-9bd3-2a7379bf7122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:31.477401 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4d0bf-5b53-4d1c-9bd3-2a7379bf7122 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:31.477717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4d0bf-5b53-4d1c-9bd3-2a7379bf7122 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:31.478000 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4d0bf-5b53-4d1c-9bd3-2a7379bf7122 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:31.485866 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4d0bf-5b53-4d1c-9bd3-2a7379bf7122 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:31.487325 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4d0bf-5b53-4d1c-9bd3-2a7379bf7122 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:31.491095 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88374503-9d27-4f52-8270-69c4540a1687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:31.492040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88374503-9d27-4f52-8270-69c4540a1687 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:31.492538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88374503-9d27-4f52-8270-69c4540a1687 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:31.493043 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88374503-9d27-4f52-8270-69c4540a1687 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:31.494059 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88374503-9d27-4f52-8270-69c4540a1687 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:31.494567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88374503-9d27-4f52-8270-69c4540a1687 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:31.496479 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88374503-9d27-4f52-8270-69c4540a1687 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:31.503224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-1fb4d0bf-5b53-4d1c-9bd3-2a7379bf7122 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 16:51:31.503224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:31.503224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:31.503224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:31.503224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:31.503224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:31.503224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:31.503224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:31.503224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:31.503224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:31.503224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:31.503224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:31.503224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:31.503224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:31.503224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:31.503224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:31.504175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:31.504175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:31.504175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:31.504175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:31.504175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:31.504175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:31.504175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:31.504175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:31.504175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:31.504175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:31.504175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:31.504175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:31.504175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:31.504175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:31.504175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:31.504175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:31.504175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:31.504175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:31.505820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:31.505820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:31.505820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:31.505820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:31.505820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:31.505820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:31.505820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:31.505820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:31.505820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 16:51:31.505820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:31.509816 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 348/677] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:51:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:31.510991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4d0bf-5b53-4d1c-9bd3-2a7379bf7122 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:31.515733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 330/678] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:31.516837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88374503-9d27-4f52-8270-69c4540a1687 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:31.525965 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:31.580563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:31.635932 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4d0bf-5b53-4d1c-9bd3-2a7379bf7122 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:31.636730 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88374503-9d27-4f52-8270-69c4540a1687 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:31.673209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4648e85-e30c-4a6c-9eae-195ade48efa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:31.674022 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4648e85-e30c-4a6c-9eae-195ade48efa8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:31.674308 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4648e85-e30c-4a6c-9eae-195ade48efa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:31.674583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4648e85-e30c-4a6c-9eae-195ade48efa8 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:31.674870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6e036-4ca3-47d6-88a7-4d1be654b914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:31.675457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4648e85-e30c-4a6c-9eae-195ade48efa8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:31.675565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6e036-4ca3-47d6-88a7-4d1be654b914 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:31.675763 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4648e85-e30c-4a6c-9eae-195ade48efa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:31.675860 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6e036-4ca3-47d6-88a7-4d1be654b914 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:31.676066 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6e036-4ca3-47d6-88a7-4d1be654b914 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:31.676821 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6e036-4ca3-47d6-88a7-4d1be654b914 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:31.677133 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6e036-4ca3-47d6-88a7-4d1be654b914 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:31.677404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4648e85-e30c-4a6c-9eae-195ade48efa8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:31.678510 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6e036-4ca3-47d6-88a7-4d1be654b914 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:31.695977 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 349/679] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:31.695977 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6e036-4ca3-47d6-88a7-4d1be654b914 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:31.703203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 331/680] 10.222.0.49 () {56 vars in 1135 bytes} [Wed May 18 16:51:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:31.703203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65066c22-33a5-480f-8ae1-df45873bbdbb None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:31.703203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65066c22-33a5-480f-8ae1-df45873bbdbb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:31.703203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65066c22-33a5-480f-8ae1-df45873bbdbb None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:31.705964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 332/681] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:31.707138 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65066c22-33a5-480f-8ae1-df45873bbdbb None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:31.773748 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:31.810799 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6e036-4ca3-47d6-88a7-4d1be654b914 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:31.820501 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65066c22-33a5-480f-8ae1-df45873bbdbb None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:31.829566 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:31.848303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490fd4f-c8db-4cac-9948-61abaeb5b5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:31.849028 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490fd4f-c8db-4cac-9948-61abaeb5b5ac None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:31.849316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490fd4f-c8db-4cac-9948-61abaeb5b5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:31.849593 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490fd4f-c8db-4cac-9948-61abaeb5b5ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:31.850469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490fd4f-c8db-4cac-9948-61abaeb5b5ac None admin] RBAC: Adding query filter params (role.id=c6328736ee34470cb87aa31dea4530bf, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=102a6c55061040129802a9739f43036a) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:31.850783 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490fd4f-c8db-4cac-9948-61abaeb5b5ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:31.852233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490fd4f-c8db-4cac-9948-61abaeb5b5ac None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:31.858939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 350/682] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:51:31 2022] GET /identity/v3/role_assignments?user.id=102a6c55061040129802a9739f43036a&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=c6328736ee34470cb87aa31dea4530bf => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:31.859772 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490fd4f-c8db-4cac-9948-61abaeb5b5ac None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:31.878216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a1cc7-9a94-4ced-a681-14771d80ee8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:31.879054 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a1cc7-9a94-4ced-a681-14771d80ee8a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:31.879343 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a1cc7-9a94-4ced-a681-14771d80ee8a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:31.879620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a1cc7-9a94-4ced-a681-14771d80ee8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:31.890855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a1cc7-9a94-4ced-a681-14771d80ee8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:31.892388 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a1cc7-9a94-4ced-a681-14771d80ee8a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:31.908760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-be2a1cc7-9a94-4ced-a681-14771d80ee8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:31.908760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:31.908760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:31.908760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:31.908760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:31.908760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:31.908760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:31.908760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:31.908760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:31.908760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:31.908760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:31.908760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:31.908760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:31.908760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:31.908760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:31.910101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:31.910101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:31.910101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:31.910101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:31.910101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:31.910101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:31.910101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:31.910101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:31.910101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:31.910101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:31.910101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:31.910101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:31.910101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:31.910101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:31.910101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:31.910101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:31.910101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:31.911020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:31.911020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:31.911020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:31.911020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:31.911020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:31.911020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:31.911020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:31.911020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:31.915046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 333/683] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:31.916692 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a862cd2-77c1-48a2-8db0-0d9306650422 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:31.916847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a862cd2-77c1-48a2-8db0-0d9306650422 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:31.917081 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a862cd2-77c1-48a2-8db0-0d9306650422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:31.936303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8a862cd2-77c1-48a2-8db0-0d9306650422 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:31.937539 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8a862cd2-77c1-48a2-8db0-0d9306650422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:32.021681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 334/684] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:32.021681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a862cd2-77c1-48a2-8db0-0d9306650422 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:32.030981 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490fd4f-c8db-4cac-9948-61abaeb5b5ac None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:32.083945 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:32.090994 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d8cc9-11a5-458a-b503-d8cf6d008a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:32.091685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d8cc9-11a5-458a-b503-d8cf6d008a40 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:32.091929 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d8cc9-11a5-458a-b503-d8cf6d008a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:32.092200 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d8cc9-11a5-458a-b503-d8cf6d008a40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:32.158323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:32.166686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a862cd2-77c1-48a2-8db0-0d9306650422 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:32.188684 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d8cc9-11a5-458a-b503-d8cf6d008a40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:32.190656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d8cc9-11a5-458a-b503-d8cf6d008a40 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:32.207634 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30687aa7-bac9-44c2-ade7-7dbb614b2162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:32.210307 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30687aa7-bac9-44c2-ade7-7dbb614b2162 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:32.211199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30687aa7-bac9-44c2-ade7-7dbb614b2162 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:32.211902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30687aa7-bac9-44c2-ade7-7dbb614b2162 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:32.213620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30687aa7-bac9-44c2-ade7-7dbb614b2162 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:32.214170 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30687aa7-bac9-44c2-ade7-7dbb614b2162 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:32.216092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30687aa7-bac9-44c2-ade7-7dbb614b2162 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:32.231417 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 335/685] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:32.232595 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30687aa7-bac9-44c2-ade7-7dbb614b2162 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:32.318944 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 351/686] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:51:32.319986 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d8cc9-11a5-458a-b503-d8cf6d008a40 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:32.356061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30687aa7-bac9-44c2-ade7-7dbb614b2162 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:32.359948 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:32.402324 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75007d-cecc-4f3f-bfc9-ea868b835be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:32.403396 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75007d-cecc-4f3f-bfc9-ea868b835be5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:32.403697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75007d-cecc-4f3f-bfc9-ea868b835be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:32.403978 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75007d-cecc-4f3f-bfc9-ea868b835be5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:32.417972 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75007d-cecc-4f3f-bfc9-ea868b835be5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:32.427567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-6a75007d-cecc-4f3f-bfc9-ea868b835be5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:51:32.427567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:32.427567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:32.427567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:32.427567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:32.427567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:32.427567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:32.427567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:32.427567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:32.427567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:32.427567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:32.427567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:32.427567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:32.427567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:32.427567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:32.427567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:32.428725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:32.428725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:32.428725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:32.428725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:32.428725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:32.428725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:32.428725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:32.428725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:32.428725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:32.428725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:32.428725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:32.428725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:32.428725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:32.428725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:32.428725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:32.428725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:32.429576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:32.429576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:32.429576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:32.429576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:32.429576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:32.429576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:32.429576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:32.429576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:32.429576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:32.429576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:32.429576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:51:32.429576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:32.433798 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 336/687] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:51:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:32.434662 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75007d-cecc-4f3f-bfc9-ea868b835be5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:32.447003 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d8cc9-11a5-458a-b503-d8cf6d008a40 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:32.458746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:32.488250 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7b332-9f02-4005-9859-a49cb5c4e0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:32.489960 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7b332-9f02-4005-9859-a49cb5c4e0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:32.490453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7b332-9f02-4005-9859-a49cb5c4e0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:32.490926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7b332-9f02-4005-9859-a49cb5c4e0a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:32.492072 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7b332-9f02-4005-9859-a49cb5c4e0a9 None admin] RBAC: Adding query filter params (role.id=c6328736ee34470cb87aa31dea4530bf, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=d35f21c5cc7c433882eb5fbe9a8072f6) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:32.492611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7b332-9f02-4005-9859-a49cb5c4e0a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:32.494547 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7b332-9f02-4005-9859-a49cb5c4e0a9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:32.501501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 352/688] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:51:32 2022] GET /identity/v3/role_assignments?user.id=d35f21c5cc7c433882eb5fbe9a8072f6&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=c6328736ee34470cb87aa31dea4530bf => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:32.502827 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7b332-9f02-4005-9859-a49cb5c4e0a9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:32.571477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75007d-cecc-4f3f-bfc9-ea868b835be5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:32.618696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a96dec-59ba-4db0-8458-ca9a23565ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:32.619540 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a96dec-59ba-4db0-8458-ca9a23565ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:32.619827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a96dec-59ba-4db0-8458-ca9a23565ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:32.620107 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a96dec-59ba-4db0-8458-ca9a23565ae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:32.641979 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a96dec-59ba-4db0-8458-ca9a23565ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:32.643582 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a96dec-59ba-4db0-8458-ca9a23565ae2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:32.664526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-b6a96dec-59ba-4db0-8458-ca9a23565ae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:32.664526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:32.664526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:32.664526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:32.664526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:32.664526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:32.664526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:32.664526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:32.664526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:32.664526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:32.664526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:32.664526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:32.664526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:32.664526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:32.664526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:32.665513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:32.665513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:32.665513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:32.665513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:32.665513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:32.665513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:32.665513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:32.665513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:32.665513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:32.665513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:32.665513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:32.665513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:32.665513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:32.665513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:32.665513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:32.665513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:32.665513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:32.666442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:32.666442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:32.666442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:32.666442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:32.667105 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 337/689] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:32.676203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a96dec-59ba-4db0-8458-ca9a23565ae2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:32.713047 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:32.724395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7b332-9f02-4005-9859-a49cb5c4e0a9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:32.784573 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b81c05-9a32-433d-be21-f356bd15781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:32.785399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b81c05-9a32-433d-be21-f356bd15781b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:32.785990 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b81c05-9a32-433d-be21-f356bd15781b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:32.786404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b81c05-9a32-433d-be21-f356bd15781b None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:32.788015 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b81c05-9a32-433d-be21-f356bd15781b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:32.788334 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b81c05-9a32-433d-be21-f356bd15781b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:32.790329 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b81c05-9a32-433d-be21-f356bd15781b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:32.796097 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:32.809074 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 353/690] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:51:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:32.810480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b81c05-9a32-433d-be21-f356bd15781b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:32.838707 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a96dec-59ba-4db0-8458-ca9a23565ae2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:32.878294 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752dd84-b7b1-4e42-b31c-e9104ca40441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:32.878939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752dd84-b7b1-4e42-b31c-e9104ca40441 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:32.879226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752dd84-b7b1-4e42-b31c-e9104ca40441 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:32.879501 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752dd84-b7b1-4e42-b31c-e9104ca40441 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:32.880485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752dd84-b7b1-4e42-b31c-e9104ca40441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:32.880829 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752dd84-b7b1-4e42-b31c-e9104ca40441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:32.882297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752dd84-b7b1-4e42-b31c-e9104ca40441 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:32.897976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 338/691] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:32.903924 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752dd84-b7b1-4e42-b31c-e9104ca40441 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:32.939328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b81c05-9a32-433d-be21-f356bd15781b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:32.984196 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103c02f-6fa1-419e-aa64-6db402a1e4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:32.985346 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103c02f-6fa1-419e-aa64-6db402a1e4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:32.985713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103c02f-6fa1-419e-aa64-6db402a1e4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:32.986289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103c02f-6fa1-419e-aa64-6db402a1e4a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:33.000892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103c02f-6fa1-419e-aa64-6db402a1e4a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:33.002406 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103c02f-6fa1-419e-aa64-6db402a1e4a4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:33.025444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-a103c02f-6fa1-419e-aa64-6db402a1e4a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:33.025444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:33.025444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:33.025444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:33.025444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:33.025444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:33.025444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:33.025444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:33.025444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:33.025444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:33.025444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:33.025444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:33.025444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:33.025444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:33.025444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:33.027656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:33.027656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:33.027656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:33.027656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:33.027656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:33.027656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:33.027656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:33.027656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:33.027656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:33.027656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:33.027656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:33.027656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:33.027656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:33.027656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:33.027656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:33.027656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:33.027656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:33.029055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:33.029055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:33.029055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:33.029055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:33.033680 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 354/692] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:33.033680 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103c02f-6fa1-419e-aa64-6db402a1e4a4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:33.041991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752dd84-b7b1-4e42-b31c-e9104ca40441 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:33.046400 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:33.081116 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:33.097396 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78266967-18cf-456d-8313-cea8977ccf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:33.099289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78266967-18cf-456d-8313-cea8977ccf82 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:33.099952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78266967-18cf-456d-8313-cea8977ccf82 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:33.100912 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78266967-18cf-456d-8313-cea8977ccf82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:33.113320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78266967-18cf-456d-8313-cea8977ccf82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:33.114969 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78266967-18cf-456d-8313-cea8977ccf82 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:33.129334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-78266967-18cf-456d-8313-cea8977ccf82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:33.129334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:33.129334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:33.129334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:33.129334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:33.129334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:33.129334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:33.129334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:33.129334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:33.129334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:33.129334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:33.129334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:33.129334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:33.129334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:33.129334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:33.130399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:33.130399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:33.130399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:33.130399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:33.130399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:33.130399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:33.130399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:33.130399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:33.130399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:33.130399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:33.130399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:33.130399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:33.130399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:33.130399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:33.130399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:33.130399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:33.130399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:33.131747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:33.131747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:33.131747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:33.131747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:33.131747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:33.131747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:33.131747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:33.131747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:33.131747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 339/693] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:33.136643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78266967-18cf-456d-8313-cea8977ccf82 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:33.178584 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103c02f-6fa1-419e-aa64-6db402a1e4a4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:33.228476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4ec3f-6ca8-45c7-a564-39d6c038e5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:33.229751 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4ec3f-6ca8-45c7-a564-39d6c038e5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:33.230226 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4ec3f-6ca8-45c7-a564-39d6c038e5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:33.231073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4ec3f-6ca8-45c7-a564-39d6c038e5d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:33.232097 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4ec3f-6ca8-45c7-a564-39d6c038e5d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:33.232637 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4ec3f-6ca8-45c7-a564-39d6c038e5d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:33.234847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4ec3f-6ca8-45c7-a564-39d6c038e5d0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:33.247096 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78266967-18cf-456d-8313-cea8977ccf82 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:33.258180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 355/694] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:33.260909 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4ec3f-6ca8-45c7-a564-39d6c038e5d0 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:33.311495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95c068-ad25-4286-8b95-e1e5fbd897a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:33.312133 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95c068-ad25-4286-8b95-e1e5fbd897a7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:33.312415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95c068-ad25-4286-8b95-e1e5fbd897a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:33.312684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95c068-ad25-4286-8b95-e1e5fbd897a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:33.313479 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95c068-ad25-4286-8b95-e1e5fbd897a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:33.313816 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95c068-ad25-4286-8b95-e1e5fbd897a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:33.315252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95c068-ad25-4286-8b95-e1e5fbd897a7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:33.345156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:33.349456 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 340/695] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:33.355670 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95c068-ad25-4286-8b95-e1e5fbd897a7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:33.390636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4ec3f-6ca8-45c7-a564-39d6c038e5d0 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:33.435139 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe1dba-9a78-42cc-816f-d18e2cb28d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:33.436551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe1dba-9a78-42cc-816f-d18e2cb28d61 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:33.437044 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe1dba-9a78-42cc-816f-d18e2cb28d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:33.437567 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe1dba-9a78-42cc-816f-d18e2cb28d61 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:33.446977 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe1dba-9a78-42cc-816f-d18e2cb28d61 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:33.448775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe1dba-9a78-42cc-816f-d18e2cb28d61 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:33.466608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-7cfe1dba-9a78-42cc-816f-d18e2cb28d61 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 16:51:33.466608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:33.466608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:33.466608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:33.466608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:33.466608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:33.466608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:33.466608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:33.466608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:33.466608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:33.466608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:33.466608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:33.466608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:33.466608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:33.466608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:33.466608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:33.467638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:33.467638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:33.467638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:33.467638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:33.467638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:33.467638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:33.467638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:33.467638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:33.467638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:33.467638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:33.467638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:33.467638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:33.467638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:33.467638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:33.467638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:33.467638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:33.467638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:33.467638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:33.468592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:33.468592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:33.468592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:33.468592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:33.468592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:33.468592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:33.468592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:33.468592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:33.468592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 16:51:33.468592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:33.476209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 356/696] 10.222.0.49 () {56 vars in 1093 bytes} [Wed May 18 16:51:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:33.479322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe1dba-9a78-42cc-816f-d18e2cb28d61 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:33.508774 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:33.604814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95c068-ad25-4286-8b95-e1e5fbd897a7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:33.617119 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe1dba-9a78-42cc-816f-d18e2cb28d61 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:33.645399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea1e90-75f4-47b5-bc82-e087b332a572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:33.646502 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:33.647344 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea1e90-75f4-47b5-bc82-e087b332a572 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:33.647842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea1e90-75f4-47b5-bc82-e087b332a572 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:33.648419 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea1e90-75f4-47b5-bc82-e087b332a572 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:33.649616 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea1e90-75f4-47b5-bc82-e087b332a572 None admin] RBAC: Adding query filter params (role.id=c6328736ee34470cb87aa31dea4530bf, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=b712c7f5fce54fe2a89d63863f3845f0) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:33.650150 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea1e90-75f4-47b5-bc82-e087b332a572 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:33.652669 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ea1e90-75f4-47b5-bc82-e087b332a572 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:33.656277 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefb6ce-5dff-47a7-a122-0c0bb8940618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:33.657143 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefb6ce-5dff-47a7-a122-0c0bb8940618 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:33.657543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefb6ce-5dff-47a7-a122-0c0bb8940618 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:33.657946 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefb6ce-5dff-47a7-a122-0c0bb8940618 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:33.658885 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefb6ce-5dff-47a7-a122-0c0bb8940618 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:33.659293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefb6ce-5dff-47a7-a122-0c0bb8940618 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:33.660873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefb6ce-5dff-47a7-a122-0c0bb8940618 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:33.661420 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 341/697] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:51:33 2022] GET /identity/v3/role_assignments?user.id=b712c7f5fce54fe2a89d63863f3845f0&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=c6328736ee34470cb87aa31dea4530bf => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:33.663039 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ae15a-87d2-48e9-8829-ffa0200ab086 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:33.663466 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ae15a-87d2-48e9-8829-ffa0200ab086 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:33.663874 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ae15a-87d2-48e9-8829-ffa0200ab086 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:33.665728 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 342/698] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:33.677691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3f09c-a9de-49e9-baa0-2df554bb2c9b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:33.677691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3f09c-a9de-49e9-baa0-2df554bb2c9b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:33.677691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3f09c-a9de-49e9-baa0-2df554bb2c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:33.695676 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5df3f09c-a9de-49e9-baa0-2df554bb2c9b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:33.696983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5df3f09c-a9de-49e9-baa0-2df554bb2c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:33.699207 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 357/699] 10.222.0.49 () {56 vars in 1133 bytes} [Wed May 18 16:51:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:33.706205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefb6ce-5dff-47a7-a122-0c0bb8940618 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:33.792800 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 343/700] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:33.822279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3f09c-a9de-49e9-baa0-2df554bb2c9b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:33.890682 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:33.932350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefb6ce-5dff-47a7-a122-0c0bb8940618 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:33.988348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1588e33-fc58-47a1-b343-3e5039a47772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:33.989010 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1588e33-fc58-47a1-b343-3e5039a47772 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:33.989337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1588e33-fc58-47a1-b343-3e5039a47772 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:33.989616 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1588e33-fc58-47a1-b343-3e5039a47772 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:33.994556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3f09c-a9de-49e9-baa0-2df554bb2c9b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:34.043222 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a751e-0081-41c6-afa4-39c99a56787f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:34.046204 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a751e-0081-41c6-afa4-39c99a56787f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:34.046731 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a751e-0081-41c6-afa4-39c99a56787f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:34.047213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a751e-0081-41c6-afa4-39c99a56787f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:34.084811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a751e-0081-41c6-afa4-39c99a56787f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:34.086495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a751e-0081-41c6-afa4-39c99a56787f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:34.090874 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:34.112524 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1588e33-fc58-47a1-b343-3e5039a47772 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:34.114129 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1588e33-fc58-47a1-b343-3e5039a47772 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:34.118050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ee1a751e-0081-41c6-afa4-39c99a56787f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:34.118050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:34.118050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:34.118050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:34.118050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:34.118050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:34.118050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:34.118050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:34.118050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:34.118050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:34.118050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:34.118050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:34.118050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:34.118050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:34.118050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:34.118987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:34.118987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:34.118987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:34.118987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:34.118987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:34.118987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:34.118987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:34.118987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:34.118987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:34.118987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:34.118987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:34.118987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:34.118987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:34.118987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:34.118987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:34.118987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:34.118987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:34.119963 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:34.119963 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:34.119963 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:34.119963 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:34.122228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 344/701] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:34.129425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a751e-0081-41c6-afa4-39c99a56787f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:34.252089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:34.261686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a751e-0081-41c6-afa4-39c99a56787f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:34.261889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 358/702] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:51:34.266957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1588e33-fc58-47a1-b343-3e5039a47772 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:34.304288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f17c4e-4663-4a64-8777-b48dccd1089a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:34.305287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f17c4e-4663-4a64-8777-b48dccd1089a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:34.305783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f17c4e-4663-4a64-8777-b48dccd1089a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:34.306267 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f17c4e-4663-4a64-8777-b48dccd1089a None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:34.307205 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f17c4e-4663-4a64-8777-b48dccd1089a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:34.307712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f17c4e-4663-4a64-8777-b48dccd1089a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:34.309466 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f17c4e-4663-4a64-8777-b48dccd1089a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:34.322951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 345/703] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:34.331303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f17c4e-4663-4a64-8777-b48dccd1089a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:34.418029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:34.429354 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1588e33-fc58-47a1-b343-3e5039a47772 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:34.443544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f17c4e-4663-4a64-8777-b48dccd1089a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:34.481866 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf23741-59df-420b-8691-e9c0fdf055a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:34.482673 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf23741-59df-420b-8691-e9c0fdf055a2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:34.482955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf23741-59df-420b-8691-e9c0fdf055a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:34.483234 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf23741-59df-420b-8691-e9c0fdf055a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:34.486775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4afd1-f4ef-4f21-aa09-e020f94e1847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:34.487576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4afd1-f4ef-4f21-aa09-e020f94e1847 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:34.487963 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4afd1-f4ef-4f21-aa09-e020f94e1847 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:34.488346 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4afd1-f4ef-4f21-aa09-e020f94e1847 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:34.489753 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4afd1-f4ef-4f21-aa09-e020f94e1847 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:34.492911 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4afd1-f4ef-4f21-aa09-e020f94e1847 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:34.495197 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf23741-59df-420b-8691-e9c0fdf055a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:34.496760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf23741-59df-420b-8691-e9c0fdf055a2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:34.516220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-7bf23741-59df-420b-8691-e9c0fdf055a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:34.516220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:34.516220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:34.516220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:34.516220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:34.516220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:34.516220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:34.516220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:34.516220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:34.516220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:34.516220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:34.516220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:34.516220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:34.516220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:34.516220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:34.517131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:34.517131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:34.517131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:34.517131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:34.517131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:34.517131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:34.517131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:34.517131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:34.517131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:34.517131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:34.517131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:34.517131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:34.517131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:34.517131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:34.517131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:34.517131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:34.517131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:34.518085 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:34.518085 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:34.518085 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:34.518085 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:34.522761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 359/705] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:34.524302 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3274daf-ce35-4252-8ea9-8704d5b48513 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:34.524659 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3274daf-ce35-4252-8ea9-8704d5b48513 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:34.524987 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3274daf-ce35-4252-8ea9-8704d5b48513 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:34.525785 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 346/705] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 18 16:51:34 2022] POST /identity/v3/users => generated 254 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 16:51:34.527289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 360/706] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:34.528313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4afd1-f4ef-4f21-aa09-e020f94e1847 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:34.537680 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49302cd3-e1b0-4b83-be4f-96dc2b237ba2 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:34.537680 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49302cd3-e1b0-4b83-be4f-96dc2b237ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:34.537680 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49302cd3-e1b0-4b83-be4f-96dc2b237ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:34.558148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:34.580695 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-49302cd3-e1b0-4b83-be4f-96dc2b237ba2 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:34.583220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-49302cd3-e1b0-4b83-be4f-96dc2b237ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:34.712543 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4afd1-f4ef-4f21-aa09-e020f94e1847 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:34.753005 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413a8ab-dc5f-4c7c-a83f-beca6e7e2345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:34.753724 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413a8ab-dc5f-4c7c-a83f-beca6e7e2345 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:34.754017 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413a8ab-dc5f-4c7c-a83f-beca6e7e2345 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:34.754402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413a8ab-dc5f-4c7c-a83f-beca6e7e2345 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:34.755190 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413a8ab-dc5f-4c7c-a83f-beca6e7e2345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:34.755503 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413a8ab-dc5f-4c7c-a83f-beca6e7e2345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:34.757017 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413a8ab-dc5f-4c7c-a83f-beca6e7e2345 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:34.757479 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 361/707] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:34.783212 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 347/708] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:34.789511 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49302cd3-e1b0-4b83-be4f-96dc2b237ba2 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:34.794979 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413a8ab-dc5f-4c7c-a83f-beca6e7e2345 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:34.877737 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:34.885510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:34.924475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413a8ab-dc5f-4c7c-a83f-beca6e7e2345 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:34.925419 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49302cd3-e1b0-4b83-be4f-96dc2b237ba2 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:34.969552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36aae03-2f87-44c1-9abf-3f7124f54396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:34.970778 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36aae03-2f87-44c1-9abf-3f7124f54396 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:34.971255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36aae03-2f87-44c1-9abf-3f7124f54396 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:34.971702 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36aae03-2f87-44c1-9abf-3f7124f54396 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:34.972514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36aae03-2f87-44c1-9abf-3f7124f54396 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:34.972724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820db523-83a7-4153-8ad1-d82df8218f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:34.973717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820db523-83a7-4153-8ad1-d82df8218f19 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:34.974128 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820db523-83a7-4153-8ad1-d82df8218f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:34.974514 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820db523-83a7-4153-8ad1-d82df8218f19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:34.975055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36aae03-2f87-44c1-9abf-3f7124f54396 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:34.983481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820db523-83a7-4153-8ad1-d82df8218f19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:34.985072 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820db523-83a7-4153-8ad1-d82df8218f19 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:34.991505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a36aae03-2f87-44c1-9abf-3f7124f54396 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 16:51:34.991505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:34.991505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:51:34.991505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:51:34.991505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:51:34.991505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:51:34.991505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:51:34.991505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:34.991505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 16:51:34.991505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:34.991505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:51:34.991505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:34.991505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:34.991505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:34.991505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:34.991505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:34.992736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:34.992736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:34.992736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:34.992736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:34.992736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:34.992736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:34.992736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:34.992736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:51:34.992736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:51:34.992736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:51:34.992736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:51:34.992736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:34.992736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:34.992736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:34.992736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:34.992736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:34.993735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:34.993735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:34.993735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:34.993735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:34.993735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:34.993735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:34.993735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:34.993735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:34.993735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:34.993735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:34.993735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:34.993735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:51:34.993735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:34.993735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 16:51:34.993735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:34.996501 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 348/709] 10.222.0.49 () {56 vars in 1129 bytes} [Wed May 18 16:51:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:35.002148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-820db523-83a7-4153-8ad1-d82df8218f19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:35.002148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:35.002148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:35.002148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:35.002148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:35.002148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:35.002148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:35.002148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:35.002148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:35.002148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:35.002148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:35.002148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:35.002148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:35.002148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:35.002148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:35.003082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:35.003082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:35.003082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:35.003082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:35.003082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:35.003082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:35.003082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:35.003082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:35.003082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:35.003082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:35.003082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:35.003082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:35.003082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:35.003082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:35.003082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:35.003082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:35.003082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:35.003980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:35.003980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:35.003980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:35.003980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:35.003980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:35.003980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:35.003980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:35.003980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:35.005601 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36aae03-2f87-44c1-9abf-3f7124f54396 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:35.008740 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 362/710] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:35.011499 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820db523-83a7-4153-8ad1-d82df8218f19 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:35.163206 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820db523-83a7-4153-8ad1-d82df8218f19 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:35.169384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36aae03-2f87-44c1-9abf-3f7124f54396 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:35.221224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:35.232714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294d052-09b3-414c-8f19-4a0540a504a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:35.233928 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294d052-09b3-414c-8f19-4a0540a504a9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:35.234788 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294d052-09b3-414c-8f19-4a0540a504a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:35.235652 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294d052-09b3-414c-8f19-4a0540a504a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:35.236993 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294d052-09b3-414c-8f19-4a0540a504a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:35.237742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294d052-09b3-414c-8f19-4a0540a504a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:35.240099 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294d052-09b3-414c-8f19-4a0540a504a9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:35.240934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd0cce-b6de-4943-89df-e759f020a755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:35.241693 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd0cce-b6de-4943-89df-e759f020a755 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:35.242054 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd0cce-b6de-4943-89df-e759f020a755 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:35.242404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd0cce-b6de-4943-89df-e759f020a755 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:35.243211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd0cce-b6de-4943-89df-e759f020a755 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:35.245289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd0cce-b6de-4943-89df-e759f020a755 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:35.246957 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd0cce-b6de-4943-89df-e759f020a755 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:35.249296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:35.263976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 349/711] 10.222.0.49 () {56 vars in 1124 bytes} [Wed May 18 16:51:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:35.271066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd0cce-b6de-4943-89df-e759f020a755 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:35.281962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 363/712] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:35.290471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294d052-09b3-414c-8f19-4a0540a504a9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:35.432931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd0cce-b6de-4943-89df-e759f020a755 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:35.483938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294d052-09b3-414c-8f19-4a0540a504a9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:35.506450 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe96f4f-743e-4a74-b717-1d1026e7537e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:35.507124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe96f4f-743e-4a74-b717-1d1026e7537e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:35.507408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe96f4f-743e-4a74-b717-1d1026e7537e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:35.507682 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe96f4f-743e-4a74-b717-1d1026e7537e None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:35.508401 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe96f4f-743e-4a74-b717-1d1026e7537e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:35.508708 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe96f4f-743e-4a74-b717-1d1026e7537e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:35.510130 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe96f4f-743e-4a74-b717-1d1026e7537e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:35.530115 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 350/713] 10.222.0.49 () {56 vars in 1124 bytes} [Wed May 18 16:51:35 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:35.555622 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04c659-b150-4475-b00f-d7a030e7cdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:35.556317 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04c659-b150-4475-b00f-d7a030e7cdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:35.556606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04c659-b150-4475-b00f-d7a030e7cdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:35.556884 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04c659-b150-4475-b00f-d7a030e7cdc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:35.557791 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04c659-b150-4475-b00f-d7a030e7cdc8 None admin] RBAC: Adding query filter params (role.id=b3f3f4910bf646699f30b749edeef422, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=c9e3c0ef5ed943d183b064f383fc01f3) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:35.558113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04c659-b150-4475-b00f-d7a030e7cdc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:35.559642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04c659-b150-4475-b00f-d7a030e7cdc8 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:35.571222 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 364/714] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:51:35 2022] GET /identity/v3/role_assignments?user.id=c9e3c0ef5ed943d183b064f383fc01f3&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=b3f3f4910bf646699f30b749edeef422 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:35.574239 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ba441-d508-44de-b86d-0cebae8f6aff None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:35.574528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ba441-d508-44de-b86d-0cebae8f6aff None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:35.574814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ba441-d508-44de-b86d-0cebae8f6aff None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:35.576599 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 351/715] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:35.583658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f44e8a-c459-4f2f-8dc0-7476076fe89f None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:35.583947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f44e8a-c459-4f2f-8dc0-7476076fe89f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:35.584225 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f44e8a-c459-4f2f-8dc0-7476076fe89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:35.604484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c4f44e8a-c459-4f2f-8dc0-7476076fe89f None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:35.605809 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c4f44e8a-c459-4f2f-8dc0-7476076fe89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:35.692517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:35.721299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 365/716] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:35.762023 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ba441-d508-44de-b86d-0cebae8f6aff None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:35.852029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:35.904848 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ba441-d508-44de-b86d-0cebae8f6aff None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:35.951688 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b4b2a-0423-471f-90c4-fa12309ac9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:35.952396 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b4b2a-0423-471f-90c4-fa12309ac9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:35.952679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b4b2a-0423-471f-90c4-fa12309ac9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:35.952954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b4b2a-0423-471f-90c4-fa12309ac9f8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:35.953616 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b4b2a-0423-471f-90c4-fa12309ac9f8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:35.955019 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b4b2a-0423-471f-90c4-fa12309ac9f8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:35.975591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-c16b4b2a-0423-471f-90c4-fa12309ac9f8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 18 16:51:35.975591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:35.975591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:51:35.975591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:51:35.975591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:51:35.975591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:51:35.975591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:51:35.975591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:35.975591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 16:51:35.975591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:35.975591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:51:35.975591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:35.975591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:35.975591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:35.975591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:35.975591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:35.975591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:35.976685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:35.976685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:35.976685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:35.976685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:35.976685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:35.976685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:35.976685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:51:35.976685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:51:35.976685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:51:35.976685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:51:35.976685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:35.976685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:35.976685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:35.976685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:35.976685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:35.976685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:35.977562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:35.977562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:35.977562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:35.977562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:35.977562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:35.977562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:35.977562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:35.977562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:35.977562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:35.977562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:35.977562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:51:35.977562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:35.977562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 16:51:35.977562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:35.977562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 352/717] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:35 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:35.985454 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f44e8a-c459-4f2f-8dc0-7476076fe89f None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:36.141719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f44e8a-c459-4f2f-8dc0-7476076fe89f None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:36.195749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411793cb-2901-48d8-9bdc-67a3033ed9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:36.196480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411793cb-2901-48d8-9bdc-67a3033ed9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:36.196826 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411793cb-2901-48d8-9bdc-67a3033ed9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:36.197109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411793cb-2901-48d8-9bdc-67a3033ed9a6 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:36.197871 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411793cb-2901-48d8-9bdc-67a3033ed9a6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:36.198290 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411793cb-2901-48d8-9bdc-67a3033ed9a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:36.199732 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411793cb-2901-48d8-9bdc-67a3033ed9a6 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:36.207930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 366/718] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 18 16:51:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:36.213407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b4b2a-0423-471f-90c4-fa12309ac9f8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:36.368567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b4b2a-0423-471f-90c4-fa12309ac9f8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:36.402359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:36.405475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32804213-3587-4dd2-846a-c9c7f03a5c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:36.406262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32804213-3587-4dd2-846a-c9c7f03a5c5f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:36.406626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32804213-3587-4dd2-846a-c9c7f03a5c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:36.407106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32804213-3587-4dd2-846a-c9c7f03a5c5f None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:36.407892 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32804213-3587-4dd2-846a-c9c7f03a5c5f None admin] RBAC: Adding query filter params (type=network) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:36.408349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32804213-3587-4dd2-846a-c9c7f03a5c5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:36.409948 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32804213-3587-4dd2-846a-c9c7f03a5c5f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:36.416080 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 353/719] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 18 16:51:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:36.947819 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc84149-2535-48cf-85f5-65c8cb9c2652 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:36.948225 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc84149-2535-48cf-85f5-65c8cb9c2652 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:36.948404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc84149-2535-48cf-85f5-65c8cb9c2652 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:36.950073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 367/720] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:36.956111 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210afac-094d-4198-9248-8f9506a92785 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:36.956610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210afac-094d-4198-9248-8f9506a92785 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:36.956689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210afac-094d-4198-9248-8f9506a92785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:36.977934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1210afac-094d-4198-9248-8f9506a92785 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:36.979169 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1210afac-094d-4198-9248-8f9506a92785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:37.085293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 354/721] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:37.124143 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc84149-2535-48cf-85f5-65c8cb9c2652 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:37.187830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:37.247780 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc84149-2535-48cf-85f5-65c8cb9c2652 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:37.289936 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d497db-df74-4440-b0cf-6cfe36f3d2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:37.291143 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d497db-df74-4440-b0cf-6cfe36f3d2be None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:37.291662 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d497db-df74-4440-b0cf-6cfe36f3d2be None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:37.292141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d497db-df74-4440-b0cf-6cfe36f3d2be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:37.311762 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d497db-df74-4440-b0cf-6cfe36f3d2be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:37.320733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-e6d497db-df74-4440-b0cf-6cfe36f3d2be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:51:37.320733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:37.320733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:37.320733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:37.320733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:37.320733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:37.320733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:37.320733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:37.320733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:37.320733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:37.320733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:37.320733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:37.320733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:37.320733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:37.320733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:37.320733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:37.321733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:37.321733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:37.321733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:37.321733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:37.321733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:37.321733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:37.321733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:37.321733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:37.321733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:37.321733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:37.321733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:37.321733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:37.321733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:37.321733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:37.321733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:37.321733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:37.322575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:37.322575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:37.322575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:37.322575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:37.322575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:37.322575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:37.322575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:37.322575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:37.322575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:37.322575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:37.322575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:51:37.322575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:37.325200 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 368/722] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:51:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:37.331712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210afac-094d-4198-9248-8f9506a92785 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:37.404435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03a8e6-9596-4ea7-aead-500960ae7dae None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:37.404836 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03a8e6-9596-4ea7-aead-500960ae7dae None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:37.405005 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03a8e6-9596-4ea7-aead-500960ae7dae None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:37.406427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 369/723] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:51:37.417211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fe8ee-c183-4f2d-b51e-c546c1a7ade4 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:37.417565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fe8ee-c183-4f2d-b51e-c546c1a7ade4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:37.417953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fe8ee-c183-4f2d-b51e-c546c1a7ade4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:37.454710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5a5fe8ee-c183-4f2d-b51e-c546c1a7ade4 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:37.456172 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5a5fe8ee-c183-4f2d-b51e-c546c1a7ade4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:37.483153 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210afac-094d-4198-9248-8f9506a92785 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:37.518122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:37.555098 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008b742-402b-4138-a70e-149a184187ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:37.555783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008b742-402b-4138-a70e-149a184187ac None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:37.556064 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008b742-402b-4138-a70e-149a184187ac None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:37.556337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008b742-402b-4138-a70e-149a184187ac None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:37.557101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008b742-402b-4138-a70e-149a184187ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:37.557408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008b742-402b-4138-a70e-149a184187ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:37.558824 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008b742-402b-4138-a70e-149a184187ac None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:37.571477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 355/724] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:51:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:37.577260 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008b742-402b-4138-a70e-149a184187ac None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:37.591516 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 370/725] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 18 16:51:37.629022 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fe8ee-c183-4f2d-b51e-c546c1a7ade4 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:37.688794 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:37.744614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008b742-402b-4138-a70e-149a184187ac None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:37.805588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8e5e6-fd1c-408c-89c0-24f18ed10b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:37.806353 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8e5e6-fd1c-408c-89c0-24f18ed10b3a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:37.806636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8e5e6-fd1c-408c-89c0-24f18ed10b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:37.806917 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8e5e6-fd1c-408c-89c0-24f18ed10b3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:37.826037 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fe8ee-c183-4f2d-b51e-c546c1a7ade4 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:37.838661 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8e5e6-fd1c-408c-89c0-24f18ed10b3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:37.840232 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8e5e6-fd1c-408c-89c0-24f18ed10b3a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:37.867563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-04c8e5e6-fd1c-408c-89c0-24f18ed10b3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:37.867563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:37.867563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:37.867563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:37.867563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:37.867563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:37.867563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:37.867563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:37.867563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:37.867563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:37.867563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:37.867563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:37.867563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:37.867563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:37.867563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:37.868527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:37.868527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:37.868527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:37.868527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:37.868527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:37.868527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:37.868527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:37.868527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:37.868527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:37.868527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:37.868527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:37.868527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:37.868527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:37.868527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:37.868527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:37.868527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:37.868527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:37.869429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:37.869429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:37.869429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:37.869429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:37.869429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 356/726] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:37.874676 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8e5e6-fd1c-408c-89c0-24f18ed10b3a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:37.928111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1668cec-dee5-4575-be6c-411463af0ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:37.928956 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1668cec-dee5-4575-be6c-411463af0ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:37.929240 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1668cec-dee5-4575-be6c-411463af0ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:37.929518 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1668cec-dee5-4575-be6c-411463af0ea7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:37.964205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1668cec-dee5-4575-be6c-411463af0ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:37.972242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-f1668cec-dee5-4575-be6c-411463af0ea7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:37.972242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:37.972242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:37.972242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:37.972242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:37.972242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:37.972242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:37.972242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:37.972242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:37.972242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:37.972242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:37.972242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:37.972242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:37.972242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:37.972242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:37.972242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:37.975079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:37.975079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:37.975079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:37.975079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:37.975079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:37.975079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:37.975079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:37.975079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:37.975079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:37.975079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:37.975079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:37.975079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:37.975079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:37.975079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:37.975079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:37.975079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:37.976202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:37.976202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:37.976202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:37.976202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:37.976202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:37.976202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:37.976202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:37.976202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:37.976202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:37.976202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:37.976202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:37.976202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:37.976202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 371/727] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:37.980216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1668cec-dee5-4575-be6c-411463af0ea7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:38.043569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:38.122172 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8e5e6-fd1c-408c-89c0-24f18ed10b3a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:38.160040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6527769-60c4-4cae-a894-296abdfbd30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:38.160713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6527769-60c4-4cae-a894-296abdfbd30b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:38.161713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6527769-60c4-4cae-a894-296abdfbd30b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:38.162010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6527769-60c4-4cae-a894-296abdfbd30b None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:38.162745 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6527769-60c4-4cae-a894-296abdfbd30b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:38.163049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6527769-60c4-4cae-a894-296abdfbd30b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:38.164454 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6527769-60c4-4cae-a894-296abdfbd30b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:38.182002 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 357/728] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:38.183390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6527769-60c4-4cae-a894-296abdfbd30b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:38.199736 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:38.216011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1668cec-dee5-4575-be6c-411463af0ea7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:38.295181 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:38.303715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6527769-60c4-4cae-a894-296abdfbd30b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:38.315302 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf9838-5dad-433b-b00f-a1c2e9aa1ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:38.316687 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf9838-5dad-433b-b00f-a1c2e9aa1ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:38.317176 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf9838-5dad-433b-b00f-a1c2e9aa1ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:38.318275 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf9838-5dad-433b-b00f-a1c2e9aa1ed6 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:38.319267 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf9838-5dad-433b-b00f-a1c2e9aa1ed6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:38.319805 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf9838-5dad-433b-b00f-a1c2e9aa1ed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:38.321417 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf9838-5dad-433b-b00f-a1c2e9aa1ed6 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:38.341161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839964de-6ffc-4c72-913f-4ddfd8d3545f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:38.342040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839964de-6ffc-4c72-913f-4ddfd8d3545f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:38.342344 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839964de-6ffc-4c72-913f-4ddfd8d3545f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:38.342598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839964de-6ffc-4c72-913f-4ddfd8d3545f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:38.352248 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839964de-6ffc-4c72-913f-4ddfd8d3545f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:38.352248 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839964de-6ffc-4c72-913f-4ddfd8d3545f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:38.352918 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 372/729] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:51:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:38.360306 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf9838-5dad-433b-b00f-a1c2e9aa1ed6 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:38.367402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-839964de-6ffc-4c72-913f-4ddfd8d3545f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 16:51:38.367402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:38.367402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:38.367402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:38.367402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:38.367402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:38.367402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:38.367402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:38.367402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:38.367402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:38.367402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:38.367402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:38.367402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:38.367402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:38.367402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:38.367402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:38.368360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:38.368360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:38.368360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:38.368360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:38.368360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:38.368360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:38.368360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:38.368360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:38.368360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:38.368360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:38.368360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:38.368360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:38.368360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:38.368360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:38.368360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:38.368360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:38.368360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:38.368360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:38.370225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:38.370225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:38.370225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:38.370225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:38.370225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:38.370225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:38.370225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:38.370225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:38.370225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 16:51:38.370225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:38.370225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 358/730] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:51:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:38.381685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839964de-6ffc-4c72-913f-4ddfd8d3545f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:38.484089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839964de-6ffc-4c72-913f-4ddfd8d3545f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:38.519760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa92c05-4137-416d-ab90-2dc1e3096e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:38.521219 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa92c05-4137-416d-ab90-2dc1e3096e38 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:38.521534 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa92c05-4137-416d-ab90-2dc1e3096e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:38.521856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa92c05-4137-416d-ab90-2dc1e3096e38 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:38.522701 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa92c05-4137-416d-ab90-2dc1e3096e38 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:38.523002 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa92c05-4137-416d-ab90-2dc1e3096e38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:38.524462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa92c05-4137-416d-ab90-2dc1e3096e38 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:38.527170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf9838-5dad-433b-b00f-a1c2e9aa1ed6 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:38.546417 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 359/731] 10.222.0.49 () {56 vars in 1135 bytes} [Wed May 18 16:51:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:38.547951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f08ead-9f4a-4b66-9453-b653120782a5 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:38.548242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f08ead-9f4a-4b66-9453-b653120782a5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:38.548516 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f08ead-9f4a-4b66-9453-b653120782a5 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:38.555825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 360/732] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:38.556788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f08ead-9f4a-4b66-9453-b653120782a5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:38.574113 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:38.584720 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241e4c7-4014-482f-8454-ad5b089a3c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:38.586043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241e4c7-4014-482f-8454-ad5b089a3c85 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:38.586329 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241e4c7-4014-482f-8454-ad5b089a3c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:38.586603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241e4c7-4014-482f-8454-ad5b089a3c85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:38.602492 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241e4c7-4014-482f-8454-ad5b089a3c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:38.603987 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241e4c7-4014-482f-8454-ad5b089a3c85 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:38.626307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-0241e4c7-4014-482f-8454-ad5b089a3c85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:38.626307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:38.626307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:38.626307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:38.626307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:38.626307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:38.626307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:38.626307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:38.626307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:38.626307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:38.626307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:38.626307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:38.626307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:38.626307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:38.626307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:38.627415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:38.627415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:38.627415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:38.627415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:38.627415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:38.627415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:38.627415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:38.627415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:38.627415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:38.627415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:38.627415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:38.627415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:38.627415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:38.627415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:38.627415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:38.627415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:38.627415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:38.628338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:38.628338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:38.628338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:38.628338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:38.628338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 373/733] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:38.629433 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11728f77-bad2-4e50-9704-d6b68a349212 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:38.629773 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11728f77-bad2-4e50-9704-d6b68a349212 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:38.630059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11728f77-bad2-4e50-9704-d6b68a349212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:38.652297 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-11728f77-bad2-4e50-9704-d6b68a349212 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:38.653563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-11728f77-bad2-4e50-9704-d6b68a349212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:38.657460 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:38.690554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f08ead-9f4a-4b66-9453-b653120782a5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:38.737940 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 374/734] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:38.739808 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11728f77-bad2-4e50-9704-d6b68a349212 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:38.746426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36979a-4f18-40a2-a76d-2dfdc880c515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:38.747108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36979a-4f18-40a2-a76d-2dfdc880c515 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:38.747393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36979a-4f18-40a2-a76d-2dfdc880c515 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:38.747673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36979a-4f18-40a2-a76d-2dfdc880c515 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:38.822495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36979a-4f18-40a2-a76d-2dfdc880c515 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:38.823954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36979a-4f18-40a2-a76d-2dfdc880c515 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:38.840733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:38.851572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11728f77-bad2-4e50-9704-d6b68a349212 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:38.889595 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ff9bf-1f51-4f6f-918b-506eb367622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:38.890322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ff9bf-1f51-4f6f-918b-506eb367622c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:38.890610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ff9bf-1f51-4f6f-918b-506eb367622c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:38.890888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ff9bf-1f51-4f6f-918b-506eb367622c None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:38.891616 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ff9bf-1f51-4f6f-918b-506eb367622c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:38.891924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ff9bf-1f51-4f6f-918b-506eb367622c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:38.893296 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ff9bf-1f51-4f6f-918b-506eb367622c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:38.903991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:38.912610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 375/735] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:38.914268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ff860-998b-4eca-8a25-7ad8b9e67993 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:38.914557 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ff860-998b-4eca-8a25-7ad8b9e67993 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:38.914838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ff860-998b-4eca-8a25-7ad8b9e67993 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:38.916297 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 376/736] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:38.921013 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ff860-998b-4eca-8a25-7ad8b9e67993 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:38.941144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 361/737] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:51:38.941144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36979a-4f18-40a2-a76d-2dfdc880c515 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:39.037903 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ff860-998b-4eca-8a25-7ad8b9e67993 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:39.068206 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36979a-4f18-40a2-a76d-2dfdc880c515 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:39.082409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:39.085799 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533609d-5ccb-4dbf-86c3-bf8d39a2e8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:39.086804 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533609d-5ccb-4dbf-86c3-bf8d39a2e8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:39.087259 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533609d-5ccb-4dbf-86c3-bf8d39a2e8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:39.087539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533609d-5ccb-4dbf-86c3-bf8d39a2e8e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:39.098472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533609d-5ccb-4dbf-86c3-bf8d39a2e8e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:39.106580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a2004-2f0d-45d4-a0ed-e745651d5f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:39.106943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-b533609d-5ccb-4dbf-86c3-bf8d39a2e8e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:51:39.106943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:39.106943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:39.106943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:39.106943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:39.106943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:39.106943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:39.106943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:39.106943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:39.106943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:39.106943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:39.106943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:39.106943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:39.106943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:39.106943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:39.106943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:39.108062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:39.108062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:39.108062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:39.108062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:39.108062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:39.108062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:39.108062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:39.108062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:39.108062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:39.108062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:39.108062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:39.108062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:39.108062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:39.108062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:39.108062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:39.108062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:39.108917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:39.108917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:39.108917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:39.108917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:39.108917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:39.108917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:39.108917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:39.108917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:39.108917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:39.108917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:39.108917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:51:39.108917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:39.108917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 377/738] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:51:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:39.109603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4c7f6-5b6c-4b47-bbc1-5bf0638aef29 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:39.109755 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4c7f6-5b6c-4b47-bbc1-5bf0638aef29 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:39.110043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4c7f6-5b6c-4b47-bbc1-5bf0638aef29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:39.110718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a2004-2f0d-45d4-a0ed-e745651d5f63 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:39.111129 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a2004-2f0d-45d4-a0ed-e745651d5f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:39.111528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a2004-2f0d-45d4-a0ed-e745651d5f63 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:39.121429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a2004-2f0d-45d4-a0ed-e745651d5f63 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:39.123128 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a2004-2f0d-45d4-a0ed-e745651d5f63 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:39.129439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-3ec4c7f6-5b6c-4b47-bbc1-5bf0638aef29 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:39.131176 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3ec4c7f6-5b6c-4b47-bbc1-5bf0638aef29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:39.139242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-519a2004-2f0d-45d4-a0ed-e745651d5f63 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 16:51:39.139242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:39.139242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:39.139242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:39.139242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:39.139242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:39.139242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:39.139242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:39.139242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:39.139242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:39.139242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:39.139242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:39.139242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:39.139242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:39.139242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:39.139242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:39.140203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:39.140203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:39.140203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:39.140203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:39.140203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:39.140203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:39.140203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:39.140203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:39.140203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:39.140203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:39.140203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:39.140203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:39.140203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:39.140203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:39.140203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:39.140203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:39.140203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:39.140203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:39.141149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:39.141149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:39.141149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:39.141149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:39.141149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:39.141149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:39.141149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:39.141149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:39.141149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 16:51:39.141149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:39.141149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 362/739] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 18 16:51:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:39.141149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a2004-2f0d-45d4-a0ed-e745651d5f63 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:39.196043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:39.210735 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 378/740] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:39.211411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4c7f6-5b6c-4b47-bbc1-5bf0638aef29 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:39.273530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a2004-2f0d-45d4-a0ed-e745651d5f63 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:39.307563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901e828-6e55-4b0d-b912-8407f309f94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:39.308361 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901e828-6e55-4b0d-b912-8407f309f94e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:39.308644 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901e828-6e55-4b0d-b912-8407f309f94e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:39.308922 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901e828-6e55-4b0d-b912-8407f309f94e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:39.320500 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901e828-6e55-4b0d-b912-8407f309f94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:39.321555 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4c7f6-5b6c-4b47-bbc1-5bf0638aef29 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:39.322060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901e828-6e55-4b0d-b912-8407f309f94e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:39.341082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-4901e828-6e55-4b0d-b912-8407f309f94e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:39.341082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:39.341082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:39.341082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:39.341082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:39.341082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:39.341082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:39.341082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:39.341082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:39.341082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:39.341082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:39.341082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:39.341082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:39.341082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:39.341082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:39.342171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:39.342171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:39.342171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:39.342171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:39.342171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:39.342171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:39.342171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:39.342171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:39.342171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:39.342171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:39.342171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:39.342171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:39.342171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:39.342171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:39.342171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:39.342171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:39.342171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:39.343082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:39.343082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:39.343082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:39.343082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:39.343082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 363/741] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:39.343082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901e828-6e55-4b0d-b912-8407f309f94e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:39.365072 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbf9d0-7a59-48b2-a564-e9ede5651d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:39.365688 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbf9d0-7a59-48b2-a564-e9ede5651d85 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:39.365981 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbf9d0-7a59-48b2-a564-e9ede5651d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:39.366267 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbf9d0-7a59-48b2-a564-e9ede5651d85 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:39.367028 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbf9d0-7a59-48b2-a564-e9ede5651d85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:39.367336 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbf9d0-7a59-48b2-a564-e9ede5651d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:39.368567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:39.368731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbf9d0-7a59-48b2-a564-e9ede5651d85 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:39.377551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 379/742] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:51:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:39.378841 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6af29-d065-4ab0-ae6a-98532a3cff88 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:39.379128 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6af29-d065-4ab0-ae6a-98532a3cff88 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:39.379405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6af29-d065-4ab0-ae6a-98532a3cff88 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:39.381367 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 380/743] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:39.382218 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6af29-d065-4ab0-ae6a-98532a3cff88 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:39.440958 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:39.451872 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901e828-6e55-4b0d-b912-8407f309f94e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:39.486961 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83e714-e730-4c9c-9920-8351d7fed8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:39.487642 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83e714-e730-4c9c-9920-8351d7fed8ab None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:39.487952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83e714-e730-4c9c-9920-8351d7fed8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:39.488207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83e714-e730-4c9c-9920-8351d7fed8ab None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:39.489308 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83e714-e730-4c9c-9920-8351d7fed8ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:39.489581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83e714-e730-4c9c-9920-8351d7fed8ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:39.490858 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83e714-e730-4c9c-9920-8351d7fed8ab None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:39.492781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6af29-d065-4ab0-ae6a-98532a3cff88 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:39.508554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 364/744] 10.222.0.49 () {56 vars in 1149 bytes} [Wed May 18 16:51:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:39.509373 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83e714-e730-4c9c-9920-8351d7fed8ab None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:39.531895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f42f98-94d8-4288-b20a-96e1eb8133cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:39.532561 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f42f98-94d8-4288-b20a-96e1eb8133cd None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:39.532849 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f42f98-94d8-4288-b20a-96e1eb8133cd None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:39.533126 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f42f98-94d8-4288-b20a-96e1eb8133cd None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:39.533882 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f42f98-94d8-4288-b20a-96e1eb8133cd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:39.535266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f42f98-94d8-4288-b20a-96e1eb8133cd None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:39.551231 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 381/745] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 18 16:51:39 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:51:39.552425 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f42f98-94d8-4288-b20a-96e1eb8133cd None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:39.610690 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:39.634869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83e714-e730-4c9c-9920-8351d7fed8ab None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:39.681416 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f42f98-94d8-4288-b20a-96e1eb8133cd None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:39.692913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:39.693128 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513fdd7-9721-43b9-9721-c567cd7492e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:39.694370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513fdd7-9721-43b9-9721-c567cd7492e5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:39.694662 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513fdd7-9721-43b9-9721-c567cd7492e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:39.694944 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513fdd7-9721-43b9-9721-c567cd7492e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:39.695710 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513fdd7-9721-43b9-9721-c567cd7492e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:39.696021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513fdd7-9721-43b9-9721-c567cd7492e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:39.697433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513fdd7-9721-43b9-9721-c567cd7492e5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:39.711857 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 365/746] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:39.713297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27433268-21ac-4eb7-8486-ffd8a477fafd None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:39.713595 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27433268-21ac-4eb7-8486-ffd8a477fafd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:39.713938 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27433268-21ac-4eb7-8486-ffd8a477fafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:39.732475 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b5f05-e831-45a9-b5f2-3ee417f74d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:39.733442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b5f05-e831-45a9-b5f2-3ee417f74d97 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:39.733745 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-27433268-21ac-4eb7-8486-ffd8a477fafd None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:39.733854 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b5f05-e831-45a9-b5f2-3ee417f74d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:39.734042 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b5f05-e831-45a9-b5f2-3ee417f74d97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:39.734955 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-27433268-21ac-4eb7-8486-ffd8a477fafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:39.746101 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b5f05-e831-45a9-b5f2-3ee417f74d97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:39.747574 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b5f05-e831-45a9-b5f2-3ee417f74d97 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:39.767899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-070b5f05-e831-45a9-b5f2-3ee417f74d97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:39.767899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:39.767899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:39.767899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:39.767899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:39.767899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:39.767899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:39.767899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:39.767899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:39.767899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:39.767899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:39.767899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:39.767899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:39.767899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:39.767899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:39.769017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:39.769017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:39.769017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:39.769017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:39.769017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:39.769017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:39.769017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:39.769017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:39.769017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:39.769017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:39.769017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:39.769017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:39.769017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:39.769017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:39.769017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:39.769017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:39.769017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:39.770217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:39.770217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:39.770217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:39.770217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:39.770217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 382/747] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:39.771299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b5f05-e831-45a9-b5f2-3ee417f74d97 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:39.819900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 366/748] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 18 16:51:39.820533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27433268-21ac-4eb7-8486-ffd8a477fafd None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:39.894312 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b5f05-e831-45a9-b5f2-3ee417f74d97 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:39.894727 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:39.933152 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a5959-b817-42ff-96a4-38b5c5db5e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:39.933365 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27433268-21ac-4eb7-8486-ffd8a477fafd None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:39.933850 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5959-b817-42ff-96a4-38b5c5db5e6d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:39.934137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5959-b817-42ff-96a4-38b5c5db5e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:39.934413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5959-b817-42ff-96a4-38b5c5db5e6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:39.965558 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:39.975613 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5f6e7-a0a3-48dc-9e15-9bd64f578c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:39.976421 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5f6e7-a0a3-48dc-9e15-9bd64f578c21 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:39.976706 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5f6e7-a0a3-48dc-9e15-9bd64f578c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:39.977278 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5f6e7-a0a3-48dc-9e15-9bd64f578c21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:39.984402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5f6e7-a0a3-48dc-9e15-9bd64f578c21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:39.985894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5f6e7-a0a3-48dc-9e15-9bd64f578c21 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:40.001713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-86f5f6e7-a0a3-48dc-9e15-9bd64f578c21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:40.001713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:40.001713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:40.001713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:40.001713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:40.001713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:40.001713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:40.001713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:40.001713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:40.001713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:40.001713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:40.001713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:40.001713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:40.001713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:40.001713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:40.002651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:40.002651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:40.002651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:40.002651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:40.002651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:40.002651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:40.002651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:40.002651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:40.002651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:40.002651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:40.002651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:40.002651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:40.002651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:40.002651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:40.002651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:40.002651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:40.002651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:40.003552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:40.003552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:40.003552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:40.003552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:40.003552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:40.003552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:40.003552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:40.003552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:40.003552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 367/749] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:40.004042 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5f6e7-a0a3-48dc-9e15-9bd64f578c21 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:40.013133 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a5959-b817-42ff-96a4-38b5c5db5e6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:40.014626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a5959-b817-42ff-96a4-38b5c5db5e6d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:40.122888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5f6e7-a0a3-48dc-9e15-9bd64f578c21 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:40.130965 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 383/750] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:39 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 18 16:51:40.131613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a5959-b817-42ff-96a4-38b5c5db5e6d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:40.158374 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:40.167013 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdff283-ba1d-4449-842a-ad9967389a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:40.167677 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdff283-ba1d-4449-842a-ad9967389a22 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:40.168051 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdff283-ba1d-4449-842a-ad9967389a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:40.168229 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdff283-ba1d-4449-842a-ad9967389a22 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:40.168958 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdff283-ba1d-4449-842a-ad9967389a22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:40.169263 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdff283-ba1d-4449-842a-ad9967389a22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:40.170675 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdff283-ba1d-4449-842a-ad9967389a22 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:40.183300 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 368/751] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:40.184156 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdff283-ba1d-4449-842a-ad9967389a22 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:40.201335 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:40.248442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a5959-b817-42ff-96a4-38b5c5db5e6d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:40.287711 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dcd05-c4c9-4d85-befd-d599d67631dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:40.288388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dcd05-c4c9-4d85-befd-d599d67631dc None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:40.288677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dcd05-c4c9-4d85-befd-d599d67631dc None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:40.288974 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dcd05-c4c9-4d85-befd-d599d67631dc None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:40.289714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2dcd05-c4c9-4d85-befd-d599d67631dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:40.291123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2dcd05-c4c9-4d85-befd-d599d67631dc None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:40.291934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdff283-ba1d-4449-842a-ad9967389a22 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:40.305976 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 384/752] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 18 16:51:40 2022] POST /identity/v3/services => generated 240 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:51:40.306862 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dcd05-c4c9-4d85-befd-d599d67631dc None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:40.351640 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a791d8d-47c2-4815-85dd-ef9d2b51aa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:40.353993 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a791d8d-47c2-4815-85dd-ef9d2b51aa46 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:40.355111 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a791d8d-47c2-4815-85dd-ef9d2b51aa46 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:40.355659 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a791d8d-47c2-4815-85dd-ef9d2b51aa46 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:40.356988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a791d8d-47c2-4815-85dd-ef9d2b51aa46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:40.357791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a791d8d-47c2-4815-85dd-ef9d2b51aa46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:40.360387 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a791d8d-47c2-4815-85dd-ef9d2b51aa46 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:40.377200 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 369/753] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:40.378604 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a791d8d-47c2-4815-85dd-ef9d2b51aa46 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:40.449132 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dcd05-c4c9-4d85-befd-d599d67631dc None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:40.453724 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:40.475419 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:40.499526 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609c9b2-9bcd-4b5e-8b4e-d9ad7ab192ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:40.500555 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609c9b2-9bcd-4b5e-8b4e-d9ad7ab192ec None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:40.500953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609c9b2-9bcd-4b5e-8b4e-d9ad7ab192ec None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:40.501361 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609c9b2-9bcd-4b5e-8b4e-d9ad7ab192ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:40.514272 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609c9b2-9bcd-4b5e-8b4e-d9ad7ab192ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:40.515879 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609c9b2-9bcd-4b5e-8b4e-d9ad7ab192ec None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:40.538375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-0609c9b2-9bcd-4b5e-8b4e-d9ad7ab192ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:40.538375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:40.538375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:40.538375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:40.538375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:40.538375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:40.538375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:40.538375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:40.538375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:40.538375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:40.538375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:40.538375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:40.538375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:40.538375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:40.538375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:40.539326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:40.539326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:40.539326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:40.539326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:40.539326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:40.539326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:40.539326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:40.539326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:40.539326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:40.539326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:40.539326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:40.539326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:40.539326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:40.539326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:40.539326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:40.539326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:40.539326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:40.541373 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:40.541373 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:40.541373 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:40.541373 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:40.541373 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 385/754] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:40.541899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a791d8d-47c2-4815-85dd-ef9d2b51aa46 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:40.542004 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609c9b2-9bcd-4b5e-8b4e-d9ad7ab192ec None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:40.592466 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be855087-a735-4a39-8abd-644dc36a7961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:40.593683 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be855087-a735-4a39-8abd-644dc36a7961 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:40.594169 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be855087-a735-4a39-8abd-644dc36a7961 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:40.594640 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be855087-a735-4a39-8abd-644dc36a7961 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:40.606117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be855087-a735-4a39-8abd-644dc36a7961 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:40.608512 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be855087-a735-4a39-8abd-644dc36a7961 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:40.628407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-be855087-a735-4a39-8abd-644dc36a7961 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 16:51:40.628407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:40.628407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:40.628407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:40.628407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:40.628407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:40.628407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:40.628407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:40.628407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:40.628407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:40.628407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:40.628407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:40.628407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:40.628407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:40.628407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:40.628407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:40.629550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:40.629550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:40.629550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:40.629550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:40.629550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:40.629550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:40.629550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:40.629550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:40.629550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:40.629550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:40.629550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:40.629550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:40.629550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:40.629550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:40.629550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:40.629550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:40.629550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:40.629550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:40.630901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:40.630901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:40.630901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:40.630901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:40.630901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:40.630901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:40.630901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:40.630901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:40.630901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 16:51:40.630901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:40.634206 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 370/755] 10.222.0.49 () {56 vars in 1093 bytes} [Wed May 18 16:51:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:40.635242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be855087-a735-4a39-8abd-644dc36a7961 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:40.677343 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609c9b2-9bcd-4b5e-8b4e-d9ad7ab192ec None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:40.717576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27ec50-67d3-4274-b76b-675703339d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:40.718522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27ec50-67d3-4274-b76b-675703339d35 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:40.718995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27ec50-67d3-4274-b76b-675703339d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:40.719539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27ec50-67d3-4274-b76b-675703339d35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:40.720642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27ec50-67d3-4274-b76b-675703339d35 None admin] RBAC: Adding query filter params (role.id=b3f3f4910bf646699f30b749edeef422, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=b712c7f5fce54fe2a89d63863f3845f0) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:40.721114 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27ec50-67d3-4274-b76b-675703339d35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:40.722916 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27ec50-67d3-4274-b76b-675703339d35 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:40.730388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 386/756] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:51:40 2022] GET /identity/v3/role_assignments?user.id=b712c7f5fce54fe2a89d63863f3845f0&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=b3f3f4910bf646699f30b749edeef422 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:40.731639 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27ec50-67d3-4274-b76b-675703339d35 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:40.776690 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be855087-a735-4a39-8abd-644dc36a7961 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:40.779423 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:40.782668 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:40.837231 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151d913-0a9c-411d-ab2f-91324084394f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:40.838541 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151d913-0a9c-411d-ab2f-91324084394f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:40.839108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151d913-0a9c-411d-ab2f-91324084394f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:40.839623 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151d913-0a9c-411d-ab2f-91324084394f None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:40.840652 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151d913-0a9c-411d-ab2f-91324084394f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:40.841061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151d913-0a9c-411d-ab2f-91324084394f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:40.843022 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151d913-0a9c-411d-ab2f-91324084394f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:40.857470 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 371/757] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:40.863078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151d913-0a9c-411d-ab2f-91324084394f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:40.874423 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27ec50-67d3-4274-b76b-675703339d35 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:40.918173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7298815-9c4d-4d32-92ea-ed23e4e511cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:40.919109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7298815-9c4d-4d32-92ea-ed23e4e511cd None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:40.919610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7298815-9c4d-4d32-92ea-ed23e4e511cd None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:40.920129 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7298815-9c4d-4d32-92ea-ed23e4e511cd None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:40.921287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7298815-9c4d-4d32-92ea-ed23e4e511cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:40.921778 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7298815-9c4d-4d32-92ea-ed23e4e511cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:40.923398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7298815-9c4d-4d32-92ea-ed23e4e511cd None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:40.949549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 387/758] 10.222.0.49 () {56 vars in 1133 bytes} [Wed May 18 16:51:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:40.951331 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7298815-9c4d-4d32-92ea-ed23e4e511cd None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:41.000598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151d913-0a9c-411d-ab2f-91324084394f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:41.073526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e4fd5-7efb-49b6-a97e-95dfc6efbcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:41.074558 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e4fd5-7efb-49b6-a97e-95dfc6efbcce None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:41.075009 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e4fd5-7efb-49b6-a97e-95dfc6efbcce None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:41.075425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e4fd5-7efb-49b6-a97e-95dfc6efbcce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:41.085275 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e4fd5-7efb-49b6-a97e-95dfc6efbcce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:41.086983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e4fd5-7efb-49b6-a97e-95dfc6efbcce None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:41.105125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e64e4fd5-7efb-49b6-a97e-95dfc6efbcce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:41.105125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:41.105125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:41.105125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:41.105125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:41.105125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:41.105125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:41.105125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:41.105125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:41.105125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:41.105125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:41.105125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:41.105125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:41.105125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:41.105125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:41.106264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:41.106264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:41.106264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:41.106264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:41.106264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:41.106264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:41.106264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:41.106264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:41.106264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:41.106264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:41.106264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:41.106264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:41.106264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:41.106264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:41.106264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:41.106264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:41.106264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:41.107205 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:41.107205 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:41.107205 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:41.107205 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:41.107205 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:41.107205 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:41.107205 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:41.107205 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:41.109722 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 372/759] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:41.118735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e4fd5-7efb-49b6-a97e-95dfc6efbcce None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:41.158298 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:41.171127 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7298815-9c4d-4d32-92ea-ed23e4e511cd None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:41.189333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:41.243307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a188c-3a92-4227-88a5-a24287106b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:41.244113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a188c-3a92-4227-88a5-a24287106b1a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:41.244394 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a188c-3a92-4227-88a5-a24287106b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:41.244667 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a188c-3a92-4227-88a5-a24287106b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:41.266256 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a188c-3a92-4227-88a5-a24287106b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:41.267672 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a188c-3a92-4227-88a5-a24287106b1a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:41.298268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-b66a188c-3a92-4227-88a5-a24287106b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:41.298268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:41.298268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:41.298268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:41.298268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:41.298268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:41.298268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:41.298268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:41.298268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:41.298268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:41.298268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:41.298268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:41.298268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:41.298268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:41.298268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:41.299220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:41.299220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:41.299220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:41.299220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:41.299220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:41.299220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:41.299220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:41.299220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:41.299220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:41.299220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:41.299220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:41.299220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:41.299220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:41.299220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:41.299220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:41.299220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:41.299220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:41.300103 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:41.300103 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:41.300103 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:41.300103 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:41.309104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 388/760] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:41.310016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a188c-3a92-4227-88a5-a24287106b1a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:41.327324 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e4fd5-7efb-49b6-a97e-95dfc6efbcce None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:41.393386 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9213c-0fb4-4c68-b703-6cad2c635fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:41.394085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9213c-0fb4-4c68-b703-6cad2c635fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:41.394366 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9213c-0fb4-4c68-b703-6cad2c635fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:41.394638 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9213c-0fb4-4c68-b703-6cad2c635fa4 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:41.396090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9213c-0fb4-4c68-b703-6cad2c635fa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:41.396533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9213c-0fb4-4c68-b703-6cad2c635fa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:41.397987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9213c-0fb4-4c68-b703-6cad2c635fa4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:41.434515 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 373/761] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:41.435492 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9213c-0fb4-4c68-b703-6cad2c635fa4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:41.479527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a188c-3a92-4227-88a5-a24287106b1a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:41.541524 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94a95b-5b43-481d-bd9a-9c8de14df22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:41.542146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94a95b-5b43-481d-bd9a-9c8de14df22c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:41.542428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94a95b-5b43-481d-bd9a-9c8de14df22c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:41.542698 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94a95b-5b43-481d-bd9a-9c8de14df22c None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:41.543529 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94a95b-5b43-481d-bd9a-9c8de14df22c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:41.543834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94a95b-5b43-481d-bd9a-9c8de14df22c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:41.545290 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94a95b-5b43-481d-bd9a-9c8de14df22c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:41.573865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 389/762] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:41.577721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94a95b-5b43-481d-bd9a-9c8de14df22c None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:41.579385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:41.591397 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:41.616979 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9213c-0fb4-4c68-b703-6cad2c635fa4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:41.685034 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f15f11-e32a-4791-a2fa-ae564ad4e26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:41.686682 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f15f11-e32a-4791-a2fa-ae564ad4e26e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:41.686965 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f15f11-e32a-4791-a2fa-ae564ad4e26e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:41.687234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f15f11-e32a-4791-a2fa-ae564ad4e26e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:41.688828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f15f11-e32a-4791-a2fa-ae564ad4e26e None admin] RBAC: Adding query filter params (role.id=c6328736ee34470cb87aa31dea4530bf, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=9692d55c8c924544a1bff62054731ed2) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:41.689141 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f15f11-e32a-4791-a2fa-ae564ad4e26e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:41.690903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f15f11-e32a-4791-a2fa-ae564ad4e26e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:41.703348 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 374/763] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:51:41 2022] GET /identity/v3/role_assignments?user.id=9692d55c8c924544a1bff62054731ed2&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=c6328736ee34470cb87aa31dea4530bf => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:41.764434 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94a95b-5b43-481d-bd9a-9c8de14df22c None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:41.827334 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059b5fb-238b-42db-b1b1-e6a40f38875f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:41.828099 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059b5fb-238b-42db-b1b1-e6a40f38875f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:41.828387 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059b5fb-238b-42db-b1b1-e6a40f38875f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:41.828670 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059b5fb-238b-42db-b1b1-e6a40f38875f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:41.840345 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059b5fb-238b-42db-b1b1-e6a40f38875f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:41.841919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059b5fb-238b-42db-b1b1-e6a40f38875f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:41.864919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-9059b5fb-238b-42db-b1b1-e6a40f38875f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:41.864919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:41.864919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:41.864919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:41.864919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:41.864919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:41.864919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:41.864919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:41.864919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:41.864919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:41.864919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:41.864919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:41.864919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:41.864919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:41.864919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:41.865934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:41.865934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:41.865934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:41.865934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:41.865934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:41.865934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:41.865934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:41.865934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:41.865934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:41.865934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:41.865934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:41.865934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:41.865934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:41.865934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:41.865934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:41.865934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:41.865934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:41.867301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:41.867301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:41.867301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:41.867301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:41.867301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:41.867301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:41.867301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:41.867301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:41.867301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 390/764] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:41.873757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f15f11-e32a-4791-a2fa-ae564ad4e26e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:42.028363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf3ba9-bc8d-47fd-9b5b-4b8d4a8875e0 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:42.029017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf3ba9-bc8d-47fd-9b5b-4b8d4a8875e0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:42.029494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf3ba9-bc8d-47fd-9b5b-4b8d4a8875e0 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:42.031088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f15f11-e32a-4791-a2fa-ae564ad4e26e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:42.035193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 391/765] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:42.037781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7aeb88-ee00-4259-8c09-0d9dbde014b7 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:42.038322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7aeb88-ee00-4259-8c09-0d9dbde014b7 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:42.038899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7aeb88-ee00-4259-8c09-0d9dbde014b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:42.061941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-8e7aeb88-ee00-4259-8c09-0d9dbde014b7 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:42.063558 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8e7aeb88-ee00-4259-8c09-0d9dbde014b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:42.079448 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c78853-6089-4ba1-a00b-71bf48d7ebf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:42.080068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c78853-6089-4ba1-a00b-71bf48d7ebf1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:42.080605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c78853-6089-4ba1-a00b-71bf48d7ebf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:42.080882 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c78853-6089-4ba1-a00b-71bf48d7ebf1 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:42.082044 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c78853-6089-4ba1-a00b-71bf48d7ebf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:42.082044 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c78853-6089-4ba1-a00b-71bf48d7ebf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:42.083482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c78853-6089-4ba1-a00b-71bf48d7ebf1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:42.109592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 375/766] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:42.126724 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c78853-6089-4ba1-a00b-71bf48d7ebf1 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:42.139034 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:42.143919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:42.157870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 392/767] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:51:42.188611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7aeb88-ee00-4259-8c09-0d9dbde014b7 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:42.270838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c78853-6089-4ba1-a00b-71bf48d7ebf1 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:42.307651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7aeb88-ee00-4259-8c09-0d9dbde014b7 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:42.325126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfd30f-5253-40b5-8547-f2ac5d74df3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:42.326061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfd30f-5253-40b5-8547-f2ac5d74df3c None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:42.326349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfd30f-5253-40b5-8547-f2ac5d74df3c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:42.326624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfd30f-5253-40b5-8547-f2ac5d74df3c None admin] PATH_INFO: `/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/c9e3c0ef5ed943d183b064f383fc01f3/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:42.328617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfd30f-5253-40b5-8547-f2ac5d74df3c None admin] RBAC: Authorizing `identity:create_grant(project_id=fcd3afbb3e384cb2939647002c60bbba, user_id=c9e3c0ef5ed943d183b064f383fc01f3, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:42.330140 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfd30f-5253-40b5-8547-f2ac5d74df3c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:42.347226 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee499d97-4e5f-49f4-b4dc-771cc94a52b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:42.349170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee499d97-4e5f-49f4-b4dc-771cc94a52b5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:42.349781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee499d97-4e5f-49f4-b4dc-771cc94a52b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:42.350391 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee499d97-4e5f-49f4-b4dc-771cc94a52b5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:42.351270 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee499d97-4e5f-49f4-b4dc-771cc94a52b5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:42.353265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee499d97-4e5f-49f4-b4dc-771cc94a52b5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:42.357608 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 376/768] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:51:42 2022] PUT /identity/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/c9e3c0ef5ed943d183b064f383fc01f3/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:51:42.375610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-ee499d97-4e5f-49f4-b4dc-771cc94a52b5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 16:51:42.375610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:42.375610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:51:42.375610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:51:42.375610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:51:42.375610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:51:42.375610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:51:42.375610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:42.375610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 16:51:42.375610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:42.375610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:51:42.375610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:42.375610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:42.375610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:42.375610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:42.375610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:42.376620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:42.376620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:42.376620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:42.376620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:42.376620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:42.376620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:42.376620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:42.376620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:51:42.376620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:51:42.376620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:51:42.376620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:51:42.376620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:42.376620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:42.376620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:42.376620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:42.376620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:42.377450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:42.377450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:42.377450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:42.377450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:42.377450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:42.377450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:42.377450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:42.377450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:42.377450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:42.377450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:42.377450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:42.377450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:51:42.377450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:42.377450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 16:51:42.377450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:42.380805 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 393/769] 10.222.0.49 () {56 vars in 1129 bytes} [Wed May 18 16:51:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:42.387566 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfd30f-5253-40b5-8547-f2ac5d74df3c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:42.500451 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:42.548653 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfd30f-5253-40b5-8547-f2ac5d74df3c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:42.588239 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caa79b-9866-488d-90f3-ea09cc268900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:42.588839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caa79b-9866-488d-90f3-ea09cc268900 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:42.589125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caa79b-9866-488d-90f3-ea09cc268900 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:42.589405 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caa79b-9866-488d-90f3-ea09cc268900 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:42.590162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52caa79b-9866-488d-90f3-ea09cc268900 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:42.590470 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52caa79b-9866-488d-90f3-ea09cc268900 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:42.591873 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52caa79b-9866-488d-90f3-ea09cc268900 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:42.597479 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 377/770] 10.222.0.49 () {56 vars in 1124 bytes} [Wed May 18 16:51:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:42.604354 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee499d97-4e5f-49f4-b4dc-771cc94a52b5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:42.681173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:42.729436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee499d97-4e5f-49f4-b4dc-771cc94a52b5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:42.781622 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07fb8d-b696-48dd-a76e-06744b4c1613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:42.782717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07fb8d-b696-48dd-a76e-06744b4c1613 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:42.783211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07fb8d-b696-48dd-a76e-06744b4c1613 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:42.783692 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07fb8d-b696-48dd-a76e-06744b4c1613 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:42.784618 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07fb8d-b696-48dd-a76e-06744b4c1613 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:42.785158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07fb8d-b696-48dd-a76e-06744b4c1613 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:42.787975 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07fb8d-b696-48dd-a76e-06744b4c1613 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:42.795273 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 394/771] 10.222.0.49 () {56 vars in 1124 bytes} [Wed May 18 16:51:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:42.802771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caa79b-9866-488d-90f3-ea09cc268900 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:42.935603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caa79b-9866-488d-90f3-ea09cc268900 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:42.956992 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49749f3-0a25-4b09-9b80-d6255e35b3b5 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:42.957310 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49749f3-0a25-4b09-9b80-d6255e35b3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:42.957561 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49749f3-0a25-4b09-9b80-d6255e35b3b5 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:42.959819 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 395/772] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:42.965322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204054c-c282-4643-83f4-652f0b577192 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:42.965611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204054c-c282-4643-83f4-652f0b577192 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:42.965919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204054c-c282-4643-83f4-652f0b577192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:42.969878 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:42.979508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd85ad9-1603-4081-bfd6-8533a3adf389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:42.980195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd85ad9-1603-4081-bfd6-8533a3adf389 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:42.980476 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd85ad9-1603-4081-bfd6-8533a3adf389 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:42.980757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd85ad9-1603-4081-bfd6-8533a3adf389 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:42.981558 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd85ad9-1603-4081-bfd6-8533a3adf389 None admin] RBAC: Adding query filter params (interface=public, service_id=406587b5691e4359818c67c425536b39, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:42.981908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd85ad9-1603-4081-bfd6-8533a3adf389 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:42.983276 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd85ad9-1603-4081-bfd6-8533a3adf389 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:43.001874 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f204054c-c282-4643-83f4-652f0b577192 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:43.003091 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f204054c-c282-4643-83f4-652f0b577192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:43.005883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 378/773] 10.222.0.49 () {56 vars in 1251 bytes} [Wed May 18 16:51:42 2022] GET /identity/v3/endpoints?service_id=406587b5691e4359818c67c425536b39&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:43.006781 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd85ad9-1603-4081-bfd6-8533a3adf389 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:43.167978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 396/774] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:51:43.174453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd85ad9-1603-4081-bfd6-8533a3adf389 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:43.203378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204054c-c282-4643-83f4-652f0b577192 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:43.213616 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f5a26-a982-4d32-81ee-923b4a0aa8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:43.214314 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f5a26-a982-4d32-81ee-923b4a0aa8b1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:43.214602 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f5a26-a982-4d32-81ee-923b4a0aa8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:43.214883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f5a26-a982-4d32-81ee-923b4a0aa8b1 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:43.215580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f5a26-a982-4d32-81ee-923b4a0aa8b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:43.216963 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f5a26-a982-4d32-81ee-923b4a0aa8b1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:43.223873 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 379/775] 10.222.0.49 () {56 vars in 1087 bytes} [Wed May 18 16:51:43 2022] GET /identity/v3/services => generated 772 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:43.280003 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:43.366004 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204054c-c282-4643-83f4-652f0b577192 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:43.406500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd64588-8dc0-412d-9f4a-63cfd221fa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:43.407321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd64588-8dc0-412d-9f4a-63cfd221fa81 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:43.407605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd64588-8dc0-412d-9f4a-63cfd221fa81 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:43.407881 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd64588-8dc0-412d-9f4a-63cfd221fa81 None admin] PATH_INFO: `/v3/services/network` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:43.408625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd64588-8dc0-412d-9f4a-63cfd221fa81 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:43.410152 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd64588-8dc0-412d-9f4a-63cfd221fa81 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:43.424094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-8fd64588-8dc0-412d-9f4a-63cfd221fa81 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 18 16:51:43.424094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:43.424094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:51:43.424094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:51:43.424094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:51:43.424094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:51:43.424094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:51:43.424094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:43.424094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 16:51:43.424094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:43.424094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:51:43.424094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:43.424094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:43.424094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:43.424094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:43.424094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:43.424094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:43.426503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:43.426503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:43.426503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:43.426503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:43.426503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:43.426503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:43.426503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:51:43.426503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:51:43.426503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:51:43.426503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:51:43.426503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:43.426503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:43.426503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:43.426503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:43.426503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:43.426503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:43.428436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:43.428436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:43.428436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:43.428436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:43.428436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:43.428436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:43.428436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:43.428436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:43.428436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:43.428436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:43.428436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:51:43.428436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:43.428436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 16:51:43.428436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:43.428436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 397/776] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:43 2022] GET /identity/v3/services/network => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:43.433696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f5a26-a982-4d32-81ee-923b4a0aa8b1 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:43.500505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:43.548163 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f5a26-a982-4d32-81ee-923b4a0aa8b1 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:43.553633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae440d-3545-42d7-a4a0-4fe1341568f5 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:43.553949 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae440d-3545-42d7-a4a0-4fe1341568f5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:43.554230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae440d-3545-42d7-a4a0-4fe1341568f5 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:43.555777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 398/777] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:43.561902 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ca39d-ece7-4a4a-af94-8b1af5b2e58e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:43.562466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ca39d-ece7-4a4a-af94-8b1af5b2e58e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:43.563017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ca39d-ece7-4a4a-af94-8b1af5b2e58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:43.583079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c47ca39d-ece7-4a4a-af94-8b1af5b2e58e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:43.584742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c47ca39d-ece7-4a4a-af94-8b1af5b2e58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:43.592308 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ee242-3591-44ca-94b1-92ce6f2c6ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:43.593415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ee242-3591-44ca-94b1-92ce6f2c6ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:43.593415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ee242-3591-44ca-94b1-92ce6f2c6ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:43.593610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ee242-3591-44ca-94b1-92ce6f2c6ee8 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:43.594283 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ee242-3591-44ca-94b1-92ce6f2c6ee8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:43.594590 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ee242-3591-44ca-94b1-92ce6f2c6ee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:43.596447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ee242-3591-44ca-94b1-92ce6f2c6ee8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:43.603342 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 380/778] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 18 16:51:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:43.607850 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ee242-3591-44ca-94b1-92ce6f2c6ee8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:43.673830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 399/779] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:51:43.696752 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ca39d-ece7-4a4a-af94-8b1af5b2e58e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:43.732651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ee242-3591-44ca-94b1-92ce6f2c6ee8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:43.751968 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:43.762572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:43.775433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b112910-b4c2-4cb1-8a7e-ae7f5eb3f652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:43.776277 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b112910-b4c2-4cb1-8a7e-ae7f5eb3f652 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:43.776569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b112910-b4c2-4cb1-8a7e-ae7f5eb3f652 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:43.776851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b112910-b4c2-4cb1-8a7e-ae7f5eb3f652 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:43.777567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b112910-b4c2-4cb1-8a7e-ae7f5eb3f652 None admin] RBAC: Adding query filter params (type=network) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:43.777904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b112910-b4c2-4cb1-8a7e-ae7f5eb3f652 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:43.780155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b112910-b4c2-4cb1-8a7e-ae7f5eb3f652 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:43.787498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 381/780] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 18 16:51:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:43.798657 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b112910-b4c2-4cb1-8a7e-ae7f5eb3f652 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:43.820890 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ca39d-ece7-4a4a-af94-8b1af5b2e58e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:43.862898 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830db2e-4ed6-4725-92fa-59d698569275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:43.864103 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830db2e-4ed6-4725-92fa-59d698569275 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:43.865032 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830db2e-4ed6-4725-92fa-59d698569275 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:43.865437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830db2e-4ed6-4725-92fa-59d698569275 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:43.881077 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830db2e-4ed6-4725-92fa-59d698569275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:43.889470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-e830db2e-4ed6-4725-92fa-59d698569275 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:51:43.889470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:43.889470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:43.889470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:43.889470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:43.889470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:43.889470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:43.889470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:43.889470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:43.889470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:43.889470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:43.889470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:43.889470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:43.889470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:43.889470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:43.889470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:43.890710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:43.890710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:43.890710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:43.890710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:43.890710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:43.890710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:43.890710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:43.890710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:43.890710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:43.890710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:43.890710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:43.890710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:43.890710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:43.890710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:43.890710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:43.890710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:43.891766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:43.891766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:43.891766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:43.891766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:43.891766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:43.891766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:43.891766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:43.891766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:43.891766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:43.891766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:43.891766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:51:43.891766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:43.897875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 400/781] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:51:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:43.901201 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830db2e-4ed6-4725-92fa-59d698569275 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:44.021617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b112910-b4c2-4cb1-8a7e-ae7f5eb3f652 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:44.076224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c631695-7099-4da9-bc98-21b879e4bf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:44.079526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c631695-7099-4da9-bc98-21b879e4bf58 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:44.079963 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c631695-7099-4da9-bc98-21b879e4bf58 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:44.080672 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c631695-7099-4da9-bc98-21b879e4bf58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:44.082482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c631695-7099-4da9-bc98-21b879e4bf58 None admin] RBAC: Adding query filter params (interface=public, service_id=cef238c96dff45c8843ec70a988f5114, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:44.084056 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c631695-7099-4da9-bc98-21b879e4bf58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:44.085588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c631695-7099-4da9-bc98-21b879e4bf58 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:44.099564 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 382/782] 10.222.0.49 () {56 vars in 1251 bytes} [Wed May 18 16:51:43 2022] GET /identity/v3/endpoints?service_id=cef238c96dff45c8843ec70a988f5114&interface=public®ion_id=RegionOne => generated 194 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:44.103587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c631695-7099-4da9-bc98-21b879e4bf58 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:44.124047 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830db2e-4ed6-4725-92fa-59d698569275 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:44.138568 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:44.166651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1fca5-cc70-4d7a-8ee7-6276b75e69c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:44.167775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1fca5-cc70-4d7a-8ee7-6276b75e69c6 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:44.168332 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1fca5-cc70-4d7a-8ee7-6276b75e69c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:44.168838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1fca5-cc70-4d7a-8ee7-6276b75e69c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:44.169821 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1fca5-cc70-4d7a-8ee7-6276b75e69c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:44.170336 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1fca5-cc70-4d7a-8ee7-6276b75e69c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:44.171916 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1fca5-cc70-4d7a-8ee7-6276b75e69c6 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:44.186888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 401/783] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:51:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:44.188414 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1fca5-cc70-4d7a-8ee7-6276b75e69c6 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:44.204778 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:44.302143 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1fca5-cc70-4d7a-8ee7-6276b75e69c6 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:44.315671 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c631695-7099-4da9-bc98-21b879e4bf58 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:44.342661 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8636c02-75fe-41ab-ae2c-fd85b43631f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:44.344011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8636c02-75fe-41ab-ae2c-fd85b43631f5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:44.344502 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8636c02-75fe-41ab-ae2c-fd85b43631f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:44.344975 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8636c02-75fe-41ab-ae2c-fd85b43631f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:44.356900 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8636c02-75fe-41ab-ae2c-fd85b43631f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:44.358805 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8636c02-75fe-41ab-ae2c-fd85b43631f5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:44.378104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-e8636c02-75fe-41ab-ae2c-fd85b43631f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:44.378104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:44.378104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:44.378104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:44.378104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:44.378104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:44.378104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:44.378104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:44.378104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:44.378104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:44.378104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:44.378104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:44.378104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:44.378104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:44.378104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:44.379039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:44.379039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:44.379039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:44.379039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:44.379039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:44.379039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:44.379039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:44.379039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:44.379039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:44.379039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:44.379039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:44.379039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:44.379039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:44.379039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:44.379039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:44.379039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:44.379039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:44.380024 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:44.380024 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:44.380024 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:44.380024 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:44.385832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 402/784] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:44.388281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8636c02-75fe-41ab-ae2c-fd85b43631f5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:44.398849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6552e2d-b855-48da-8b71-279a7ff4ead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:44.399537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6552e2d-b855-48da-8b71-279a7ff4ead3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:44.399830 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6552e2d-b855-48da-8b71-279a7ff4ead3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:44.400106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6552e2d-b855-48da-8b71-279a7ff4ead3 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:44.400805 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6552e2d-b855-48da-8b71-279a7ff4ead3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:44.402477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6552e2d-b855-48da-8b71-279a7ff4ead3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:44.415323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 383/785] 10.222.0.49 () {56 vars in 1087 bytes} [Wed May 18 16:51:44 2022] GET /identity/v3/services => generated 772 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:44.438124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:44.557677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8636c02-75fe-41ab-ae2c-fd85b43631f5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:44.616119 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70319bed-9bb9-42eb-9220-25cd8bab07b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:44.616804 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70319bed-9bb9-42eb-9220-25cd8bab07b4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:44.617081 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70319bed-9bb9-42eb-9220-25cd8bab07b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:44.617357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70319bed-9bb9-42eb-9220-25cd8bab07b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:44.618135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70319bed-9bb9-42eb-9220-25cd8bab07b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:44.618439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70319bed-9bb9-42eb-9220-25cd8bab07b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:44.619894 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70319bed-9bb9-42eb-9220-25cd8bab07b4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:44.635348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 403/786] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:44.641116 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6552e2d-b855-48da-8b71-279a7ff4ead3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:44.649049 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8318ab-3586-40df-ae77-928c7ecf1a3e None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:44.649343 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8318ab-3586-40df-ae77-928c7ecf1a3e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:44.649700 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8318ab-3586-40df-ae77-928c7ecf1a3e None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:44.651382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 404/787] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:44.656174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b03a23-7626-402b-aa7a-e019f28e9978 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:44.656469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b03a23-7626-402b-aa7a-e019f28e9978 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:44.656751 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b03a23-7626-402b-aa7a-e019f28e9978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:44.679123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-55b03a23-7626-402b-aa7a-e019f28e9978 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:44.680455 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-55b03a23-7626-402b-aa7a-e019f28e9978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:44.763238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6552e2d-b855-48da-8b71-279a7ff4ead3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:44.766315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 405/788] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:51:44.780101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:44.799054 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce2cc0-3ba0-4e16-abaa-d27c95f69eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:44.799855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce2cc0-3ba0-4e16-abaa-d27c95f69eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:44.800142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce2cc0-3ba0-4e16-abaa-d27c95f69eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:44.800418 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce2cc0-3ba0-4e16-abaa-d27c95f69eb4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:44.805237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b03a23-7626-402b-aa7a-e019f28e9978 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:44.809406 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce2cc0-3ba0-4e16-abaa-d27c95f69eb4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:44.810833 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce2cc0-3ba0-4e16-abaa-d27c95f69eb4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:44.825880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-8dce2cc0-3ba0-4e16-abaa-d27c95f69eb4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 16:51:44.825880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:44.825880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:44.825880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:44.825880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:44.825880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:44.825880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:44.825880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:44.825880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:44.825880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:44.825880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:44.825880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:44.825880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:44.825880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:44.825880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:44.825880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:44.827057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:44.827057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:44.827057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:44.827057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:44.827057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:44.827057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:44.827057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:44.827057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:44.827057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:44.827057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:44.827057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:44.827057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:44.827057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:44.827057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:44.827057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:44.827057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:44.827057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:44.827057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:44.828215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:44.828215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:44.828215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:44.828215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:44.828215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:44.828215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:44.828215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:44.828215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:44.828215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 16:51:44.828215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:44.828215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 384/789] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:51:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:44.833721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce2cc0-3ba0-4e16-abaa-d27c95f69eb4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:44.836021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:44.960113 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce2cc0-3ba0-4e16-abaa-d27c95f69eb4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:45.003264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f99b1b-5493-460e-b6b2-6c6ff347a2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:45.004294 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f99b1b-5493-460e-b6b2-6c6ff347a2dc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:45.005353 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f99b1b-5493-460e-b6b2-6c6ff347a2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:45.005966 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f99b1b-5493-460e-b6b2-6c6ff347a2dc None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:45.009686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f99b1b-5493-460e-b6b2-6c6ff347a2dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:45.009686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f99b1b-5493-460e-b6b2-6c6ff347a2dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:45.009686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f99b1b-5493-460e-b6b2-6c6ff347a2dc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:45.035031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 385/790] 10.222.0.49 () {56 vars in 1135 bytes} [Wed May 18 16:51:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:45.037194 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b03a23-7626-402b-aa7a-e019f28e9978 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:45.040262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f99b1b-5493-460e-b6b2-6c6ff347a2dc None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:45.087337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:45.142516 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bdb25-0c92-4a88-86c1-60397ad5a791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:45.143340 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bdb25-0c92-4a88-86c1-60397ad5a791 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:45.143626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bdb25-0c92-4a88-86c1-60397ad5a791 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:45.143922 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bdb25-0c92-4a88-86c1-60397ad5a791 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:45.163724 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f99b1b-5493-460e-b6b2-6c6ff347a2dc None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:45.173698 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bdb25-0c92-4a88-86c1-60397ad5a791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:45.188383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-d95bdb25-0c92-4a88-86c1-60397ad5a791 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:45.188383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:45.188383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:45.188383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:45.188383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:45.188383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:45.188383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:45.188383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:45.188383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:45.188383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:45.188383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:45.188383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:45.188383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:45.188383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:45.188383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:45.188383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:45.189410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:45.189410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:45.189410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:45.189410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:45.189410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:45.189410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:45.189410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:45.189410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:45.189410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:45.189410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:45.189410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:45.189410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:45.189410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:45.189410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:45.189410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:45.189410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:45.190326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:45.190326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:45.190326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:45.190326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:45.190326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:45.190326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:45.190326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:45.190326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:45.190326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:45.190326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:45.190326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:45.190326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:45.190326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 406/791] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:45.196195 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bdb25-0c92-4a88-86c1-60397ad5a791 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:45.207554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8a65d-eca9-4dc2-96c0-16df47060204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:45.209554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8a65d-eca9-4dc2-96c0-16df47060204 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:45.210110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8a65d-eca9-4dc2-96c0-16df47060204 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:45.210593 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8a65d-eca9-4dc2-96c0-16df47060204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:45.222946 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8a65d-eca9-4dc2-96c0-16df47060204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:45.224779 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8a65d-eca9-4dc2-96c0-16df47060204 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:45.250069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-6ae8a65d-eca9-4dc2-96c0-16df47060204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:45.250069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:45.250069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:45.250069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:45.250069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:45.250069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:45.250069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:45.250069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:45.250069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:45.250069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:45.250069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:45.250069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:45.250069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:45.250069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:45.250069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:45.251045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:45.251045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:45.251045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:45.251045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:45.251045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:45.251045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:45.251045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:45.251045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:45.251045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:45.251045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:45.251045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:45.251045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:45.251045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:45.251045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:45.251045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:45.251045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:45.251045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:45.251967 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:45.251967 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:45.251967 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:45.251967 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:45.254522 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 386/792] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:45.260061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f79d-82f4-4269-a396-613897f98935 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:45.260061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f79d-82f4-4269-a396-613897f98935 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:45.260061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f79d-82f4-4269-a396-613897f98935 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:45.260061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 387/793] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:45.263122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6f79d-82f4-4269-a396-613897f98935 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:45.297714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:45.339807 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bdb25-0c92-4a88-86c1-60397ad5a791 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:45.381330 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476bcb9-851d-4359-8bd7-ee3227e2b567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:45.381571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:45.382085 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476bcb9-851d-4359-8bd7-ee3227e2b567 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:45.382652 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476bcb9-851d-4359-8bd7-ee3227e2b567 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:45.382652 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476bcb9-851d-4359-8bd7-ee3227e2b567 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:45.383512 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476bcb9-851d-4359-8bd7-ee3227e2b567 None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:45.383854 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476bcb9-851d-4359-8bd7-ee3227e2b567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:45.385372 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476bcb9-851d-4359-8bd7-ee3227e2b567 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:45.398452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 407/794] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:51:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:45.398452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181e073-b88e-49f1-9f43-15f58a7ab1a6 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:45.398452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181e073-b88e-49f1-9f43-15f58a7ab1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:45.398452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181e073-b88e-49f1-9f43-15f58a7ab1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:45.414328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d181e073-b88e-49f1-9f43-15f58a7ab1a6 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:45.415723 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d181e073-b88e-49f1-9f43-15f58a7ab1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:45.416462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6f79d-82f4-4269-a396-613897f98935 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:45.463852 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc9ecb-8781-4a81-9d08-24bf90cb8a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:45.465286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc9ecb-8781-4a81-9d08-24bf90cb8a68 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:45.465749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc9ecb-8781-4a81-9d08-24bf90cb8a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:45.466199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc9ecb-8781-4a81-9d08-24bf90cb8a68 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:45.467515 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc9ecb-8781-4a81-9d08-24bf90cb8a68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:45.468243 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc9ecb-8781-4a81-9d08-24bf90cb8a68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:45.470163 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc9ecb-8781-4a81-9d08-24bf90cb8a68 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:45.488117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 388/795] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:45.489001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc9ecb-8781-4a81-9d08-24bf90cb8a68 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:45.501876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 408/796] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:51:45.503204 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181e073-b88e-49f1-9f43-15f58a7ab1a6 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:45.595155 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:45.596672 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc9ecb-8781-4a81-9d08-24bf90cb8a68 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:45.633539 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db1894-42d1-4a21-9701-3c4a6f53089e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:45.634471 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db1894-42d1-4a21-9701-3c4a6f53089e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:45.634762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db1894-42d1-4a21-9701-3c4a6f53089e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:45.635043 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db1894-42d1-4a21-9701-3c4a6f53089e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:45.640628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181e073-b88e-49f1-9f43-15f58a7ab1a6 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:45.647090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db1894-42d1-4a21-9701-3c4a6f53089e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:45.648562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db1894-42d1-4a21-9701-3c4a6f53089e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:45.655647 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:45.669254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-89db1894-42d1-4a21-9701-3c4a6f53089e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:45.669254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:45.669254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:45.669254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:45.669254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:45.669254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:45.669254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:45.669254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:45.669254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:45.669254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:45.669254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:45.669254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:45.669254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:45.669254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:45.669254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:45.670257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:45.670257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:45.670257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:45.670257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:45.670257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:45.670257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:45.670257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:45.670257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:45.670257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:45.670257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:45.670257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:45.670257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:45.670257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:45.670257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:45.670257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:45.670257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:45.670257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:45.671599 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:45.671599 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:45.671599 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:45.671599 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:45.671599 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 389/797] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:45.671872 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db1894-42d1-4a21-9701-3c4a6f53089e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:45.687422 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14313646-c140-4900-9730-b2c0c4c9b214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:45.689122 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14313646-c140-4900-9730-b2c0c4c9b214 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:45.690010 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14313646-c140-4900-9730-b2c0c4c9b214 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:45.690496 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14313646-c140-4900-9730-b2c0c4c9b214 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:45.699217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14313646-c140-4900-9730-b2c0c4c9b214 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:45.701146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14313646-c140-4900-9730-b2c0c4c9b214 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:45.717640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-14313646-c140-4900-9730-b2c0c4c9b214 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:45.717640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:45.717640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:45.717640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:45.717640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:45.717640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:45.717640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:45.717640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:45.717640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:45.717640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:45.717640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:45.717640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:45.717640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:45.717640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:45.717640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:45.718594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:45.718594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:45.718594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:45.718594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:45.718594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:45.718594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:45.718594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:45.718594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:45.718594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:45.718594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:45.718594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:45.718594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:45.718594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:45.718594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:45.718594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:45.718594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:45.718594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:45.719526 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:45.719526 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:45.719526 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:45.719526 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:45.719526 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:45.719526 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:45.719526 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:45.719526 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:45.722281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 409/798] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:45.724173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14313646-c140-4900-9730-b2c0c4c9b214 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:45.791917 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db1894-42d1-4a21-9701-3c4a6f53089e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:45.831767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a59ee-ca71-4fee-b073-b00b81101b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:45.833242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a59ee-ca71-4fee-b073-b00b81101b87 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:45.833393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a59ee-ca71-4fee-b073-b00b81101b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:45.833939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a59ee-ca71-4fee-b073-b00b81101b87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:45.842265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14313646-c140-4900-9730-b2c0c4c9b214 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:45.845441 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a59ee-ca71-4fee-b073-b00b81101b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:45.853689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-fe0a59ee-ca71-4fee-b073-b00b81101b87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:51:45.853689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:45.853689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:45.853689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:45.853689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:45.853689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:45.853689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:45.853689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:45.853689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:45.853689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:45.853689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:45.853689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:45.853689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:45.853689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:45.853689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:45.853689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:45.854741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:45.854741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:45.854741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:45.854741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:45.854741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:45.854741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:45.854741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:45.854741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:45.854741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:45.854741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:45.854741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:45.854741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:45.854741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:45.854741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:45.854741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:45.854741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:45.855588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:45.855588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:45.855588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:45.855588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:45.855588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:45.855588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:45.855588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:45.855588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:45.855588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:45.855588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:45.855588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:51:45.855588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:45.859872 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 390/799] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:51:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:45.860835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a59ee-ca71-4fee-b073-b00b81101b87 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:45.875893 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:45.889017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ec610-87d1-4525-83e9-749c9a5aeadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:45.890083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ec610-87d1-4525-83e9-749c9a5aeadf None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:45.890449 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ec610-87d1-4525-83e9-749c9a5aeadf None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:45.890827 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ec610-87d1-4525-83e9-749c9a5aeadf None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:45.891775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ec610-87d1-4525-83e9-749c9a5aeadf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:45.892188 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ec610-87d1-4525-83e9-749c9a5aeadf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:45.893837 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ec610-87d1-4525-83e9-749c9a5aeadf None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:45.913401 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 410/800] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:45.914501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ec610-87d1-4525-83e9-749c9a5aeadf None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:45.929332 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:45.981213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a59ee-ca71-4fee-b073-b00b81101b87 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:46.020150 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1527c3-0847-4b3b-b7db-ef3005a5adbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:46.021678 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1527c3-0847-4b3b-b7db-ef3005a5adbc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:46.022118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1527c3-0847-4b3b-b7db-ef3005a5adbc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:46.022544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1527c3-0847-4b3b-b7db-ef3005a5adbc None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:46.023499 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1527c3-0847-4b3b-b7db-ef3005a5adbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:46.023957 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1527c3-0847-4b3b-b7db-ef3005a5adbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:46.025568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1527c3-0847-4b3b-b7db-ef3005a5adbc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:46.037687 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ec610-87d1-4525-83e9-749c9a5aeadf None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:46.043824 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 391/801] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:46.044888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1527c3-0847-4b3b-b7db-ef3005a5adbc None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:46.086358 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bc447-a8bc-4ece-a5b2-392e25f53c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:46.087188 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bc447-a8bc-4ece-a5b2-392e25f53c1c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:46.087572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bc447-a8bc-4ece-a5b2-392e25f53c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:46.087952 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bc447-a8bc-4ece-a5b2-392e25f53c1c None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:46.088806 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bc447-a8bc-4ece-a5b2-392e25f53c1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:46.089252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bc447-a8bc-4ece-a5b2-392e25f53c1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:46.091233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bc447-a8bc-4ece-a5b2-392e25f53c1c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:46.105760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 411/802] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:51:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:46.105760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bc447-a8bc-4ece-a5b2-392e25f53c1c None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:46.156728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:46.161361 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1527c3-0847-4b3b-b7db-ef3005a5adbc None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:46.185178 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:46.207349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24eeae-399a-45b5-b1df-fcef0b444ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:46.208086 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24eeae-399a-45b5-b1df-fcef0b444ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:46.208086 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24eeae-399a-45b5-b1df-fcef0b444ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:46.208366 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24eeae-399a-45b5-b1df-fcef0b444ef7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:46.215984 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24eeae-399a-45b5-b1df-fcef0b444ef7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:46.217471 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24eeae-399a-45b5-b1df-fcef0b444ef7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:46.221516 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bc447-a8bc-4ece-a5b2-392e25f53c1c None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:46.234511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1c24eeae-399a-45b5-b1df-fcef0b444ef7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 16:51:46.234511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:46.234511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:46.234511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:46.234511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:46.234511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:46.234511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:46.234511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:46.234511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:46.234511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:46.234511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:46.234511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:46.234511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:46.234511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:46.234511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:46.234511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:46.235610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:46.235610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:46.235610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:46.235610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:46.235610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:46.235610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:46.235610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:46.235610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:46.235610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:46.235610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:46.235610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:46.235610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:46.235610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:46.235610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:46.235610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:46.235610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:46.235610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:46.235610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:46.242237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:46.242237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:46.242237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:46.242237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:46.242237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:46.242237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:46.242237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:46.242237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:46.242237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 16:51:46.242237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:46.242237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 392/803] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 18 16:51:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:46.242237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24eeae-399a-45b5-b1df-fcef0b444ef7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:46.266991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31099b-bba5-4e9c-91bb-80eef8a2f854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:46.267870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31099b-bba5-4e9c-91bb-80eef8a2f854 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:46.268160 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31099b-bba5-4e9c-91bb-80eef8a2f854 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:46.268432 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31099b-bba5-4e9c-91bb-80eef8a2f854 None admin] PATH_INFO: `/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/b712c7f5fce54fe2a89d63863f3845f0/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:46.270455 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31099b-bba5-4e9c-91bb-80eef8a2f854 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcd3afbb3e384cb2939647002c60bbba, user_id=b712c7f5fce54fe2a89d63863f3845f0, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:46.271899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31099b-bba5-4e9c-91bb-80eef8a2f854 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:46.287385 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 412/804] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:51:46 2022] PUT /identity/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/b712c7f5fce54fe2a89d63863f3845f0/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:51:46.288030 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8972e-6331-4b79-8176-e003e8fd3f2c None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:46.288316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8972e-6331-4b79-8176-e003e8fd3f2c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:46.288592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8972e-6331-4b79-8176-e003e8fd3f2c None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:46.294300 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 413/805] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:46.295395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8972e-6331-4b79-8176-e003e8fd3f2c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:46.390100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24eeae-399a-45b5-b1df-fcef0b444ef7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:46.438560 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5d9ec-f2e5-466b-afb2-5174056fa3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:46.439481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5d9ec-f2e5-466b-afb2-5174056fa3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:46.439766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5d9ec-f2e5-466b-afb2-5174056fa3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:46.440130 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5d9ec-f2e5-466b-afb2-5174056fa3c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:46.453061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5d9ec-f2e5-466b-afb2-5174056fa3c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:46.454632 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5d9ec-f2e5-466b-afb2-5174056fa3c6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:46.456067 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8972e-6331-4b79-8176-e003e8fd3f2c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:46.468242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:46.478880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-e9f5d9ec-f2e5-466b-afb2-5174056fa3c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:46.478880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:46.478880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:46.478880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:46.478880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:46.478880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:46.478880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:46.478880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:46.478880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:46.478880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:46.478880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:46.478880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:46.478880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:46.478880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:46.478880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:46.479871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:46.479871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:46.479871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:46.479871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:46.479871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:46.479871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:46.479871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:46.479871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:46.479871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:46.479871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:46.479871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:46.479871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:46.479871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:46.479871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:46.479871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:46.479871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:46.479871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:46.480757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:46.480757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:46.480757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:46.480757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:46.481735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 393/806] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:46.482784 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ca558-713a-4e6a-baad-19103f091632 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:46.483092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ca558-713a-4e6a-baad-19103f091632 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:46.483749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ca558-713a-4e6a-baad-19103f091632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:46.506239 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7c0ca558-713a-4e6a-baad-19103f091632 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:46.507619 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7c0ca558-713a-4e6a-baad-19103f091632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:46.515180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76918834-7353-46f5-94f2-e3824f0f4e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:46.515868 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76918834-7353-46f5-94f2-e3824f0f4e21 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:46.516155 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76918834-7353-46f5-94f2-e3824f0f4e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:46.516432 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76918834-7353-46f5-94f2-e3824f0f4e21 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:46.517343 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76918834-7353-46f5-94f2-e3824f0f4e21 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:46.517819 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76918834-7353-46f5-94f2-e3824f0f4e21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:46.519400 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76918834-7353-46f5-94f2-e3824f0f4e21 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:46.549032 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 414/807] 10.222.0.49 () {56 vars in 1149 bytes} [Wed May 18 16:51:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:46.549032 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76918834-7353-46f5-94f2-e3824f0f4e21 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:46.553282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:46.601224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 394/808] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:51:46.602132 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ca558-713a-4e6a-baad-19103f091632 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:46.666061 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76918834-7353-46f5-94f2-e3824f0f4e21 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:46.727026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ca558-713a-4e6a-baad-19103f091632 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:46.771664 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60a5b0-eb8b-4ec6-9265-4becca3580bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:46.772591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60a5b0-eb8b-4ec6-9265-4becca3580bc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:46.772875 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60a5b0-eb8b-4ec6-9265-4becca3580bc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:46.773152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60a5b0-eb8b-4ec6-9265-4becca3580bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:46.785688 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60a5b0-eb8b-4ec6-9265-4becca3580bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:46.787556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60a5b0-eb8b-4ec6-9265-4becca3580bc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:46.807928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-2d60a5b0-eb8b-4ec6-9265-4becca3580bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:46.807928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:46.807928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:46.807928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:46.807928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:46.807928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:46.807928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:46.807928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:46.807928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:46.807928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:46.807928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:46.807928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:46.807928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:46.807928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:46.807928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:46.808928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:46.808928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:46.808928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:46.808928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:46.808928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:46.808928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:46.808928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:46.808928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:46.808928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:46.808928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:46.808928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:46.808928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:46.808928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:46.808928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:46.808928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:46.808928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:46.808928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:46.810624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:46.810624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:46.810624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:46.810624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:46.810624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 395/809] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:46.810624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60a5b0-eb8b-4ec6-9265-4becca3580bc None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:46.825633 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:46.840108 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67c729-67ee-4744-b676-d101102814bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:46.841528 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67c729-67ee-4744-b676-d101102814bc None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:46.842039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67c729-67ee-4744-b676-d101102814bc None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:46.842563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67c729-67ee-4744-b676-d101102814bc None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:46.843491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67c729-67ee-4744-b676-d101102814bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:46.844012 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67c729-67ee-4744-b676-d101102814bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:46.845595 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67c729-67ee-4744-b676-d101102814bc None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:46.859195 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 415/810] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:46.860511 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67c729-67ee-4744-b676-d101102814bc None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:46.890043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:46.921745 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60a5b0-eb8b-4ec6-9265-4becca3580bc None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:46.960654 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63d12e-d4e4-45a5-b5ce-03a4c5526c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:46.961466 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63d12e-d4e4-45a5-b5ce-03a4c5526c4c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:46.961780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63d12e-d4e4-45a5-b5ce-03a4c5526c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:46.962074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63d12e-d4e4-45a5-b5ce-03a4c5526c4c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:46.962972 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63d12e-d4e4-45a5-b5ce-03a4c5526c4c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:46.964135 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be63d12e-d4e4-45a5-b5ce-03a4c5526c4c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:46.972768 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67c729-67ee-4744-b676-d101102814bc None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:46.977482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-be63d12e-d4e4-45a5-b5ce-03a4c5526c4c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 16:51:46.977482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:46.977482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:51:46.977482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:51:46.977482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:51:46.977482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:51:46.977482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:51:46.977482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:46.977482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 16:51:46.977482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:46.977482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:51:46.977482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:46.977482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:46.977482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:46.977482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:46.977482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:46.978556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:46.978556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:46.978556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:46.978556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:46.978556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:46.978556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:46.978556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:46.978556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:51:46.978556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:51:46.978556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:51:46.978556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:51:46.978556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:46.978556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:46.978556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:46.978556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:46.978556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:46.979399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:46.979399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:46.979399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:46.979399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:46.979399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:46.979399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:46.979399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:46.979399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:46.979399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:46.979399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:46.979399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:46.979399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:51:46.979399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:46.979399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 18 16:51:46.979399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:46.982717 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 396/811] 10.222.0.49 () {56 vars in 1129 bytes} [Wed May 18 16:51:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:46.982717 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63d12e-d4e4-45a5-b5ce-03a4c5526c4c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:47.012890 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb4788-e2de-44aa-9965-8f6edd598f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:47.013556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb4788-e2de-44aa-9965-8f6edd598f6d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:47.013863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb4788-e2de-44aa-9965-8f6edd598f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:47.014135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb4788-e2de-44aa-9965-8f6edd598f6d None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:47.014857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb4788-e2de-44aa-9965-8f6edd598f6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:47.015161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb4788-e2de-44aa-9965-8f6edd598f6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:47.016525 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb4788-e2de-44aa-9965-8f6edd598f6d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:47.034827 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 416/812] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:47.034827 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e7719-9a68-445a-8775-1e22e7b99ddb None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:47.034827 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e7719-9a68-445a-8775-1e22e7b99ddb None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:47.034827 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e7719-9a68-445a-8775-1e22e7b99ddb None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:47.035339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 417/813] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:47.036655 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e7719-9a68-445a-8775-1e22e7b99ddb None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:47.078560 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:47.105097 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63d12e-d4e4-45a5-b5ce-03a4c5526c4c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:47.137901 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:47.144053 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0494c-e755-4750-9609-eadffe198c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:47.144852 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0494c-e755-4750-9609-eadffe198c8e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:47.145629 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0494c-e755-4750-9609-eadffe198c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:47.146197 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0494c-e755-4750-9609-eadffe198c8e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:47.154787 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0494c-e755-4750-9609-eadffe198c8e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:47.156242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0494c-e755-4750-9609-eadffe198c8e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:47.158846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e7719-9a68-445a-8775-1e22e7b99ddb None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:47.172123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-c9a0494c-e755-4750-9609-eadffe198c8e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 16:51:47.172123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:47.172123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:47.172123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:47.172123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:47.172123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:47.172123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:47.172123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:47.172123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:47.172123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:47.172123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:47.172123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:47.172123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:47.172123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:47.172123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:47.172123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:47.173333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:47.173333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:47.173333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:47.173333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:47.173333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:47.173333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:47.173333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:47.173333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:47.173333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:47.173333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:47.173333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:47.173333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:47.173333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:47.173333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:47.173333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:47.173333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:47.173333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:47.173333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:47.174549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:47.174549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:47.174549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:47.174549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:47.174549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:47.174549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:47.174549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:47.174549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:47.174549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 16:51:47.174549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:47.178981 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 397/814] 10.222.0.49 () {56 vars in 1093 bytes} [Wed May 18 16:51:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:47.179797 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0494c-e755-4750-9609-eadffe198c8e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:47.201267 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc8c55-bff6-4391-8231-1a791febb396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:47.201969 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc8c55-bff6-4391-8231-1a791febb396 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:47.202252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc8c55-bff6-4391-8231-1a791febb396 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:47.202529 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc8c55-bff6-4391-8231-1a791febb396 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:47.203323 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc8c55-bff6-4391-8231-1a791febb396 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:47.203556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc8c55-bff6-4391-8231-1a791febb396 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:47.204920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc8c55-bff6-4391-8231-1a791febb396 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:47.215045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 418/815] 10.222.0.49 () {56 vars in 1124 bytes} [Wed May 18 16:51:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:47.215045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329663d-4ca8-4e15-a2ab-1f615a43c1e3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:47.215045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329663d-4ca8-4e15-a2ab-1f615a43c1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:47.215045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329663d-4ca8-4e15-a2ab-1f615a43c1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:47.232783 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f329663d-4ca8-4e15-a2ab-1f615a43c1e3 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:47.234559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f329663d-4ca8-4e15-a2ab-1f615a43c1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:47.298893 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0494c-e755-4750-9609-eadffe198c8e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:47.314044 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 419/816] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:51:47.314044 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329663d-4ca8-4e15-a2ab-1f615a43c1e3 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:47.345947 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6961d77-9cd9-4ac2-9c67-a4b5ba553061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:47.347012 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6961d77-9cd9-4ac2-9c67-a4b5ba553061 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:47.347700 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6961d77-9cd9-4ac2-9c67-a4b5ba553061 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:47.347986 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6961d77-9cd9-4ac2-9c67-a4b5ba553061 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:47.352228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:47.358256 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6961d77-9cd9-4ac2-9c67-a4b5ba553061 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:47.360105 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6961d77-9cd9-4ac2-9c67-a4b5ba553061 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:47.375900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-c6961d77-9cd9-4ac2-9c67-a4b5ba553061 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:47.375900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:47.375900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:47.375900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:47.375900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:47.375900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:47.375900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:47.375900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:47.375900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:47.375900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:47.375900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:47.375900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:47.375900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:47.375900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:47.375900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:47.376985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:47.376985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:47.376985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:47.376985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:47.376985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:47.376985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:47.376985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:47.376985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:47.376985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:47.376985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:47.376985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:47.376985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:47.376985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:47.376985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:47.376985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:47.376985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:47.376985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:47.378074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:47.378074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:47.378074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:47.378074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:47.378074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:47.378074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:47.378074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:47.378074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:47.378546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 398/817] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:47.378985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6961d77-9cd9-4ac2-9c67-a4b5ba553061 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:47.408751 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:47.432855 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329663d-4ca8-4e15-a2ab-1f615a43c1e3 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:47.470475 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37436101-5cfc-4827-9f9c-975d5a74e96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:47.471309 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37436101-5cfc-4827-9f9c-975d5a74e96f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:47.471698 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37436101-5cfc-4827-9f9c-975d5a74e96f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:47.472078 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37436101-5cfc-4827-9f9c-975d5a74e96f None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:47.473084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37436101-5cfc-4827-9f9c-975d5a74e96f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:47.473465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37436101-5cfc-4827-9f9c-975d5a74e96f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:47.475365 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37436101-5cfc-4827-9f9c-975d5a74e96f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:47.495703 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 420/818] 10.222.0.49 () {56 vars in 1133 bytes} [Wed May 18 16:51:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:47.496407 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37436101-5cfc-4827-9f9c-975d5a74e96f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:47.505150 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6961d77-9cd9-4ac2-9c67-a4b5ba553061 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:47.551065 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48464157-d7c7-4184-b08e-7447189d390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:47.552437 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48464157-d7c7-4184-b08e-7447189d390f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:47.552777 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48464157-d7c7-4184-b08e-7447189d390f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:47.553117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48464157-d7c7-4184-b08e-7447189d390f None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:47.554039 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48464157-d7c7-4184-b08e-7447189d390f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:47.554403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48464157-d7c7-4184-b08e-7447189d390f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:47.555885 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48464157-d7c7-4184-b08e-7447189d390f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:47.566743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 399/819] 10.222.0.49 () {56 vars in 1124 bytes} [Wed May 18 16:51:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:47.566743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48464157-d7c7-4184-b08e-7447189d390f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:47.602367 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37436101-5cfc-4827-9f9c-975d5a74e96f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:47.634836 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:47.640889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc23d4-eb2b-40aa-9625-26a0e4365ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:47.641792 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc23d4-eb2b-40aa-9625-26a0e4365ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:47.642163 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc23d4-eb2b-40aa-9625-26a0e4365ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:47.642617 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc23d4-eb2b-40aa-9625-26a0e4365ee8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:47.643284 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc23d4-eb2b-40aa-9625-26a0e4365ee8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:47.644683 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc23d4-eb2b-40aa-9625-26a0e4365ee8 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:47.648711 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:47.659379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-adbc23d4-eb2b-40aa-9625-26a0e4365ee8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 18 16:51:47.659379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:47.659379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:51:47.659379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:51:47.659379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:51:47.659379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:51:47.659379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:51:47.659379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:47.659379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 16:51:47.659379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:47.659379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:51:47.659379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:47.659379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:47.659379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:47.659379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:47.659379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:47.659379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:47.660611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:47.660611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:47.660611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:47.660611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:47.660611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:47.660611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:47.660611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:51:47.660611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:51:47.660611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:51:47.660611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:51:47.660611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:47.660611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:47.660611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:47.660611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:47.660611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:47.660611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:47.662181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:47.662181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:47.662181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:47.662181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:47.662181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:47.662181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:47.662181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:47.662181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:47.662181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:47.662181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:47.662181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:51:47.662181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:47.662181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 18 16:51:47.662181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:47.669925 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 421/820] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:47 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:47.669925 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc23d4-eb2b-40aa-9625-26a0e4365ee8 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:47.688747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48464157-d7c7-4184-b08e-7447189d390f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:47.726998 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f588c53-43f6-417b-9982-2e6ff488e2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:47.727758 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f588c53-43f6-417b-9982-2e6ff488e2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:47.728369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f588c53-43f6-417b-9982-2e6ff488e2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:47.728369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f588c53-43f6-417b-9982-2e6ff488e2a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:47.729160 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f588c53-43f6-417b-9982-2e6ff488e2a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:47.729534 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f588c53-43f6-417b-9982-2e6ff488e2a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:47.731037 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f588c53-43f6-417b-9982-2e6ff488e2a1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:47.744897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 400/821] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:47.746016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f588c53-43f6-417b-9982-2e6ff488e2a1 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:47.784279 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc23d4-eb2b-40aa-9625-26a0e4365ee8 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:47.821216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e0b4d-a088-4201-9f7a-0d5989e7ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:47.821997 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e0b4d-a088-4201-9f7a-0d5989e7ac21 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:47.822336 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e0b4d-a088-4201-9f7a-0d5989e7ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:47.822672 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e0b4d-a088-4201-9f7a-0d5989e7ac21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:47.855969 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f588c53-43f6-417b-9982-2e6ff488e2a1 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:47.877510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:47.892239 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:47.893979 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1722457-f151-4275-bc3d-7f68078ed813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:47.894799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1722457-f151-4275-bc3d-7f68078ed813 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:47.895080 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e0b4d-a088-4201-9f7a-0d5989e7ac21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:47.895851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1722457-f151-4275-bc3d-7f68078ed813 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:47.896447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1722457-f151-4275-bc3d-7f68078ed813 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:47.897345 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1722457-f151-4275-bc3d-7f68078ed813 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:47.897747 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e0b4d-a088-4201-9f7a-0d5989e7ac21 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:47.898937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1722457-f151-4275-bc3d-7f68078ed813 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:47.933693 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 401/822] 10.222.0.49 () {60 vars in 1144 bytes} [Wed May 18 16:51:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:51:47.933693 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1722457-f151-4275-bc3d-7f68078ed813 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:48.022279 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 422/823] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 16:51:48.023268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e0b4d-a088-4201-9f7a-0d5989e7ac21 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:48.095447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1722457-f151-4275-bc3d-7f68078ed813 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:48.145684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0bbbd-e3fb-45d8-8551-08f848740897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:48.147087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0bbbd-e3fb-45d8-8551-08f848740897 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:48.147475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0bbbd-e3fb-45d8-8551-08f848740897 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:48.147855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0bbbd-e3fb-45d8-8551-08f848740897 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:48.148969 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0bbbd-e3fb-45d8-8551-08f848740897 None admin] RBAC: Adding query filter params (name=network) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:48.149379 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0bbbd-e3fb-45d8-8551-08f848740897 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:48.151552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0bbbd-e3fb-45d8-8551-08f848740897 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:48.160528 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e0b4d-a088-4201-9f7a-0d5989e7ac21 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:48.161735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 402/824] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 18 16:51:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:48.163008 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0bbbd-e3fb-45d8-8551-08f848740897 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:48.163122 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:48.204890 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6ec1f-7c05-48c7-86e1-7b9febbc36d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:48.206296 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6ec1f-7c05-48c7-86e1-7b9febbc36d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:48.206679 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6ec1f-7c05-48c7-86e1-7b9febbc36d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:48.207023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6ec1f-7c05-48c7-86e1-7b9febbc36d9 None admin] PATH_INFO: `/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/9692d55c8c924544a1bff62054731ed2/roles/c6328736ee34470cb87aa31dea4530bf` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:48.207505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:48.225482 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6ec1f-7c05-48c7-86e1-7b9febbc36d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcd3afbb3e384cb2939647002c60bbba, user_id=9692d55c8c924544a1bff62054731ed2, role_id=c6328736ee34470cb87aa31dea4530bf)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:48.227207 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6ec1f-7c05-48c7-86e1-7b9febbc36d9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:48.245138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 423/825] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:51:48 2022] PUT /identity/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/9692d55c8c924544a1bff62054731ed2/roles/c6328736ee34470cb87aa31dea4530bf => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:51:48.246133 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6ec1f-7c05-48c7-86e1-7b9febbc36d9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:48.289984 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0bbbd-e3fb-45d8-8551-08f848740897 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:48.334673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11158447-9fda-43b2-b094-454d3a035720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:48.336548 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11158447-9fda-43b2-b094-454d3a035720 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:48.337011 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11158447-9fda-43b2-b094-454d3a035720 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:48.337461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11158447-9fda-43b2-b094-454d3a035720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:48.354662 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11158447-9fda-43b2-b094-454d3a035720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:48.357034 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11158447-9fda-43b2-b094-454d3a035720 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:48.383734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-11158447-9fda-43b2-b094-454d3a035720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:48.383734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:48.383734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:48.383734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:48.383734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:48.383734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:48.383734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:48.383734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:48.383734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:48.383734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:48.383734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:48.383734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:48.383734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:48.383734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:48.383734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:48.384681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:48.384681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:48.384681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:48.384681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:48.384681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:48.384681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:48.384681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:48.384681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:48.384681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:48.384681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:48.384681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:48.384681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:48.384681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:48.384681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:48.384681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:48.384681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:48.384681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:48.385615 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:48.385615 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:48.385615 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:48.385615 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:48.391167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 403/826] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:48.393139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11158447-9fda-43b2-b094-454d3a035720 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:48.407339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6ec1f-7c05-48c7-86e1-7b9febbc36d9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:48.495161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38420b7-2abc-4535-81b2-f54d50df662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:48.496243 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38420b7-2abc-4535-81b2-f54d50df662a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:48.496741 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38420b7-2abc-4535-81b2-f54d50df662a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:48.497231 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38420b7-2abc-4535-81b2-f54d50df662a None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:48.498212 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38420b7-2abc-4535-81b2-f54d50df662a None admin] RBAC: Adding query filter params (type=network) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:48.498763 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38420b7-2abc-4535-81b2-f54d50df662a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:48.502168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38420b7-2abc-4535-81b2-f54d50df662a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:48.512590 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 424/827] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 18 16:51:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:48.519399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38420b7-2abc-4535-81b2-f54d50df662a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:48.546741 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:48.589007 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:48.613117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11158447-9fda-43b2-b094-454d3a035720 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:48.674164 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38420b7-2abc-4535-81b2-f54d50df662a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:48.675778 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48342357-46eb-4b9c-ba78-5f4980e58d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:48.676920 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48342357-46eb-4b9c-ba78-5f4980e58d4b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:48.677381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48342357-46eb-4b9c-ba78-5f4980e58d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:48.677837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48342357-46eb-4b9c-ba78-5f4980e58d4b None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:48.678712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48342357-46eb-4b9c-ba78-5f4980e58d4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:48.679165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48342357-46eb-4b9c-ba78-5f4980e58d4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:48.680814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48342357-46eb-4b9c-ba78-5f4980e58d4b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:48.695814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 404/828] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:48.698025 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cf634-7536-4401-9bd6-d82354e28904 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:48.698757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cf634-7536-4401-9bd6-d82354e28904 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:48.699191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cf634-7536-4401-9bd6-d82354e28904 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:48.701929 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 405/829] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:48.702934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cf634-7536-4401-9bd6-d82354e28904 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:48.716862 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12074f-fba0-45af-922a-eb9b2ac4d187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:48.717534 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12074f-fba0-45af-922a-eb9b2ac4d187 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:48.717895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12074f-fba0-45af-922a-eb9b2ac4d187 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:48.718175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12074f-fba0-45af-922a-eb9b2ac4d187 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:48.718978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12074f-fba0-45af-922a-eb9b2ac4d187 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:48.720365 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12074f-fba0-45af-922a-eb9b2ac4d187 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:48.746864 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 425/830] 10.222.0.49 () {60 vars in 1144 bytes} [Wed May 18 16:51:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:51:48.748051 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1f90c-37f8-479a-a8a8-0c27d1f05f79 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:48.748342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1f90c-37f8-479a-a8a8-0c27d1f05f79 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:48.748622 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1f90c-37f8-479a-a8a8-0c27d1f05f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:48.770982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-97b1f90c-37f8-479a-a8a8-0c27d1f05f79 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:48.772325 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-97b1f90c-37f8-479a-a8a8-0c27d1f05f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:48.849338 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cf634-7536-4401-9bd6-d82354e28904 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:48.857678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:48.867409 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 426/831] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:51:48.894927 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1f90c-37f8-479a-a8a8-0c27d1f05f79 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:48.935256 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ad055-1d21-431f-9eb7-e5354ab478f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:48.936427 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ad055-1d21-431f-9eb7-e5354ab478f6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:48.936879 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ad055-1d21-431f-9eb7-e5354ab478f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:48.937375 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ad055-1d21-431f-9eb7-e5354ab478f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:48.958597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ad055-1d21-431f-9eb7-e5354ab478f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:48.960378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ad055-1d21-431f-9eb7-e5354ab478f6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:48.977810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-8e3ad055-1d21-431f-9eb7-e5354ab478f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:48.977810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:48.977810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:48.977810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:48.977810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:48.977810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:48.977810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:48.977810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:48.977810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:48.977810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:48.977810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:48.977810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:48.977810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:48.977810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:48.977810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:48.978853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:48.978853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:48.978853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:48.978853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:48.978853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:48.978853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:48.978853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:48.978853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:48.978853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:48.978853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:48.978853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:48.978853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:48.978853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:48.978853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:48.978853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:48.978853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:48.978853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:48.980254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:48.980254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:48.980254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:48.980254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:48.980254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:48.980254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:48.980254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:48.980254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:48.980254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 406/832] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:48.986615 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ad055-1d21-431f-9eb7-e5354ab478f6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:48.991047 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:49.074290 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1f90c-37f8-479a-a8a8-0c27d1f05f79 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:49.117889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de972c8c-1a99-49d3-b7aa-9ddeeea4b87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:49.118797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de972c8c-1a99-49d3-b7aa-9ddeeea4b87e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:49.119171 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de972c8c-1a99-49d3-b7aa-9ddeeea4b87e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:49.119538 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de972c8c-1a99-49d3-b7aa-9ddeeea4b87e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:49.133310 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de972c8c-1a99-49d3-b7aa-9ddeeea4b87e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:49.141083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-de972c8c-1a99-49d3-b7aa-9ddeeea4b87e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:51:49.141083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:49.141083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:49.141083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:49.141083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:49.141083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:49.141083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:49.141083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:49.141083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:49.141083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:49.141083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:49.141083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:49.141083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:49.141083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:49.141083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:49.141083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:49.142170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:49.142170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:49.142170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:49.142170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:49.142170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:49.142170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:49.142170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:49.142170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:49.142170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:49.142170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:49.142170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:49.142170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:49.142170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:49.142170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:49.142170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:49.142170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:49.143009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:49.143009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:49.143009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:49.143009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:49.143009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:49.143009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:49.143009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:49.143009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:49.143009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:49.143009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:49.143009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:51:49.143009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:49.145908 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 427/833] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:51:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:49.151623 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de972c8c-1a99-49d3-b7aa-9ddeeea4b87e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:49.152842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ad055-1d21-431f-9eb7-e5354ab478f6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:49.192978 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ae619-3d3e-4cd0-b68d-cfaa35d64f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:49.193675 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ae619-3d3e-4cd0-b68d-cfaa35d64f44 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:49.193970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ae619-3d3e-4cd0-b68d-cfaa35d64f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:49.194246 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ae619-3d3e-4cd0-b68d-cfaa35d64f44 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:49.195053 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ae619-3d3e-4cd0-b68d-cfaa35d64f44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:49.195363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ae619-3d3e-4cd0-b68d-cfaa35d64f44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:49.196809 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ae619-3d3e-4cd0-b68d-cfaa35d64f44 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:49.211606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 407/834] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:49.218099 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ae619-3d3e-4cd0-b68d-cfaa35d64f44 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:49.220667 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:49.273420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de972c8c-1a99-49d3-b7aa-9ddeeea4b87e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:49.298080 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:49.314879 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be66ff-eb00-4187-9830-70aa110e44ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:49.315646 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be66ff-eb00-4187-9830-70aa110e44ec None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:49.315994 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be66ff-eb00-4187-9830-70aa110e44ec None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:49.316341 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be66ff-eb00-4187-9830-70aa110e44ec None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:49.318049 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be66ff-eb00-4187-9830-70aa110e44ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:49.318434 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be66ff-eb00-4187-9830-70aa110e44ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:49.320021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be66ff-eb00-4187-9830-70aa110e44ec None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:49.329509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 428/835] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:51:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:49.336315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be66ff-eb00-4187-9830-70aa110e44ec None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:49.349363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ae619-3d3e-4cd0-b68d-cfaa35d64f44 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:49.388548 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6072a9-9904-4cf7-97dc-0153fbc2a13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:49.389159 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6072a9-9904-4cf7-97dc-0153fbc2a13a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:49.389437 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6072a9-9904-4cf7-97dc-0153fbc2a13a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:49.389735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6072a9-9904-4cf7-97dc-0153fbc2a13a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:49.390687 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6072a9-9904-4cf7-97dc-0153fbc2a13a None admin] RBAC: Adding query filter params (role.id=b3f3f4910bf646699f30b749edeef422, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=c9e3c0ef5ed943d183b064f383fc01f3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:49.391007 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6072a9-9904-4cf7-97dc-0153fbc2a13a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:49.392962 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6072a9-9904-4cf7-97dc-0153fbc2a13a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:49.403101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 408/836] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:51:49 2022] GET /identity/v3/role_assignments?user.id=c9e3c0ef5ed943d183b064f383fc01f3&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=b3f3f4910bf646699f30b749edeef422 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:49.470935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be66ff-eb00-4187-9830-70aa110e44ec None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:49.499929 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:49.515400 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47790c41-f20d-404f-82fa-7d8c67db33c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:49.516515 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47790c41-f20d-404f-82fa-7d8c67db33c9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:49.516979 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47790c41-f20d-404f-82fa-7d8c67db33c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:49.517421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47790c41-f20d-404f-82fa-7d8c67db33c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:49.530668 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47790c41-f20d-404f-82fa-7d8c67db33c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:49.532413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47790c41-f20d-404f-82fa-7d8c67db33c9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:49.552938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-47790c41-f20d-404f-82fa-7d8c67db33c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:49.552938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:49.552938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:49.552938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:49.552938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:49.552938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:49.552938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:49.552938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:49.552938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:49.552938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:49.552938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:49.552938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:49.552938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:49.552938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:49.552938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:49.554178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:49.554178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:49.554178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:49.554178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:49.554178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:49.554178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:49.554178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:49.554178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:49.554178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:49.554178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:49.554178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:49.554178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:49.554178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:49.554178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:49.554178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:49.554178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:49.554178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:49.555305 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:49.555305 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:49.555305 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:49.555305 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:49.557279 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 429/837] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:49.563241 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6072a9-9904-4cf7-97dc-0153fbc2a13a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:49.676237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6072a9-9904-4cf7-97dc-0153fbc2a13a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:49.707886 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:49.717577 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127040f5-ec5c-484c-acbf-5643f13fc679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:49.718655 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127040f5-ec5c-484c-acbf-5643f13fc679 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:49.718945 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127040f5-ec5c-484c-acbf-5643f13fc679 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:49.719225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127040f5-ec5c-484c-acbf-5643f13fc679 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:49.719968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127040f5-ec5c-484c-acbf-5643f13fc679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:49.720277 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127040f5-ec5c-484c-acbf-5643f13fc679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:49.721740 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127040f5-ec5c-484c-acbf-5643f13fc679 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:49.735197 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 409/838] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:49.741336 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47790c41-f20d-404f-82fa-7d8c67db33c9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:49.851203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47790c41-f20d-404f-82fa-7d8c67db33c9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:49.887947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d07ba-7998-489c-bac5-73146e8ff4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:49.888750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d07ba-7998-489c-bac5-73146e8ff4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:49.889043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d07ba-7998-489c-bac5-73146e8ff4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:49.889320 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d07ba-7998-489c-bac5-73146e8ff4c3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:49.899131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d07ba-7998-489c-bac5-73146e8ff4c3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:49.900613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d07ba-7998-489c-bac5-73146e8ff4c3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:49.915411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-b83d07ba-7998-489c-bac5-73146e8ff4c3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 18 16:51:49.915411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:49.915411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:49.915411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:49.915411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:49.915411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:49.915411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:49.915411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:49.915411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:49.915411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:49.915411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:49.915411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:49.915411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:49.915411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:49.915411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:49.915411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:49.916431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:49.916431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:49.916431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:49.916431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:49.916431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:49.916431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:49.916431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:49.916431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:49.916431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:49.916431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:49.916431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:49.916431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:49.916431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:49.916431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:49.916431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:49.916431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:49.916431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:49.916431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:49.917978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:49.917978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:49.917978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:49.917978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:49.917978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:49.917978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:49.917978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:49.917978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:49.917978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 18 16:51:49.917978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:49.917978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 430/839] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:51:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:49.922752 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127040f5-ec5c-484c-acbf-5643f13fc679 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:50.031529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127040f5-ec5c-484c-acbf-5643f13fc679 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:50.076271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3f4f2-7541-4e51-a694-370bfc5274e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:50.076967 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3f4f2-7541-4e51-a694-370bfc5274e4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:50.077249 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3f4f2-7541-4e51-a694-370bfc5274e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:50.077529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3f4f2-7541-4e51-a694-370bfc5274e4 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:50.078422 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3f4f2-7541-4e51-a694-370bfc5274e4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:50.078733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3f4f2-7541-4e51-a694-370bfc5274e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:50.080164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3f4f2-7541-4e51-a694-370bfc5274e4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:50.101422 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 410/840] 10.222.0.49 () {56 vars in 1135 bytes} [Wed May 18 16:51:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:50.106659 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d07ba-7998-489c-bac5-73146e8ff4c3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:50.143666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:50.219633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d07ba-7998-489c-bac5-73146e8ff4c3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:50.256762 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cd15e-1cc1-4cdf-9ecf-5b0fbb0aafab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:50.257741 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cd15e-1cc1-4cdf-9ecf-5b0fbb0aafab None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:50.258206 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cd15e-1cc1-4cdf-9ecf-5b0fbb0aafab None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:50.258644 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cd15e-1cc1-4cdf-9ecf-5b0fbb0aafab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:50.337534 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cd15e-1cc1-4cdf-9ecf-5b0fbb0aafab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:50.339340 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cd15e-1cc1-4cdf-9ecf-5b0fbb0aafab None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:50.378055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:50.453751 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 431/841] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 16:51:50.459259 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3f4f2-7541-4e51-a694-370bfc5274e4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:50.521756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:50.522776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9233c59-d196-4c50-b0b6-406b695262a4 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:50.523280 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9233c59-d196-4c50-b0b6-406b695262a4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:50.523797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9233c59-d196-4c50-b0b6-406b695262a4 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:50.525738 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 432/842] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:51:50.530553 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e07c8-a002-4d4f-a88f-27ab03225d0e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:50.530839 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e07c8-a002-4d4f-a88f-27ab03225d0e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:50.531118 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e07c8-a002-4d4f-a88f-27ab03225d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:50.548807 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c65e07c8-a002-4d4f-a88f-27ab03225d0e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:50.550492 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c65e07c8-a002-4d4f-a88f-27ab03225d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:50.582259 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3f4f2-7541-4e51-a694-370bfc5274e4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:50.626405 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bb9ef-1b96-448a-b5a8-48ff8b959573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:50.627207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bb9ef-1b96-448a-b5a8-48ff8b959573 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:50.627488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bb9ef-1b96-448a-b5a8-48ff8b959573 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:50.627763 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bb9ef-1b96-448a-b5a8-48ff8b959573 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:50.632464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 433/843] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:51:50.641952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bb9ef-1b96-448a-b5a8-48ff8b959573 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:50.643422 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bb9ef-1b96-448a-b5a8-48ff8b959573 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:50.655207 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e07c8-a002-4d4f-a88f-27ab03225d0e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:50.665356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-0a0bb9ef-1b96-448a-b5a8-48ff8b959573 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:50.665356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:50.665356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:50.665356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:50.665356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:50.665356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:50.665356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:50.665356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:50.665356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:50.665356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:50.665356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:50.665356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:50.665356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:50.665356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:50.665356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:50.666377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:50.666377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:50.666377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:50.666377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:50.666377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:50.666377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:50.666377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:50.666377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:50.666377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:50.666377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:50.666377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:50.666377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:50.666377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:50.666377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:50.666377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:50.666377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:50.666377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:50.667288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:50.667288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:50.667288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:50.667288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:50.667288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 411/844] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:50.681699 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bb9ef-1b96-448a-b5a8-48ff8b959573 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:50.750116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:50.789112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:50.789565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e07c8-a002-4d4f-a88f-27ab03225d0e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:50.794205 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bb9ef-1b96-448a-b5a8-48ff8b959573 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:50.829774 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f621c-9f8c-4bb8-808b-c871927b7d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:50.830880 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f621c-9f8c-4bb8-808b-c871927b7d4f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:50.831164 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f621c-9f8c-4bb8-808b-c871927b7d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:50.831441 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f621c-9f8c-4bb8-808b-c871927b7d4f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:50.831868 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce36437-c9a0-4418-a7e7-fb7f8a39dd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:50.832149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f621c-9f8c-4bb8-808b-c871927b7d4f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:50.833496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce36437-c9a0-4418-a7e7-fb7f8a39dd0e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:50.834023 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce36437-c9a0-4418-a7e7-fb7f8a39dd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:50.834129 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f621c-9f8c-4bb8-808b-c871927b7d4f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:50.834614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce36437-c9a0-4418-a7e7-fb7f8a39dd0e None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:50.835561 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce36437-c9a0-4418-a7e7-fb7f8a39dd0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:50.836066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce36437-c9a0-4418-a7e7-fb7f8a39dd0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:50.837631 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce36437-c9a0-4418-a7e7-fb7f8a39dd0e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:50.846973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-4a9f621c-9f8c-4bb8-808b-c871927b7d4f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 16:51:50.846973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:50.846973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:51:50.846973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:51:50.846973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:51:50.846973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:51:50.846973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:51:50.846973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:50.846973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 16:51:50.846973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:50.846973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:51:50.846973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:50.846973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:50.846973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:50.846973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:50.846973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:50.846973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:50.848073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:50.848073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:50.848073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:50.848073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:50.848073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:50.848073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:50.848073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:51:50.848073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:51:50.848073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:51:50.848073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:51:50.848073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:50.848073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:50.848073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:50.848073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:50.848073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:50.848073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:50.849599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:50.849599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:50.849599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:50.849599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:50.849599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:50.849599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:50.849599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:50.849599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:50.849599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:50.849599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:50.849599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:51:50.849599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:50.849599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 16:51:50.849599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:50.849599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 434/845] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:51:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:50.857591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 412/846] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:50.857878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f621c-9f8c-4bb8-808b-c871927b7d4f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:50.860493 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce36437-c9a0-4418-a7e7-fb7f8a39dd0e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:50.966820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce36437-c9a0-4418-a7e7-fb7f8a39dd0e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:50.969876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f621c-9f8c-4bb8-808b-c871927b7d4f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:51.001095 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:51.001896 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c677412-6d39-4ceb-8732-7dce98f0bda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:51.002687 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c677412-6d39-4ceb-8732-7dce98f0bda1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:51.002995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c677412-6d39-4ceb-8732-7dce98f0bda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:51.003291 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c677412-6d39-4ceb-8732-7dce98f0bda1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:51.010651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c677412-6d39-4ceb-8732-7dce98f0bda1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:51.011327 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5beee-48fd-48f7-aeb2-2e72d5c08b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:51.012107 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c677412-6d39-4ceb-8732-7dce98f0bda1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:51.012411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5beee-48fd-48f7-aeb2-2e72d5c08b22 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:51.012869 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5beee-48fd-48f7-aeb2-2e72d5c08b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:51.013316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5beee-48fd-48f7-aeb2-2e72d5c08b22 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:51.014214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5beee-48fd-48f7-aeb2-2e72d5c08b22 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:51.014685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5beee-48fd-48f7-aeb2-2e72d5c08b22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:51.016112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5beee-48fd-48f7-aeb2-2e72d5c08b22 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:51.025980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 435/847] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:51:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:51.025980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec11ba-f6e2-4492-a1fc-909822b9e089 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:51.025980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec11ba-f6e2-4492-a1fc-909822b9e089 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:51.025980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec11ba-f6e2-4492-a1fc-909822b9e089 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:51.027775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-3c677412-6d39-4ceb-8732-7dce98f0bda1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:51.027775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:51.027775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:51.027775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:51.027775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:51.027775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:51.027775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:51.027775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:51.027775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:51.027775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:51.027775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:51.027775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:51.027775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:51.027775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:51.027775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:51.028636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:51.028636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:51.028636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:51.028636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:51.028636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:51.028636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:51.028636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:51.028636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:51.028636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:51.028636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:51.028636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:51.028636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:51.028636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:51.028636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:51.028636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:51.028636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:51.028636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:51.029547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:51.029547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:51.029547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:51.029547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:51.029547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:51.029547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:51.029547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:51.029547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:51.030012 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 436/848] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:51.030012 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec11ba-f6e2-4492-a1fc-909822b9e089 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:51.033846 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 413/849] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:51.035142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c30ca-781b-422d-92bb-95f62ad8bbf4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:51.035434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c30ca-781b-422d-92bb-95f62ad8bbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:51.035749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c30ca-781b-422d-92bb-95f62ad8bbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:51.054026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-283c30ca-781b-422d-92bb-95f62ad8bbf4 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:51.058188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-283c30ca-781b-422d-92bb-95f62ad8bbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:51.070374 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:51.133709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 414/850] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:51:51.133709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c30ca-781b-422d-92bb-95f62ad8bbf4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:51.159924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec11ba-f6e2-4492-a1fc-909822b9e089 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:51.196224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96afa7-e311-41c2-a0d0-931d604cbfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:51.196899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96afa7-e311-41c2-a0d0-931d604cbfb5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:51.197183 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96afa7-e311-41c2-a0d0-931d604cbfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:51.197460 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96afa7-e311-41c2-a0d0-931d604cbfb5 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:51.198274 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96afa7-e311-41c2-a0d0-931d604cbfb5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:51.198584 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96afa7-e311-41c2-a0d0-931d604cbfb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:51.199963 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96afa7-e311-41c2-a0d0-931d604cbfb5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:51.205065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 437/851] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:51:51 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:51.205958 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96afa7-e311-41c2-a0d0-931d604cbfb5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:51.274826 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:51.284914 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c30ca-781b-422d-92bb-95f62ad8bbf4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:51.327764 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78b890-7d59-4c11-b41f-c52bab006190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:51.328450 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78b890-7d59-4c11-b41f-c52bab006190 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:51.328790 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78b890-7d59-4c11-b41f-c52bab006190 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:51.329071 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78b890-7d59-4c11-b41f-c52bab006190 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:51.330025 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78b890-7d59-4c11-b41f-c52bab006190 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:51.330269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78b890-7d59-4c11-b41f-c52bab006190 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:51.332008 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78b890-7d59-4c11-b41f-c52bab006190 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:51.334598 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96afa7-e311-41c2-a0d0-931d604cbfb5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:51.350105 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 415/852] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:51.352688 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78b890-7d59-4c11-b41f-c52bab006190 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:51.365572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:51.383118 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec73c57-f7e4-4f1c-95b7-150f3126fc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:51.383770 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73c57-f7e4-4f1c-95b7-150f3126fc3e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:51.384059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73c57-f7e4-4f1c-95b7-150f3126fc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:51.384339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73c57-f7e4-4f1c-95b7-150f3126fc3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:51.399590 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec73c57-f7e4-4f1c-95b7-150f3126fc3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:51.410505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-aec73c57-f7e4-4f1c-95b7-150f3126fc3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:51.410505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:51.410505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:51.410505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:51.410505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:51.410505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:51.410505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:51.410505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:51.410505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:51.410505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:51.410505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:51.410505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:51.410505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:51.410505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:51.410505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:51.410505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:51.411845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:51.411845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:51.411845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:51.411845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:51.411845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:51.411845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:51.411845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:51.411845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:51.411845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:51.411845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:51.411845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:51.411845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:51.411845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:51.411845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:51.411845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:51.411845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:51.412962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:51.412962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:51.412962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:51.412962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:51.412962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:51.412962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:51.412962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:51.412962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:51.412962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:51.412962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:51.412962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:51:51.412962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:51.412962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 438/853] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:51:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:51.417285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec73c57-f7e4-4f1c-95b7-150f3126fc3e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:51.479743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78b890-7d59-4c11-b41f-c52bab006190 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:51.526987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca06ade-f4d5-4411-833b-bd936123ef98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:51.528038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca06ade-f4d5-4411-833b-bd936123ef98 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:51.528326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca06ade-f4d5-4411-833b-bd936123ef98 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:51.528601 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca06ade-f4d5-4411-833b-bd936123ef98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:51.529774 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca06ade-f4d5-4411-833b-bd936123ef98 None admin] RBAC: Adding query filter params (role.id=b3f3f4910bf646699f30b749edeef422, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=b712c7f5fce54fe2a89d63863f3845f0) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:51.530146 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca06ade-f4d5-4411-833b-bd936123ef98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:51.531876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca06ade-f4d5-4411-833b-bd936123ef98 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:51.540569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 416/854] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:51:51 2022] GET /identity/v3/role_assignments?user.id=b712c7f5fce54fe2a89d63863f3845f0&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=b3f3f4910bf646699f30b749edeef422 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:51.541000 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec73c57-f7e4-4f1c-95b7-150f3126fc3e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:51.569934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:51.595929 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ee894-50e9-48aa-853a-dc74bb06dc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:51.596624 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ee894-50e9-48aa-853a-dc74bb06dc18 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:51.596901 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ee894-50e9-48aa-853a-dc74bb06dc18 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:51.597179 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ee894-50e9-48aa-853a-dc74bb06dc18 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:51.598184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ee894-50e9-48aa-853a-dc74bb06dc18 None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:51.598509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ee894-50e9-48aa-853a-dc74bb06dc18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:51.599924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ee894-50e9-48aa-853a-dc74bb06dc18 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:51.610542 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 439/855] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:51:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:51.616901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca06ade-f4d5-4411-833b-bd936123ef98 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:51.703390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:51.737145 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca06ade-f4d5-4411-833b-bd936123ef98 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:51.777958 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e5863-891e-4b46-b972-695a03515b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:51.779084 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e5863-891e-4b46-b972-695a03515b4e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:51.779547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e5863-891e-4b46-b972-695a03515b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:51.780009 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e5863-891e-4b46-b972-695a03515b4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:51.791872 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e5863-891e-4b46-b972-695a03515b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:51.793627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e5863-891e-4b46-b972-695a03515b4e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:51.812475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-212e5863-891e-4b46-b972-695a03515b4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:51.812475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:51.812475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:51.812475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:51.812475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:51.812475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:51.812475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:51.812475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:51.812475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:51.812475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:51.812475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:51.812475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:51.812475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:51.812475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:51.812475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:51.813415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:51.813415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:51.813415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:51.813415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:51.813415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:51.813415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:51.813415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:51.813415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:51.813415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:51.813415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:51.813415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:51.813415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:51.813415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:51.813415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:51.813415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:51.813415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:51.813415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:51.814319 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:51.814319 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:51.814319 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:51.814319 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:51.816303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 417/856] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:51.825296 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ee894-50e9-48aa-853a-dc74bb06dc18 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:51.882422 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d410d7a-53af-4780-8801-4774036d3fc9 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:51.882808 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d410d7a-53af-4780-8801-4774036d3fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:51.883163 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d410d7a-53af-4780-8801-4774036d3fc9 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:51.884902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 418/857] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:51.890171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebf074-606a-4d3b-82e6-9155ffebfe7b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:51.890463 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebf074-606a-4d3b-82e6-9155ffebfe7b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:51.890745 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebf074-606a-4d3b-82e6-9155ffebfe7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:51.909832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-82ebf074-606a-4d3b-82e6-9155ffebfe7b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:51.911842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-82ebf074-606a-4d3b-82e6-9155ffebfe7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:51.943611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ee894-50e9-48aa-853a-dc74bb06dc18 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:51.982162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5dae0d-724e-48ad-8de2-30856a5bf360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:51.983746 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dae0d-724e-48ad-8de2-30856a5bf360 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:51.984259 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dae0d-724e-48ad-8de2-30856a5bf360 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:51.984758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dae0d-724e-48ad-8de2-30856a5bf360 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:51.985933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5dae0d-724e-48ad-8de2-30856a5bf360 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:51.986522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5dae0d-724e-48ad-8de2-30856a5bf360 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:51.988109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5dae0d-724e-48ad-8de2-30856a5bf360 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:51.994768 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 419/858] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:51:52.003776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 440/859] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:52.010034 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebf074-606a-4d3b-82e6-9155ffebfe7b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:52.014821 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5dae0d-724e-48ad-8de2-30856a5bf360 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:52.075548 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:52.093308 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:52.158075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebf074-606a-4d3b-82e6-9155ffebfe7b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:52.162304 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5dae0d-724e-48ad-8de2-30856a5bf360 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:52.197194 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428942b-e065-4af9-a4eb-bfd684684293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:52.198042 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428942b-e065-4af9-a4eb-bfd684684293 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:52.198327 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428942b-e065-4af9-a4eb-bfd684684293 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:52.198631 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428942b-e065-4af9-a4eb-bfd684684293 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:52.201186 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0a7d1-17cd-46f9-9029-9da9422177bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:52.202317 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0a7d1-17cd-46f9-9029-9da9422177bf None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:52.202810 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0a7d1-17cd-46f9-9029-9da9422177bf None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:52.203321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0a7d1-17cd-46f9-9029-9da9422177bf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:52.204186 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0a7d1-17cd-46f9-9029-9da9422177bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:52.206148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0a7d1-17cd-46f9-9029-9da9422177bf None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:52.206500 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428942b-e065-4af9-a4eb-bfd684684293 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:52.208245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428942b-e065-4af9-a4eb-bfd684684293 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:52.220178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-adf0a7d1-17cd-46f9-9029-9da9422177bf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 16:51:52.220178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:52.220178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:51:52.220178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:51:52.220178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:51:52.220178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:51:52.220178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:51:52.220178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:52.220178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 16:51:52.220178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:52.220178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:51:52.220178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:52.220178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:52.220178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:52.220178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:52.220178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:52.221161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:52.221161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:52.221161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:52.221161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:52.221161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:52.221161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:52.221161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:52.221161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:51:52.221161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:51:52.221161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:51:52.221161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:51:52.221161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:52.221161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:52.221161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:52.221161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:52.221161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:52.222405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:52.222405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:52.222405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:52.222405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:52.222405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:52.222405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:52.222405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:52.222405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:52.222405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:52.222405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:52.222405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:52.222405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:51:52.222405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:52.222405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 16:51:52.222405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:52.225785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 441/860] 10.222.0.49 () {56 vars in 1132 bytes} [Wed May 18 16:51:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:52.230378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-3428942b-e065-4af9-a4eb-bfd684684293 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 16:51:52.230378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:52.230378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:52.230378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:52.230378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:52.230378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:52.230378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:52.230378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:52.230378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:52.230378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:52.230378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:52.230378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:52.230378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:52.230378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:52.230378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:52.230378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:52.232139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:52.232139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:52.232139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:52.232139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:52.232139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:52.232139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:52.232139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:52.232139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:52.232139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:52.232139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:52.232139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:52.232139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:52.232139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:52.232139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:52.232139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:52.232139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:52.232139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:52.232139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:52.233759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:52.233759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:52.233759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:52.233759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:52.233759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:52.233759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:52.233759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:52.233759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:52.233759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 16:51:52.233759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:52.235696 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0a7d1-17cd-46f9-9029-9da9422177bf None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:52.237714 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 420/861] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 18 16:51:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:52.244501 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428942b-e065-4af9-a4eb-bfd684684293 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:52.361452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0a7d1-17cd-46f9-9029-9da9422177bf None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:52.364598 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:52.372734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428942b-e065-4af9-a4eb-bfd684684293 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:52.388668 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:52.420930 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa6c82-f953-4f76-8a81-d7195773f362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:52.421610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa6c82-f953-4f76-8a81-d7195773f362 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:52.421912 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa6c82-f953-4f76-8a81-d7195773f362 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:52.422188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa6c82-f953-4f76-8a81-d7195773f362 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:52.423032 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa6c82-f953-4f76-8a81-d7195773f362 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:52.423337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa6c82-f953-4f76-8a81-d7195773f362 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:52.424757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa6c82-f953-4f76-8a81-d7195773f362 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:52.426814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb635a-4bdc-4733-ae17-6c60471ab849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:52.428903 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb635a-4bdc-4733-ae17-6c60471ab849 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:52.429410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb635a-4bdc-4733-ae17-6c60471ab849 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:52.429927 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb635a-4bdc-4733-ae17-6c60471ab849 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:52.430934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb635a-4bdc-4733-ae17-6c60471ab849 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:52.431494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb635a-4bdc-4733-ae17-6c60471ab849 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:52.433645 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb635a-4bdc-4733-ae17-6c60471ab849 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:52.445376 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 442/862] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 18 16:51:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:52.449138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb635a-4bdc-4733-ae17-6c60471ab849 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:52.449281 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 421/863] 10.222.0.49 () {56 vars in 1149 bytes} [Wed May 18 16:51:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:52.455736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa6c82-f953-4f76-8a81-d7195773f362 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:52.567650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb635a-4bdc-4733-ae17-6c60471ab849 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:52.594464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa6c82-f953-4f76-8a81-d7195773f362 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:52.607293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3fd86-14a3-4be0-94ff-51f50275884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:52.608444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3fd86-14a3-4be0-94ff-51f50275884c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:52.608959 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3fd86-14a3-4be0-94ff-51f50275884c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:52.609441 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3fd86-14a3-4be0-94ff-51f50275884c None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:52.610389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3fd86-14a3-4be0-94ff-51f50275884c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:52.610903 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3fd86-14a3-4be0-94ff-51f50275884c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:52.612642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3fd86-14a3-4be0-94ff-51f50275884c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:52.626101 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 443/864] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 18 16:51:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:52.636461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccf0fc-930b-45d4-a0bd-0f2f2e7bc68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:52.637131 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccf0fc-930b-45d4-a0bd-0f2f2e7bc68a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:52.637416 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccf0fc-930b-45d4-a0bd-0f2f2e7bc68a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:52.637718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccf0fc-930b-45d4-a0bd-0f2f2e7bc68a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:52.686735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:52.717909 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccf0fc-930b-45d4-a0bd-0f2f2e7bc68a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:52.719388 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccf0fc-930b-45d4-a0bd-0f2f2e7bc68a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:52.836849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 422/865] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 18 16:51:52.842468 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3fd86-14a3-4be0-94ff-51f50275884c None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:52.876319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:52.953355 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3fd86-14a3-4be0-94ff-51f50275884c None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:52.989917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c212df4-37d7-45cf-97f6-a34998dc9b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:52.990801 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c212df4-37d7-45cf-97f6-a34998dc9b50 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:52.990994 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c212df4-37d7-45cf-97f6-a34998dc9b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:52.991269 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c212df4-37d7-45cf-97f6-a34998dc9b50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:53.002395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c212df4-37d7-45cf-97f6-a34998dc9b50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:53.003913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c212df4-37d7-45cf-97f6-a34998dc9b50 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:53.023313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-4c212df4-37d7-45cf-97f6-a34998dc9b50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:53.023313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:53.023313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:53.023313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:53.023313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:53.023313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:53.023313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:53.023313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:53.023313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:53.023313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:53.023313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:53.023313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:53.023313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:53.023313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:53.023313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:53.024257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:53.024257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:53.024257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:53.024257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:53.024257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:53.024257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:53.024257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:53.024257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:53.024257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:53.024257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:53.024257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:53.024257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:53.024257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:53.024257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:53.024257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:53.024257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:53.024257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:53.025151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:53.025151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:53.025151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:53.025151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:53.025151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 444/866] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:53.034760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccf0fc-930b-45d4-a0bd-0f2f2e7bc68a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:53.115318 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:53.148012 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccf0fc-930b-45d4-a0bd-0f2f2e7bc68a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:53.184096 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dd220-d026-40a1-9413-3d5a120b94b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:53.184768 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dd220-d026-40a1-9413-3d5a120b94b3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:53.185052 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dd220-d026-40a1-9413-3d5a120b94b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:53.185332 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dd220-d026-40a1-9413-3d5a120b94b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:53.186091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dd220-d026-40a1-9413-3d5a120b94b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:53.186397 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dd220-d026-40a1-9413-3d5a120b94b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:53.187769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dd220-d026-40a1-9413-3d5a120b94b3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:53.201202 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 423/867] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:53.209628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c212df4-37d7-45cf-97f6-a34998dc9b50 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:53.301964 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:53.322973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c212df4-37d7-45cf-97f6-a34998dc9b50 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:53.360846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfff70e-522d-44ab-93ae-86bb3da13080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:53.362179 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfff70e-522d-44ab-93ae-86bb3da13080 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:53.362699 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfff70e-522d-44ab-93ae-86bb3da13080 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:53.363218 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfff70e-522d-44ab-93ae-86bb3da13080 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:53.372322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfff70e-522d-44ab-93ae-86bb3da13080 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:53.374259 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfff70e-522d-44ab-93ae-86bb3da13080 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:53.390991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-fdfff70e-522d-44ab-93ae-86bb3da13080 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:53.390991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:53.390991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:53.390991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:53.390991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:53.390991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:53.390991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:53.390991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:53.390991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:53.390991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:53.390991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:53.390991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:53.390991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:53.390991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:53.390991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:53.391978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:53.391978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:53.391978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:53.391978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:53.391978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:53.391978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:53.391978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:53.391978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:53.391978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:53.391978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:53.391978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:53.391978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:53.391978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:53.391978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:53.391978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:53.391978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:53.391978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:53.392888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:53.392888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:53.392888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:53.392888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:53.392888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:53.392888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:53.392888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:53.392888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:53.396975 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 445/868] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:53.403061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dd220-d026-40a1-9413-3d5a120b94b3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:53.511007 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dd220-d026-40a1-9413-3d5a120b94b3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:53.542919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:53.548559 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9230d-ddcc-4ae9-8fd6-73fc182fc710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:53.549249 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9230d-ddcc-4ae9-8fd6-73fc182fc710 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:53.549549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9230d-ddcc-4ae9-8fd6-73fc182fc710 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:53.549879 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9230d-ddcc-4ae9-8fd6-73fc182fc710 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:53.550815 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9230d-ddcc-4ae9-8fd6-73fc182fc710 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:53.551127 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9230d-ddcc-4ae9-8fd6-73fc182fc710 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:53.553208 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9230d-ddcc-4ae9-8fd6-73fc182fc710 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:53.562761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca206af-b8dd-4382-bbb8-b68851c10414 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:53.563067 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca206af-b8dd-4382-bbb8-b68851c10414 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:53.563339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca206af-b8dd-4382-bbb8-b68851c10414 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:53.567008 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 424/870] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:53.567171 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 446/870] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:53.570773 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9d372-03d7-43c8-a3ba-49f1f15b9d09 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:53.571062 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9d372-03d7-43c8-a3ba-49f1f15b9d09 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:53.571343 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9d372-03d7-43c8-a3ba-49f1f15b9d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:53.573851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca206af-b8dd-4382-bbb8-b68851c10414 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:53.588614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-55a9d372-03d7-43c8-a3ba-49f1f15b9d09 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:53.589848 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-55a9d372-03d7-43c8-a3ba-49f1f15b9d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:53.663055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 425/871] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:51:53.684705 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9d372-03d7-43c8-a3ba-49f1f15b9d09 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:53.695121 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca206af-b8dd-4382-bbb8-b68851c10414 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:53.732508 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b3e39-fe44-419c-947b-a2bde7770fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:53.733617 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b3e39-fe44-419c-947b-a2bde7770fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:53.734169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b3e39-fe44-419c-947b-a2bde7770fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:53.734658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b3e39-fe44-419c-947b-a2bde7770fc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:53.735739 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b3e39-fe44-419c-947b-a2bde7770fc8 None admin] RBAC: Adding query filter params (role.id=c6328736ee34470cb87aa31dea4530bf, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=9692d55c8c924544a1bff62054731ed2) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:53.736268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b3e39-fe44-419c-947b-a2bde7770fc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:53.737961 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b3e39-fe44-419c-947b-a2bde7770fc8 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:53.745217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 447/872] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:51:53 2022] GET /identity/v3/role_assignments?user.id=9692d55c8c924544a1bff62054731ed2&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=c6328736ee34470cb87aa31dea4530bf => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:53.800613 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9d372-03d7-43c8-a3ba-49f1f15b9d09 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:53.829222 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:53.843635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e4048-ebc5-45cd-92b7-dd5e70b02847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:53.844329 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e4048-ebc5-45cd-92b7-dd5e70b02847 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:53.844611 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e4048-ebc5-45cd-92b7-dd5e70b02847 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:53.844889 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e4048-ebc5-45cd-92b7-dd5e70b02847 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:53.845648 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e4048-ebc5-45cd-92b7-dd5e70b02847 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:53.847091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e4048-ebc5-45cd-92b7-dd5e70b02847 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:53.866624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 426/873] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 18 16:51:53 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 16:51:53.969952 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9428609-b23f-4e15-b435-2d7854738ad5 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:53.970245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9428609-b23f-4e15-b435-2d7854738ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:53.970518 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9428609-b23f-4e15-b435-2d7854738ad5 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:53.971899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 448/874] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:53.978565 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4753cf-01ab-4d83-b5e5-02dc05c053cb None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:53.978925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4753cf-01ab-4d83-b5e5-02dc05c053cb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:53.979141 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4753cf-01ab-4d83-b5e5-02dc05c053cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:53.999400 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0f4753cf-01ab-4d83-b5e5-02dc05c053cb None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:54.000689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0f4753cf-01ab-4d83-b5e5-02dc05c053cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:54.091800 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 427/875] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:51:54.114437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9428609-b23f-4e15-b435-2d7854738ad5 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:54.124592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:54.226014 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9428609-b23f-4e15-b435-2d7854738ad5 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:54.261776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fc5d0-ee66-4de4-909c-d179ded8b82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:54.262593 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fc5d0-ee66-4de4-909c-d179ded8b82b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:54.262876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fc5d0-ee66-4de4-909c-d179ded8b82b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:54.263156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fc5d0-ee66-4de4-909c-d179ded8b82b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:54.263814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fc5d0-ee66-4de4-909c-d179ded8b82b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:54.265187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fc5d0-ee66-4de4-909c-d179ded8b82b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:54.278249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-9c4fc5d0-ee66-4de4-909c-d179ded8b82b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 16:51:54.278249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:54.278249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:51:54.278249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:51:54.278249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:51:54.278249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:51:54.278249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:51:54.278249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:54.278249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 16:51:54.278249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:54.278249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:51:54.278249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:54.278249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:54.278249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:54.278249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:54.278249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:54.278249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:54.279485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:54.279485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:54.279485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:54.279485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:54.279485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:54.279485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:54.279485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:51:54.279485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:51:54.279485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:51:54.279485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:51:54.279485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:54.279485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:54.279485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:54.279485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:54.279485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:54.279485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:54.280362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:54.280362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:54.280362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:54.280362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:54.280362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:54.280362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:54.280362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:54.280362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:54.280362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:54.280362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:54.280362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:51:54.280362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:54.280362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 16:51:54.280362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:54.280362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 449/876] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 18 16:51:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:54.285904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4753cf-01ab-4d83-b5e5-02dc05c053cb None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:54.391716 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4753cf-01ab-4d83-b5e5-02dc05c053cb None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:54.402148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:54.431119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047294b-4c17-4446-8bd8-d1cbb2df8e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:54.432067 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047294b-4c17-4446-8bd8-d1cbb2df8e8d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:54.432521 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047294b-4c17-4446-8bd8-d1cbb2df8e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:54.432942 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047294b-4c17-4446-8bd8-d1cbb2df8e8d None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:54.433832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047294b-4c17-4446-8bd8-d1cbb2df8e8d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:54.434299 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047294b-4c17-4446-8bd8-d1cbb2df8e8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:54.435815 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047294b-4c17-4446-8bd8-d1cbb2df8e8d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:54.441303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 428/877] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 18 16:51:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:54.447752 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fc5d0-ee66-4de4-909c-d179ded8b82b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:54.522407 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:54.556041 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fc5d0-ee66-4de4-909c-d179ded8b82b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:54.592175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85964e39-5a10-47fb-8453-e9a51184348a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:54.592901 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85964e39-5a10-47fb-8453-e9a51184348a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:54.593185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85964e39-5a10-47fb-8453-e9a51184348a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:54.593508 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85964e39-5a10-47fb-8453-e9a51184348a None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:54.594257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85964e39-5a10-47fb-8453-e9a51184348a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:54.594565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85964e39-5a10-47fb-8453-e9a51184348a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:54.595939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85964e39-5a10-47fb-8453-e9a51184348a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:54.602193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 450/878] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 18 16:51:54 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:55.181195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc508e39-f796-47bd-86e9-5c8cd79c2be4 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:55.181738 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc508e39-f796-47bd-86e9-5c8cd79c2be4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:55.181819 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc508e39-f796-47bd-86e9-5c8cd79c2be4 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:55.183404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 429/879] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:55.188754 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbca172-1e19-4f62-9d6a-145cca6d6344 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:55.189177 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbca172-1e19-4f62-9d6a-145cca6d6344 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:55.189330 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbca172-1e19-4f62-9d6a-145cca6d6344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:55.206834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-3bbca172-1e19-4f62-9d6a-145cca6d6344 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:55.208778 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3bbca172-1e19-4f62-9d6a-145cca6d6344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:55.279169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 451/880] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:55 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:51:55.301149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc508e39-f796-47bd-86e9-5c8cd79c2be4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:55.408551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc508e39-f796-47bd-86e9-5c8cd79c2be4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:55.449298 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee58de7-00d3-4882-9236-23c9e64919f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:55.449997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee58de7-00d3-4882-9236-23c9e64919f1 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:55.450282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee58de7-00d3-4882-9236-23c9e64919f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:55.450560 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee58de7-00d3-4882-9236-23c9e64919f1 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:55.451290 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee58de7-00d3-4882-9236-23c9e64919f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:55.452655 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee58de7-00d3-4882-9236-23c9e64919f1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:55.470216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 430/881] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 18 16:51:55 2022] POST /identity/v3/services => generated 269 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:51:56.162328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debefae4-bcb1-4d03-882d-7c4f6d1acaa0 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:56.162679 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debefae4-bcb1-4d03-882d-7c4f6d1acaa0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:56.162883 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debefae4-bcb1-4d03-882d-7c4f6d1acaa0 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:56.164516 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 452/882] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:56.170174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a9e4d-95f7-4f69-9b9f-2c27021e23bf None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:56.170769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a9e4d-95f7-4f69-9b9f-2c27021e23bf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:56.171245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a9e4d-95f7-4f69-9b9f-2c27021e23bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:56.190377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-905a9e4d-95f7-4f69-9b9f-2c27021e23bf None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:56.192987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-905a9e4d-95f7-4f69-9b9f-2c27021e23bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:56.224954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:56.278238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 431/883] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:51:56.302195 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debefae4-bcb1-4d03-882d-7c4f6d1acaa0 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:56.309841 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca521e4-eb87-463e-9741-d9538305778c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:56.310137 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca521e4-eb87-463e-9741-d9538305778c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:56.310415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca521e4-eb87-463e-9741-d9538305778c None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:56.312077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 432/884] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:56.318767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc6864-1a89-49da-aec9-4640f3b3dbc1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:56.319046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc6864-1a89-49da-aec9-4640f3b3dbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:56.319253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc6864-1a89-49da-aec9-4640f3b3dbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:56.341866 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-22bc6864-1a89-49da-aec9-4640f3b3dbc1 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:56.343075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-22bc6864-1a89-49da-aec9-4640f3b3dbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:56.384016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:56.439377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debefae4-bcb1-4d03-882d-7c4f6d1acaa0 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:56.456858 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 433/885] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:51:56.483863 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc6864-1a89-49da-aec9-4640f3b3dbc1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:56.494043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104a235-3652-48bb-b77f-40e2177ed814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:56.494881 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104a235-3652-48bb-b77f-40e2177ed814 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:56.495157 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104a235-3652-48bb-b77f-40e2177ed814 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:56.495742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104a235-3652-48bb-b77f-40e2177ed814 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:56.515397 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e104a235-3652-48bb-b77f-40e2177ed814 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:51:56.526926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-e104a235-3652-48bb-b77f-40e2177ed814 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 16:51:56.526926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:56.526926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:56.526926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:56.526926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:56.526926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:56.526926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:56.526926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:56.526926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:56.526926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:56.526926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:56.526926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:56.526926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:51:56.526926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:51:56.526926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:51:56.526926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:51:56.528070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:51:56.528070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:51:56.528070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:51:56.528070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:51:56.528070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:56.528070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:56.528070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:56.528070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:56.528070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:56.528070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:56.528070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:56.528070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:56.528070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:56.528070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:56.528070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:56.528070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:56.529299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:56.529299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:56.529299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:56.529299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:56.529299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:51:56.529299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:51:56.529299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:51:56.529299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:51:56.529299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:51:56.529299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:51:56.529299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 16:51:56.529299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:56.532338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 453/886] 10.222.0.49 () {56 vars in 1120 bytes} [Wed May 18 16:51:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:56.542443 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104a235-3652-48bb-b77f-40e2177ed814 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:56.622138 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:56.634761 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc6864-1a89-49da-aec9-4640f3b3dbc1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:56.675592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708ff2a-ad87-4dfe-a766-839ee36158c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:56.677880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708ff2a-ad87-4dfe-a766-839ee36158c0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:56.678830 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708ff2a-ad87-4dfe-a766-839ee36158c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:56.679623 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708ff2a-ad87-4dfe-a766-839ee36158c0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:56.680639 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708ff2a-ad87-4dfe-a766-839ee36158c0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:56.682603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708ff2a-ad87-4dfe-a766-839ee36158c0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:56.694787 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104a235-3652-48bb-b77f-40e2177ed814 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:56.701898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-9708ff2a-ad87-4dfe-a766-839ee36158c0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 16:51:56.701898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:56.701898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:51:56.701898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:51:56.701898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:51:56.701898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:51:56.701898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:51:56.701898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:56.701898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 16:51:56.701898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:56.701898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:51:56.701898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:56.701898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:56.701898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:56.701898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:56.701898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:56.701898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:56.702935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:56.702935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:56.702935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:56.702935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:56.702935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:56.702935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:56.702935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:51:56.702935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:51:56.702935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:51:56.702935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:51:56.702935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:56.702935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:56.702935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:56.702935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:56.702935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:56.702935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:56.703856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:56.703856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:56.703856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:56.703856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:56.703856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:56.703856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:56.703856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:56.703856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:56.703856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:56.703856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:56.703856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:51:56.703856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:56.703856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 16:51:56.703856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:56.713523 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 434/887] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:51:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:56.716543 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708ff2a-ad87-4dfe-a766-839ee36158c0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:56.724271 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:56.740638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09325f2a-24d5-43eb-8787-1663e3d44239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:56.741368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09325f2a-24d5-43eb-8787-1663e3d44239 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:56.741672 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09325f2a-24d5-43eb-8787-1663e3d44239 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:56.742106 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09325f2a-24d5-43eb-8787-1663e3d44239 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:56.742899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09325f2a-24d5-43eb-8787-1663e3d44239 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:56.743436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09325f2a-24d5-43eb-8787-1663e3d44239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:56.745040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09325f2a-24d5-43eb-8787-1663e3d44239 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:56.756388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 454/888] 10.222.0.49 () {56 vars in 1115 bytes} [Wed May 18 16:51:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:56.763105 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09325f2a-24d5-43eb-8787-1663e3d44239 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:56.845241 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708ff2a-ad87-4dfe-a766-839ee36158c0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:56.893534 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21981fa-de69-40b4-8396-e6f5d69a02fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:56.894683 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21981fa-de69-40b4-8396-e6f5d69a02fa None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:56.895747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21981fa-de69-40b4-8396-e6f5d69a02fa None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:56.896231 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21981fa-de69-40b4-8396-e6f5d69a02fa None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:56.896339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09325f2a-24d5-43eb-8787-1663e3d44239 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:56.897255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21981fa-de69-40b4-8396-e6f5d69a02fa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:56.897986 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21981fa-de69-40b4-8396-e6f5d69a02fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:56.899697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21981fa-de69-40b4-8396-e6f5d69a02fa None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:56.909843 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 435/889] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:51:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:56.913891 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21981fa-de69-40b4-8396-e6f5d69a02fa None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:56.935021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:56.938415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abdf71-b082-4a53-811a-fed31ad059f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:56.939872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abdf71-b082-4a53-811a-fed31ad059f7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:56.940349 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abdf71-b082-4a53-811a-fed31ad059f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:56.940865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abdf71-b082-4a53-811a-fed31ad059f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:56.956655 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abdf71-b082-4a53-811a-fed31ad059f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:56.959163 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abdf71-b082-4a53-811a-fed31ad059f7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:56.980263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-e6abdf71-b082-4a53-811a-fed31ad059f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:56.980263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:56.980263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:56.980263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:56.980263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:56.980263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:56.980263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:56.980263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:56.980263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:56.980263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:56.980263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:56.980263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:56.980263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:56.980263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:56.980263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:56.981229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:56.981229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:56.981229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:56.981229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:56.981229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:56.981229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:56.981229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:56.981229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:56.981229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:56.981229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:56.981229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:56.981229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:56.981229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:56.981229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:56.981229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:56.981229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:56.981229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:56.982392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:56.982392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:56.982392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:56.982392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:56.989431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 455/890] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:56.990721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abdf71-b082-4a53-811a-fed31ad059f7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:57.037646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21981fa-de69-40b4-8396-e6f5d69a02fa None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:57.048073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:57.083664 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1908d-67ae-4f4b-8bcc-e7938da7248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:57.084571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1908d-67ae-4f4b-8bcc-e7938da7248e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:57.084958 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1908d-67ae-4f4b-8bcc-e7938da7248e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:57.085335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1908d-67ae-4f4b-8bcc-e7938da7248e None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:57.086328 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1908d-67ae-4f4b-8bcc-e7938da7248e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:57.086755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1908d-67ae-4f4b-8bcc-e7938da7248e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:57.088356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1908d-67ae-4f4b-8bcc-e7938da7248e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:57.096661 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 436/891] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:51:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:51:57.098843 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352a06-534a-439c-89bd-77ec13267abd None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:57.099225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352a06-534a-439c-89bd-77ec13267abd None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:57.099654 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff352a06-534a-439c-89bd-77ec13267abd None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:57.102003 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 437/892] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:57.104255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff352a06-534a-439c-89bd-77ec13267abd None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:57.142771 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abdf71-b082-4a53-811a-fed31ad059f7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:57.190074 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b95d6-6064-40a8-b56d-4b6d4682754b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:57.190771 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b95d6-6064-40a8-b56d-4b6d4682754b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:57.191051 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b95d6-6064-40a8-b56d-4b6d4682754b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:57.191325 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b95d6-6064-40a8-b56d-4b6d4682754b None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:57.192131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b95d6-6064-40a8-b56d-4b6d4682754b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:57.192436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b95d6-6064-40a8-b56d-4b6d4682754b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:57.194132 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b95d6-6064-40a8-b56d-4b6d4682754b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:57.208631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 456/893] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:57.210002 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f23fb1-8624-4976-9478-a9adc2ac4e5c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:57.210305 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f23fb1-8624-4976-9478-a9adc2ac4e5c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:57.210575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f23fb1-8624-4976-9478-a9adc2ac4e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:57.213311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:57.229053 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-02f23fb1-8624-4976-9478-a9adc2ac4e5c None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:57.230284 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-02f23fb1-8624-4976-9478-a9adc2ac4e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:57.240751 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff352a06-534a-439c-89bd-77ec13267abd None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:57.285083 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b97ac-8f43-4c3a-abac-45a87ffb8a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:57.286124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b97ac-8f43-4c3a-abac-45a87ffb8a97 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:57.286417 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b97ac-8f43-4c3a-abac-45a87ffb8a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:57.286689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b97ac-8f43-4c3a-abac-45a87ffb8a97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:57.287480 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b97ac-8f43-4c3a-abac-45a87ffb8a97 None admin] RBAC: Adding query filter params (interface=public, service_id=4a53cdbb82a84c62b835123a289d4cd3, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:57.287793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b97ac-8f43-4c3a-abac-45a87ffb8a97 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:57.289159 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b97ac-8f43-4c3a-abac-45a87ffb8a97 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:57.300785 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 438/894] 10.222.0.49 () {56 vars in 1251 bytes} [Wed May 18 16:51:57 2022] GET /identity/v3/endpoints?service_id=4a53cdbb82a84c62b835123a289d4cd3&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:57.300785 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b97ac-8f43-4c3a-abac-45a87ffb8a97 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:57.321721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 457/895] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:51:57.322263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f23fb1-8624-4976-9478-a9adc2ac4e5c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:57.363000 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:57.414989 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b97ac-8f43-4c3a-abac-45a87ffb8a97 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:57.440505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f23fb1-8624-4976-9478-a9adc2ac4e5c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:57.456381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c70eff-2afe-450f-8170-86e924ec6148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:57.457196 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c70eff-2afe-450f-8170-86e924ec6148 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:57.457627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c70eff-2afe-450f-8170-86e924ec6148 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:57.457947 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c70eff-2afe-450f-8170-86e924ec6148 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:57.466282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c70eff-2afe-450f-8170-86e924ec6148 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:57.467726 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c70eff-2afe-450f-8170-86e924ec6148 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:57.478969 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20331f5-a9be-49d0-ad1e-f20ace7d13f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:57.479639 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20331f5-a9be-49d0-ad1e-f20ace7d13f2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:57.479933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20331f5-a9be-49d0-ad1e-f20ace7d13f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:57.480211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20331f5-a9be-49d0-ad1e-f20ace7d13f2 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:57.480903 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20331f5-a9be-49d0-ad1e-f20ace7d13f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:57.482308 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20331f5-a9be-49d0-ad1e-f20ace7d13f2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:57.483174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-d3c70eff-2afe-450f-8170-86e924ec6148 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 16:51:57.483174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:57.483174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:57.483174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:57.483174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:57.483174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:57.483174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:57.483174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:57.483174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:57.483174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:57.483174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:57.483174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:57.483174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:51:57.483174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:51:57.483174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:51:57.483174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:51:57.484077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:57.484077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:57.484077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:51:57.484077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:57.484077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:51:57.484077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:51:57.484077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:57.484077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:57.484077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:57.484077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:57.484077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:57.484077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:57.484077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:57.484077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:57.484077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:57.484077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:57.484077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:57.484077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:57.485643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:57.485643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:57.485643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:51:57.485643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:51:57.485643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:51:57.485643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:51:57.485643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:51:57.485643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:51:57.485643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 16:51:57.485643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:57.485643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 439/896] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 18 16:51:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:57.486537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c70eff-2afe-450f-8170-86e924ec6148 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:57.491286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:57.494858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 458/897] 10.222.0.49 () {56 vars in 1087 bytes} [Wed May 18 16:51:57 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 16:51:57.501733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20331f5-a9be-49d0-ad1e-f20ace7d13f2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:57.600343 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:57.611375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20331f5-a9be-49d0-ad1e-f20ace7d13f2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:57.611824 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c70eff-2afe-450f-8170-86e924ec6148 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:57.653980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3955a-3fe1-4b27-9477-77f935b40043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:57.654810 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3955a-3fe1-4b27-9477-77f935b40043 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:57.654914 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded3f96-619f-43c9-b39d-887c873023b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:57.655134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3955a-3fe1-4b27-9477-77f935b40043 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:57.655517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3955a-3fe1-4b27-9477-77f935b40043 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:57.655636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded3f96-619f-43c9-b39d-887c873023b5 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:57.655812 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded3f96-619f-43c9-b39d-887c873023b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:57.656099 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded3f96-619f-43c9-b39d-887c873023b5 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:57.656736 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3955a-3fe1-4b27-9477-77f935b40043 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:57.656843 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded3f96-619f-43c9-b39d-887c873023b5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:57.657241 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3955a-3fe1-4b27-9477-77f935b40043 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:57.658328 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded3f96-619f-43c9-b39d-887c873023b5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:57.658967 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3955a-3fe1-4b27-9477-77f935b40043 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:57.682042 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 459/898] 10.222.0.49 () {56 vars in 1149 bytes} [Wed May 18 16:51:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:57.682518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 440/899] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 18 16:51:57 2022] POST /identity/v3/services => generated 241 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:51:57.693906 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3955a-3fe1-4b27-9477-77f935b40043 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:57.814371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3955a-3fe1-4b27-9477-77f935b40043 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:57.841362 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d259808-0691-4819-a5ad-de9fffcf29c5 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:57.841736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d259808-0691-4819-a5ad-de9fffcf29c5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:57.841954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d259808-0691-4819-a5ad-de9fffcf29c5 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:57.843611 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 441/900] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:57.850473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445eb1a-26d2-45ac-b1b2-3b56c3222c56 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:57.850958 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445eb1a-26d2-45ac-b1b2-3b56c3222c56 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:57.851293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445eb1a-26d2-45ac-b1b2-3b56c3222c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:57.870996 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8445eb1a-26d2-45ac-b1b2-3b56c3222c56 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:57.872640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd50a3-fa5c-4ada-8382-fdaa7c670b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:57.872895 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8445eb1a-26d2-45ac-b1b2-3b56c3222c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:51:57.873313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd50a3-fa5c-4ada-8382-fdaa7c670b1a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:57.873599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd50a3-fa5c-4ada-8382-fdaa7c670b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:57.873913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd50a3-fa5c-4ada-8382-fdaa7c670b1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:57.896580 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:57.950775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:57.969532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd50a3-fa5c-4ada-8382-fdaa7c670b1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:57.969532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd50a3-fa5c-4ada-8382-fdaa7c670b1a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:57.973553 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 442/901] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:51:57.994826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445eb1a-26d2-45ac-b1b2-3b56c3222c56 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:58.094669 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 460/902] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:51:57 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 16:51:58.100402 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd50a3-fa5c-4ada-8382-fdaa7c670b1a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:58.112491 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445eb1a-26d2-45ac-b1b2-3b56c3222c56 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:58.157390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58cfeb-d348-4eda-bc0a-a19140aa6b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:58.158433 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:58.158647 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58cfeb-d348-4eda-bc0a-a19140aa6b69 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:58.159465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58cfeb-d348-4eda-bc0a-a19140aa6b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:58.159905 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58cfeb-d348-4eda-bc0a-a19140aa6b69 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:58.161586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58cfeb-d348-4eda-bc0a-a19140aa6b69 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:58.163181 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58cfeb-d348-4eda-bc0a-a19140aa6b69 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:58.179514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ae58cfeb-d348-4eda-bc0a-a19140aa6b69 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 16:51:58.179514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:58.179514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:51:58.179514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:51:58.179514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:51:58.179514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:51:58.179514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:51:58.179514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:58.179514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 16:51:58.179514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:58.179514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:51:58.179514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:58.179514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:58.179514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:58.179514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:58.179514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:58.180709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:58.180709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:58.180709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:58.180709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:58.180709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:58.180709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:58.180709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:58.180709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:51:58.180709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:51:58.180709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:51:58.180709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:51:58.180709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:58.180709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:58.180709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:58.180709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:58.180709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:58.181756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:58.181756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:58.181756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:51:58.181756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:58.181756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:58.181756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:58.181756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:58.181756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:58.181756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:58.181756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:58.181756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:58.181756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:51:58.181756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:51:58.181756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 16:51:58.181756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:51:58.188923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 443/903] 10.222.0.49 () {56 vars in 1132 bytes} [Wed May 18 16:51:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:58.190929 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58cfeb-d348-4eda-bc0a-a19140aa6b69 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:58.239644 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd50a3-fa5c-4ada-8382-fdaa7c670b1a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:58.266463 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:58.284953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a02860-22f5-45f6-bcf6-9d4a6c2ae216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:58.286587 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a02860-22f5-45f6-bcf6-9d4a6c2ae216 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:58.287017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a02860-22f5-45f6-bcf6-9d4a6c2ae216 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:58.287990 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a02860-22f5-45f6-bcf6-9d4a6c2ae216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:58.300620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a02860-22f5-45f6-bcf6-9d4a6c2ae216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:58.303137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a02860-22f5-45f6-bcf6-9d4a6c2ae216 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:58.320541 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58cfeb-d348-4eda-bc0a-a19140aa6b69 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:58.322357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-05a02860-22f5-45f6-bcf6-9d4a6c2ae216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:58.322357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:58.322357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:58.322357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:58.322357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:58.322357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:58.322357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:58.322357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:58.322357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:58.322357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:58.322357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:58.322357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:58.322357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:51:58.322357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:51:58.322357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:51:58.323717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:51:58.323717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:58.323717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:58.323717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:58.323717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:58.323717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:58.323717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:58.323717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:58.323717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:58.323717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:58.323717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:58.323717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:58.323717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:58.323717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:58.323717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:58.323717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:58.323717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:58.324816 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:51:58.324816 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:51:58.324816 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:51:58.324816 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:58.325539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 461/904] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:51:58.330829 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a02860-22f5-45f6-bcf6-9d4a6c2ae216 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:58.371396 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcb5ff-9a89-4811-9e20-4e5666c11136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:58.372061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcb5ff-9a89-4811-9e20-4e5666c11136 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:58.372343 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcb5ff-9a89-4811-9e20-4e5666c11136 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:58.372618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcb5ff-9a89-4811-9e20-4e5666c11136 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:58.373337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcb5ff-9a89-4811-9e20-4e5666c11136 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:58.373640 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcb5ff-9a89-4811-9e20-4e5666c11136 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:58.375059 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcb5ff-9a89-4811-9e20-4e5666c11136 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:58.396736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 444/905] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 18 16:51:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:58.398522 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcb5ff-9a89-4811-9e20-4e5666c11136 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:58.458116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:58.465338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a02860-22f5-45f6-bcf6-9d4a6c2ae216 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:58.513287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cbd1e-2725-44cb-bb12-76ed57e9f0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:58.514329 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cbd1e-2725-44cb-bb12-76ed57e9f0ef None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:58.515025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cbd1e-2725-44cb-bb12-76ed57e9f0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:58.515491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cbd1e-2725-44cb-bb12-76ed57e9f0ef None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:58.517106 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cbd1e-2725-44cb-bb12-76ed57e9f0ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:58.517574 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cbd1e-2725-44cb-bb12-76ed57e9f0ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:58.520135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cbd1e-2725-44cb-bb12-76ed57e9f0ef None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:58.527809 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcb5ff-9a89-4811-9e20-4e5666c11136 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:58.534788 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 462/906] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:58.539977 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cbd1e-2725-44cb-bb12-76ed57e9f0ef None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:58.560541 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:58.576884 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535130a-1ee8-4438-91cb-8ff0a5c61a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:58.577852 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535130a-1ee8-4438-91cb-8ff0a5c61a79 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:58.578151 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535130a-1ee8-4438-91cb-8ff0a5c61a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:58.578430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535130a-1ee8-4438-91cb-8ff0a5c61a79 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:58.579154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535130a-1ee8-4438-91cb-8ff0a5c61a79 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:58.579464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535130a-1ee8-4438-91cb-8ff0a5c61a79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:58.581800 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535130a-1ee8-4438-91cb-8ff0a5c61a79 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:58.593736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 445/907] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 18 16:51:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:58.596626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535130a-1ee8-4438-91cb-8ff0a5c61a79 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:58.664481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cbd1e-2725-44cb-bb12-76ed57e9f0ef None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:58.704529 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543fc5e-2770-46dc-b131-cc990ec0a95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:58.705774 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543fc5e-2770-46dc-b131-cc990ec0a95f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:58.706062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543fc5e-2770-46dc-b131-cc990ec0a95f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:58.706347 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543fc5e-2770-46dc-b131-cc990ec0a95f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:58.714728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543fc5e-2770-46dc-b131-cc990ec0a95f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:58.716129 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543fc5e-2770-46dc-b131-cc990ec0a95f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:58.734209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-1543fc5e-2770-46dc-b131-cc990ec0a95f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:58.734209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:51:58.734209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:51:58.734209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:51:58.734209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:51:58.734209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:51:58.734209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:51:58.734209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:51:58.734209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:51:58.734209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:51:58.734209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:51:58.734209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:51:58.734209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:51:58.734209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:51:58.734209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:51:58.735214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:51:58.735214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:51:58.735214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:51:58.735214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:51:58.735214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:51:58.735214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:51:58.735214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:51:58.735214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:51:58.735214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:51:58.735214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:51:58.735214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:51:58.735214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:51:58.735214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:51:58.735214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:51:58.735214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:51:58.735214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:51:58.735214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:51:58.736113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:51:58.736113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:51:58.736113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:51:58.736113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:51:58.736113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:51:58.736113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:51:58.736113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:51:58.736113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:51:58.736113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 463/908] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:51:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:51:58.740828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535130a-1ee8-4438-91cb-8ff0a5c61a79 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:58.741866 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543fc5e-2770-46dc-b131-cc990ec0a95f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:58.762713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:58.779638 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb196dc3-b828-47dc-bbbd-0af57793c5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:58.780227 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb196dc3-b828-47dc-bbbd-0af57793c5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:58.780560 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb196dc3-b828-47dc-bbbd-0af57793c5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:58.780770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb196dc3-b828-47dc-bbbd-0af57793c5c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:58.781572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb196dc3-b828-47dc-bbbd-0af57793c5c0 None admin] RBAC: Adding query filter params (interface=public, service_id=dc8d8178c8684fa29a307d5ea0db8ef8, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:58.781918 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb196dc3-b828-47dc-bbbd-0af57793c5c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:58.783337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb196dc3-b828-47dc-bbbd-0af57793c5c0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:58.789697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 446/909] 10.222.0.49 () {56 vars in 1251 bytes} [Wed May 18 16:51:58 2022] GET /identity/v3/endpoints?service_id=dc8d8178c8684fa29a307d5ea0db8ef8&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:58.794783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb196dc3-b828-47dc-bbbd-0af57793c5c0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:58.854039 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:58.883186 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543fc5e-2770-46dc-b131-cc990ec0a95f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:58.906135 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb196dc3-b828-47dc-bbbd-0af57793c5c0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:58.936327 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807b284-9ab5-4c30-b114-df5779cf95d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:58.937927 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807b284-9ab5-4c30-b114-df5779cf95d5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:58.938502 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807b284-9ab5-4c30-b114-df5779cf95d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:58.939201 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807b284-9ab5-4c30-b114-df5779cf95d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:58.940333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807b284-9ab5-4c30-b114-df5779cf95d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:58.941110 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807b284-9ab5-4c30-b114-df5779cf95d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:58.943705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807b284-9ab5-4c30-b114-df5779cf95d5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:58.954863 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57c0a4-b1bf-4d7e-b866-d2772b0dcd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:58.955795 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57c0a4-b1bf-4d7e-b866-d2772b0dcd3a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:58.956089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57c0a4-b1bf-4d7e-b866-d2772b0dcd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:58.956550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57c0a4-b1bf-4d7e-b866-d2772b0dcd3a None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:58.957449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57c0a4-b1bf-4d7e-b866-d2772b0dcd3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:58.964552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57c0a4-b1bf-4d7e-b866-d2772b0dcd3a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:58.965137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 464/910] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:51:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:58.966516 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807b284-9ab5-4c30-b114-df5779cf95d5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:51:58.972089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 447/911] 10.222.0.49 () {56 vars in 1087 bytes} [Wed May 18 16:51:58 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 16:51:59.064544 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:51:59.090935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807b284-9ab5-4c30-b114-df5779cf95d5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:51:59.128985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396d376-c2ce-45ee-9b5d-11764b8ccaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:51:59.130012 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396d376-c2ce-45ee-9b5d-11764b8ccaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:59.130439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396d376-c2ce-45ee-9b5d-11764b8ccaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:59.130895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396d376-c2ce-45ee-9b5d-11764b8ccaa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:59.131883 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396d376-c2ce-45ee-9b5d-11764b8ccaa6 None admin] RBAC: Adding query filter params (role.id=dd4f2c1c23cf4468a005cb46a039f660, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=9692d55c8c924544a1bff62054731ed2) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:51:59.132353 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396d376-c2ce-45ee-9b5d-11764b8ccaa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:51:59.134053 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396d376-c2ce-45ee-9b5d-11764b8ccaa6 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:51:59.141212 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 465/912] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:51:58 2022] GET /identity/v3/role_assignments?user.id=9692d55c8c924544a1bff62054731ed2&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=dd4f2c1c23cf4468a005cb46a039f660 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:51:59.922535 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dbca6-46d9-477a-98a1-a76161ea46ac None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:59.923054 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dbca6-46d9-477a-98a1-a76161ea46ac None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:59.923160 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dbca6-46d9-477a-98a1-a76161ea46ac None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:59.924700 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 448/913] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:51:59.930838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e028d30-ad9e-46bc-b3ac-098aa3161ac6 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:51:59.931677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e028d30-ad9e-46bc-b3ac-098aa3161ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:51:59.932167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e028d30-ad9e-46bc-b3ac-098aa3161ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:51:59.950144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-3e028d30-ad9e-46bc-b3ac-098aa3161ac6 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:51:59.951648 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3e028d30-ad9e-46bc-b3ac-098aa3161ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:00.023726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 466/914] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:51:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:00.036392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1e828-1874-479d-a6ca-5605e20eb306 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:00.036748 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1e828-1874-479d-a6ca-5605e20eb306 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:00.037033 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1e828-1874-479d-a6ca-5605e20eb306 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:00.038694 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 449/915] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:00.044157 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93284a9-3171-4525-851a-241e9fe96c7d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:00.044681 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93284a9-3171-4525-851a-241e9fe96c7d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:00.045175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93284a9-3171-4525-851a-241e9fe96c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:00.050854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1e828-1874-479d-a6ca-5605e20eb306 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:00.065361 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e93284a9-3171-4525-851a-241e9fe96c7d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:00.066767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e93284a9-3171-4525-851a-241e9fe96c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:00.161266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 467/916] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:00.177970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1e828-1874-479d-a6ca-5605e20eb306 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:00.180571 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93284a9-3171-4525-851a-241e9fe96c7d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:00.183047 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:00.202027 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:00.222285 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab038fbb-3999-45cc-a5f5-52880b81c545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:00.223654 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab038fbb-3999-45cc-a5f5-52880b81c545 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:00.223932 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab038fbb-3999-45cc-a5f5-52880b81c545 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:00.224198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab038fbb-3999-45cc-a5f5-52880b81c545 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:00.224857 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab038fbb-3999-45cc-a5f5-52880b81c545 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:00.226262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab038fbb-3999-45cc-a5f5-52880b81c545 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:00.243951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ab038fbb-3999-45cc-a5f5-52880b81c545 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 16:52:00.243951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:00.243951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:52:00.243951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:52:00.243951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:52:00.243951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:52:00.243951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:52:00.243951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:00.243951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 16:52:00.243951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:00.243951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:52:00.243951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:00.243951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:00.243951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:00.243951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:00.243951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:00.243951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:00.245031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:00.245031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:00.245031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:00.245031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:00.245031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:00.245031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:00.245031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:52:00.245031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:52:00.245031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:52:00.245031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:52:00.245031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:00.245031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:00.245031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:00.245031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:00.245031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:00.245031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:00.246591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:00.246591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:00.246591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:00.246591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:00.246591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:00.246591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:00.246591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:00.246591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:00.246591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:00.246591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:00.246591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:52:00.246591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:00.246591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 18 16:52:00.246591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:00.246591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 450/917] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:52:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:00.250996 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab038fbb-3999-45cc-a5f5-52880b81c545 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:00.320411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93284a9-3171-4525-851a-241e9fe96c7d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:00.365863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a47ec-263e-4d58-8176-69744c79444c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:00.366679 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a47ec-263e-4d58-8176-69744c79444c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:00.367005 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a47ec-263e-4d58-8176-69744c79444c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:00.367284 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a47ec-263e-4d58-8176-69744c79444c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:00.368519 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a47ec-263e-4d58-8176-69744c79444c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:00.370234 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a47ec-263e-4d58-8176-69744c79444c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:00.384861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-576a47ec-263e-4d58-8176-69744c79444c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 16:52:00.384861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:00.384861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:52:00.384861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:52:00.384861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:52:00.384861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:52:00.384861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:52:00.384861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:00.384861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 16:52:00.384861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:00.384861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:52:00.384861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:00.384861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:00.384861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:00.384861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:00.384861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:00.384861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:00.385953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:00.385953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:00.385953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:00.385953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:00.385953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:00.385953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:00.385953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:52:00.385953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:52:00.385953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:52:00.385953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:52:00.385953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:00.385953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:00.385953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:00.385953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:00.385953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:00.385953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:00.386793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:00.386793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:00.386793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:00.386793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:00.386793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:00.386793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:00.386793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:00.386793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:00.386793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:00.386793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:00.386793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:52:00.386793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:00.386793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 16:52:00.386793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:00.388710 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab038fbb-3999-45cc-a5f5-52880b81c545 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:00.391450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 468/918] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 18 16:52:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:52:00.392471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a47ec-263e-4d58-8176-69744c79444c None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:00.428636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0a28c-f4e8-4301-9c40-b2c35ae9b37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:00.429684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0a28c-f4e8-4301-9c40-b2c35ae9b37f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:00.430145 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0a28c-f4e8-4301-9c40-b2c35ae9b37f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:00.430596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0a28c-f4e8-4301-9c40-b2c35ae9b37f None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:00.431643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0a28c-f4e8-4301-9c40-b2c35ae9b37f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:00.432249 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0a28c-f4e8-4301-9c40-b2c35ae9b37f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:00.433843 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0a28c-f4e8-4301-9c40-b2c35ae9b37f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:00.439704 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 451/919] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:52:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:52:00.446651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0a28c-f4e8-4301-9c40-b2c35ae9b37f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:00.473442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:00.494828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:00.518722 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a47ec-263e-4d58-8176-69744c79444c None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:00.559334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0a28c-f4e8-4301-9c40-b2c35ae9b37f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:00.565491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17614cd-be02-4843-8343-1ebc0176da95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:00.566419 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17614cd-be02-4843-8343-1ebc0176da95 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:00.567053 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17614cd-be02-4843-8343-1ebc0176da95 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:00.567569 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17614cd-be02-4843-8343-1ebc0176da95 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:00.568949 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17614cd-be02-4843-8343-1ebc0176da95 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:00.569490 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17614cd-be02-4843-8343-1ebc0176da95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:00.571553 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17614cd-be02-4843-8343-1ebc0176da95 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:00.579060 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 469/920] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 18 16:52:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:00.585463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17614cd-be02-4843-8343-1ebc0176da95 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:00.605188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8702d95-4467-438c-bf37-84e22f96aebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:00.605969 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8702d95-4467-438c-bf37-84e22f96aebe None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:00.606256 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8702d95-4467-438c-bf37-84e22f96aebe None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:00.606537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8702d95-4467-438c-bf37-84e22f96aebe None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:00.607264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8702d95-4467-438c-bf37-84e22f96aebe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:00.607625 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8702d95-4467-438c-bf37-84e22f96aebe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:00.609062 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8702d95-4467-438c-bf37-84e22f96aebe None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:00.620752 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 452/921] 10.222.0.49 () {56 vars in 1114 bytes} [Wed May 18 16:52:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:00.621635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8702d95-4467-438c-bf37-84e22f96aebe None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:00.737330 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17614cd-be02-4843-8343-1ebc0176da95 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:00.741459 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8702d95-4467-438c-bf37-84e22f96aebe None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:00.748868 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:00.778170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:00.782565 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5d110-5e2d-4b45-8a8f-56b07630cb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:00.783516 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5d110-5e2d-4b45-8a8f-56b07630cb53 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:00.783851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5d110-5e2d-4b45-8a8f-56b07630cb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:00.784222 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5d110-5e2d-4b45-8a8f-56b07630cb53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:00.785059 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5d110-5e2d-4b45-8a8f-56b07630cb53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:00.787494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a4e1a-37a2-44e1-9f4f-971c9fa37473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:00.787626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5d110-5e2d-4b45-8a8f-56b07630cb53 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:00.788484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a4e1a-37a2-44e1-9f4f-971c9fa37473 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:00.788968 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a4e1a-37a2-44e1-9f4f-971c9fa37473 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:00.789383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a4e1a-37a2-44e1-9f4f-971c9fa37473 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:00.790431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a4e1a-37a2-44e1-9f4f-971c9fa37473 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:00.790895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a4e1a-37a2-44e1-9f4f-971c9fa37473 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:00.793274 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a4e1a-37a2-44e1-9f4f-971c9fa37473 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:00.800797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 470/922] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 18 16:52:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:52:00.809524 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a4e1a-37a2-44e1-9f4f-971c9fa37473 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:00.822114 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 453/923] 10.222.0.49 () {60 vars in 1144 bytes} [Wed May 18 16:52:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:52:00.931206 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a4e1a-37a2-44e1-9f4f-971c9fa37473 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:00.978511 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e9191-2f76-472d-a928-dc742b1c5ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:00.979504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e9191-2f76-472d-a928-dc742b1c5ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:00.979965 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e9191-2f76-472d-a928-dc742b1c5ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:00.980453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e9191-2f76-472d-a928-dc742b1c5ea7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:00.981454 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e9191-2f76-472d-a928-dc742b1c5ea7 None admin] RBAC: Adding query filter params (interface=public, service_id=46989271c2064ab8bdff9c3c7163dbf5, region_id=RegionOne) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:00.982025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e9191-2f76-472d-a928-dc742b1c5ea7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:00.983643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e9191-2f76-472d-a928-dc742b1c5ea7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:00.993720 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 471/924] 10.222.0.49 () {56 vars in 1251 bytes} [Wed May 18 16:52:00 2022] GET /identity/v3/endpoints?service_id=46989271c2064ab8bdff9c3c7163dbf5&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:52:01.003338 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5d110-5e2d-4b45-8a8f-56b07630cb53 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:01.135158 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5d110-5e2d-4b45-8a8f-56b07630cb53 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:01.171569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fe3e5-b9e9-4f3c-91d5-b12c25758ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:01.172241 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fe3e5-b9e9-4f3c-91d5-b12c25758ada None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:01.172520 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fe3e5-b9e9-4f3c-91d5-b12c25758ada None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:01.172793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fe3e5-b9e9-4f3c-91d5-b12c25758ada None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:01.173477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fe3e5-b9e9-4f3c-91d5-b12c25758ada None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:01.174871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fe3e5-b9e9-4f3c-91d5-b12c25758ada None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:01.182566 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 454/925] 10.222.0.49 () {56 vars in 1087 bytes} [Wed May 18 16:52:00 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 16:52:01.282638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202f582-98f7-4af4-91d3-fb08413d618d None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:01.282826 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202f582-98f7-4af4-91d3-fb08413d618d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:01.283113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202f582-98f7-4af4-91d3-fb08413d618d None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:01.284823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 472/926] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:01.290753 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804d2b9-85c5-475e-b531-6ad1f484b216 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:01.291091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804d2b9-85c5-475e-b531-6ad1f484b216 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:01.291306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804d2b9-85c5-475e-b531-6ad1f484b216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:01.311322 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8804d2b9-85c5-475e-b531-6ad1f484b216 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:01.313033 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8804d2b9-85c5-475e-b531-6ad1f484b216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:01.341128 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:01.396914 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 455/927] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:01.420751 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202f582-98f7-4af4-91d3-fb08413d618d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:01.485124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:01.501559 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb51e5-af6a-46a0-92af-ea283a02ea42 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:01.501914 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb51e5-af6a-46a0-92af-ea283a02ea42 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:01.502149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb51e5-af6a-46a0-92af-ea283a02ea42 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:01.503776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 456/928] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:52:01.509798 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c157670-3d60-4d70-8c1c-51c8684eeed9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:01.510089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c157670-3d60-4d70-8c1c-51c8684eeed9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:01.510370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c157670-3d60-4d70-8c1c-51c8684eeed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:01.527940 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9c157670-3d60-4d70-8c1c-51c8684eeed9 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:01.529143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9c157670-3d60-4d70-8c1c-51c8684eeed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:01.541532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202f582-98f7-4af4-91d3-fb08413d618d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:01.587171 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370e15c-5571-4a61-a6b2-8f553dcc64c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:01.588445 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370e15c-5571-4a61-a6b2-8f553dcc64c9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:01.588758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370e15c-5571-4a61-a6b2-8f553dcc64c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:01.589040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370e15c-5571-4a61-a6b2-8f553dcc64c9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:01.590016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370e15c-5571-4a61-a6b2-8f553dcc64c9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:01.591898 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370e15c-5571-4a61-a6b2-8f553dcc64c9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:01.600563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 457/929] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:52:01.606756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-9370e15c-5571-4a61-a6b2-8f553dcc64c9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 16:52:01.606756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:01.606756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:52:01.606756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:52:01.606756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:52:01.606756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:52:01.606756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:52:01.606756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:01.606756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 16:52:01.606756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:01.606756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:52:01.606756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:01.606756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:01.606756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:01.606756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:01.606756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:01.607713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:01.607713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:01.607713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:01.607713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:01.607713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:01.607713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:01.607713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:01.607713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:52:01.607713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:52:01.607713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:52:01.607713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:52:01.607713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:01.607713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:01.607713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:01.607713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:01.607713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:01.608873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:01.608873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:01.608873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:01.608873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:01.608873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:01.608873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:01.608873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:01.608873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:01.608873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:01.608873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:01.608873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:01.608873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:52:01.608873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:01.608873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 18 16:52:01.608873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:01.608873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 473/930] 10.222.0.49 () {56 vars in 1132 bytes} [Wed May 18 16:52:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:01.614505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c157670-3d60-4d70-8c1c-51c8684eeed9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:01.624438 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370e15c-5571-4a61-a6b2-8f553dcc64c9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:01.705617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:01.723661 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c157670-3d60-4d70-8c1c-51c8684eeed9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:01.762997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46b31e-739d-4517-b4ba-2e1ae77838af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:01.764021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46b31e-739d-4517-b4ba-2e1ae77838af None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:01.764533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46b31e-739d-4517-b4ba-2e1ae77838af None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:01.765019 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46b31e-739d-4517-b4ba-2e1ae77838af None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:01.765682 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370e15c-5571-4a61-a6b2-8f553dcc64c9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:01.766274 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46b31e-739d-4517-b4ba-2e1ae77838af None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:01.766813 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46b31e-739d-4517-b4ba-2e1ae77838af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:01.768612 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46b31e-739d-4517-b4ba-2e1ae77838af None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:01.779705 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 458/931] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 18 16:52:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:01.780980 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46b31e-739d-4517-b4ba-2e1ae77838af None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:01.788148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:01.803634 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536281c2-6304-4630-902f-6a6aee628228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:01.804441 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536281c2-6304-4630-902f-6a6aee628228 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:01.804929 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536281c2-6304-4630-902f-6a6aee628228 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:01.805035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536281c2-6304-4630-902f-6a6aee628228 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:01.815895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536281c2-6304-4630-902f-6a6aee628228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:52:01.824857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-536281c2-6304-4630-902f-6a6aee628228 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 16:52:01.824857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:01.824857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:01.824857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:01.824857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:01.824857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:01.824857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:01.824857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:01.824857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:01.824857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:01.824857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:01.824857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:01.824857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:52:01.824857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:52:01.824857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:52:01.824857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:52:01.826093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:52:01.826093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:52:01.826093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:52:01.826093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:52:01.826093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:01.826093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:01.826093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:01.826093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:01.826093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:01.826093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:01.826093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:01.826093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:01.826093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:01.826093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:01.826093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:01.826093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:01.826917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:01.826917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:01.826917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:01.826917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:01.826917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:52:01.826917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:52:01.826917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:52:01.826917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:52:01.826917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:52:01.826917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:52:01.826917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 16:52:01.826917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:01.831432 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 474/932] 10.222.0.49 () {56 vars in 1120 bytes} [Wed May 18 16:52:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:01.833378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536281c2-6304-4630-902f-6a6aee628228 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:01.905624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46b31e-739d-4517-b4ba-2e1ae77838af None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:01.939803 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536281c2-6304-4630-902f-6a6aee628228 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:01.944598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3a663-4e09-4b78-a5ef-f75021ed89ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:01.945856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3a663-4e09-4b78-a5ef-f75021ed89ba None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:01.946535 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3a663-4e09-4b78-a5ef-f75021ed89ba None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:01.947174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3a663-4e09-4b78-a5ef-f75021ed89ba None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:01.948301 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3a663-4e09-4b78-a5ef-f75021ed89ba None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:01.948876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3a663-4e09-4b78-a5ef-f75021ed89ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:01.951251 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3a663-4e09-4b78-a5ef-f75021ed89ba None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:01.958346 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 459/933] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 18 16:52:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:01.964111 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3a663-4e09-4b78-a5ef-f75021ed89ba None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:01.980637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:01.984022 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aa24f-24d1-454e-b3fe-dedd7e26c3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:01.985045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aa24f-24d1-454e-b3fe-dedd7e26c3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:01.985797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aa24f-24d1-454e-b3fe-dedd7e26c3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:01.986284 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aa24f-24d1-454e-b3fe-dedd7e26c3a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:01.988132 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67aa24f-24d1-454e-b3fe-dedd7e26c3a5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:01.988794 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67aa24f-24d1-454e-b3fe-dedd7e26c3a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:01.990882 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67aa24f-24d1-454e-b3fe-dedd7e26c3a5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:02.000943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 475/934] 10.222.0.49 () {56 vars in 1115 bytes} [Wed May 18 16:52:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:02.009704 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aa24f-24d1-454e-b3fe-dedd7e26c3a5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:02.053145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:02.078917 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3a663-4e09-4b78-a5ef-f75021ed89ba None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:02.115364 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b47d4-e8ef-45a7-977c-14473f3fe926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:02.116076 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b47d4-e8ef-45a7-977c-14473f3fe926 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:02.116361 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b47d4-e8ef-45a7-977c-14473f3fe926 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:02.116635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b47d4-e8ef-45a7-977c-14473f3fe926 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:02.117404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b47d4-e8ef-45a7-977c-14473f3fe926 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:02.118944 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b47d4-e8ef-45a7-977c-14473f3fe926 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:02.142495 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aa24f-24d1-454e-b3fe-dedd7e26c3a5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:02.150192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 460/935] 10.222.0.49 () {60 vars in 1144 bytes} [Wed May 18 16:52:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 16:52:02.191030 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ace74-99da-4612-a134-92c311412812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:02.192858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ace74-99da-4612-a134-92c311412812 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:02.193392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ace74-99da-4612-a134-92c311412812 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:02.193914 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ace74-99da-4612-a134-92c311412812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:02.208413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ace74-99da-4612-a134-92c311412812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:02.210410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ace74-99da-4612-a134-92c311412812 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:02.231666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-785ace74-99da-4612-a134-92c311412812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:02.231666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:02.231666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:02.231666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:02.231666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:02.231666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:02.231666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:02.231666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:02.231666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:02.231666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:02.231666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:02.231666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:02.231666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:52:02.231666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:52:02.231666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:52:02.232728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:52:02.232728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:02.232728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:02.232728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:02.232728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:02.232728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:02.232728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:02.232728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:02.232728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:02.232728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:02.232728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:02.232728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:02.232728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:02.232728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:02.232728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:02.232728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:02.232728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:02.233693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:52:02.233693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:52:02.233693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:02.233693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:02.236312 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 476/936] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:02.245703 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b47d4-e8ef-45a7-977c-14473f3fe926 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:02.321396 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:02.371787 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b47d4-e8ef-45a7-977c-14473f3fe926 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:02.414628 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ae360-512d-4e03-8392-086aea529e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:02.415381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ae360-512d-4e03-8392-086aea529e11 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:02.415689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ae360-512d-4e03-8392-086aea529e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:02.416600 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ae360-512d-4e03-8392-086aea529e11 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:02.418027 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ae360-512d-4e03-8392-086aea529e11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:02.418027 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ae360-512d-4e03-8392-086aea529e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:02.421695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ae360-512d-4e03-8392-086aea529e11 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:02.431994 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 461/937] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:02.437901 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ace74-99da-4612-a134-92c311412812 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:02.570175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:02.586813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ace74-99da-4612-a134-92c311412812 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:02.628100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4de60-66b6-4e8e-a1c9-9c81777493a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:02.630002 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4de60-66b6-4e8e-a1c9-9c81777493a7 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:02.630468 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4de60-66b6-4e8e-a1c9-9c81777493a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:02.630933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4de60-66b6-4e8e-a1c9-9c81777493a7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:02.647322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4de60-66b6-4e8e-a1c9-9c81777493a7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:02.648865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4de60-66b6-4e8e-a1c9-9c81777493a7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:02.665494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-50c4de60-66b6-4e8e-a1c9-9c81777493a7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 16:52:02.665494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:02.665494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:02.665494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:02.665494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:02.665494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:02.665494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:02.665494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:02.665494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:02.665494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:02.665494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:02.665494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:02.665494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:52:02.665494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:52:02.665494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:52:02.665494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:52:02.666504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:02.666504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:02.666504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:52:02.666504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:52:02.666504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:52:02.666504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:52:02.666504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:02.666504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:02.666504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:02.666504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:02.666504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:02.666504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:02.666504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:02.666504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:02.666504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:02.666504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:02.666504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:02.666504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:02.667462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:02.667462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:02.667462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:52:02.667462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:52:02.667462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:52:02.667462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:52:02.667462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:52:02.667462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:52:02.667462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 16:52:02.667462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:02.667462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 477/938] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 18 16:52:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:02.672600 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ae360-512d-4e03-8392-086aea529e11 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:02.779909 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ae360-512d-4e03-8392-086aea529e11 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:02.810961 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:02.817741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bebf9f-0f66-4381-a4a0-fd8444cc313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:02.818494 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bebf9f-0f66-4381-a4a0-fd8444cc313e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:02.819048 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bebf9f-0f66-4381-a4a0-fd8444cc313e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:02.819390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bebf9f-0f66-4381-a4a0-fd8444cc313e None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:02.820409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bebf9f-0f66-4381-a4a0-fd8444cc313e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:02.820784 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bebf9f-0f66-4381-a4a0-fd8444cc313e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:02.822449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bebf9f-0f66-4381-a4a0-fd8444cc313e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:02.841391 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 462/939] 10.222.0.49 () {56 vars in 1149 bytes} [Wed May 18 16:52:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:02.849771 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4de60-66b6-4e8e-a1c9-9c81777493a7 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:02.968146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4de60-66b6-4e8e-a1c9-9c81777493a7 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:03.005289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646e7aa-a26d-43a7-b4f8-a7fdc32bbc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:03.006124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646e7aa-a26d-43a7-b4f8-a7fdc32bbc80 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:03.006407 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646e7aa-a26d-43a7-b4f8-a7fdc32bbc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:03.006686 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646e7aa-a26d-43a7-b4f8-a7fdc32bbc80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:03.018615 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646e7aa-a26d-43a7-b4f8-a7fdc32bbc80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:03.021392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646e7aa-a26d-43a7-b4f8-a7fdc32bbc80 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:03.030281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:03.041843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-7646e7aa-a26d-43a7-b4f8-a7fdc32bbc80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:03.041843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:03.041843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:03.041843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:03.041843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:03.041843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:03.041843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:03.041843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:03.041843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:03.041843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:03.041843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:03.041843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:03.041843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:52:03.041843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:52:03.041843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:52:03.042995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:52:03.042995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:03.042995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:03.042995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:03.042995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:03.042995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:03.042995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:03.042995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:03.042995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:03.042995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:03.042995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:03.042995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:03.042995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:03.042995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:03.042995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:03.042995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:03.042995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:03.044088 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:52:03.044088 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:52:03.044088 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:03.044088 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:03.046452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 478/940] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:03.051660 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bebf9f-0f66-4381-a4a0-fd8444cc313e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:03.161729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bebf9f-0f66-4381-a4a0-fd8444cc313e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:03.200615 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820ce3b-5a85-430c-b232-bdc417f02fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:03.201290 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820ce3b-5a85-430c-b232-bdc417f02fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:03.201578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820ce3b-5a85-430c-b232-bdc417f02fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:03.201889 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820ce3b-5a85-430c-b232-bdc417f02fd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:03.202631 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820ce3b-5a85-430c-b232-bdc417f02fd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:03.202945 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820ce3b-5a85-430c-b232-bdc417f02fd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:03.204387 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820ce3b-5a85-430c-b232-bdc417f02fd5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:03.218110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 463/941] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:03.223429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646e7aa-a26d-43a7-b4f8-a7fdc32bbc80 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:03.341393 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646e7aa-a26d-43a7-b4f8-a7fdc32bbc80 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:03.377479 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f3d6e-2033-45a8-812a-add353818100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:03.378322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f3d6e-2033-45a8-812a-add353818100 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:03.378609 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f3d6e-2033-45a8-812a-add353818100 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:03.378888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f3d6e-2033-45a8-812a-add353818100 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:03.388583 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f3d6e-2033-45a8-812a-add353818100 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:03.390078 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f3d6e-2033-45a8-812a-add353818100 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:03.407601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-0f6f3d6e-2033-45a8-812a-add353818100 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:52:03.407601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:03.407601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:03.407601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:03.407601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:03.407601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:03.407601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:03.407601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:03.407601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:03.407601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:03.407601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:03.407601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:03.407601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:52:03.407601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:52:03.407601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:52:03.408549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:52:03.408549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:03.408549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:03.408549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:03.408549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:03.408549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:03.408549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:03.408549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:03.408549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:03.408549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:03.408549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:03.408549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:03.408549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:03.408549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:03.408549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:03.408549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:03.408549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:03.409442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:52:03.409442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:52:03.409442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:52:03.409442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:52:03.409442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:52:03.409442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:52:03.409442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:52:03.409442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:03.409442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 479/942] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:52:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:03.415152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820ce3b-5a85-430c-b232-bdc417f02fd5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:03.452060 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b11a9-bddd-45b7-9c01-232406d906c1 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:03.452458 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b11a9-bddd-45b7-9c01-232406d906c1 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:03.452747 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b11a9-bddd-45b7-9c01-232406d906c1 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:03.454658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 480/943] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:52:03.461181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be453f-50fb-4d45-9f28-bfce6d16f24e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:03.461468 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be453f-50fb-4d45-9f28-bfce6d16f24e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:03.461784 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be453f-50fb-4d45-9f28-bfce6d16f24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:03.474280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:03.482506 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c3be453f-50fb-4d45-9f28-bfce6d16f24e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:03.483715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c3be453f-50fb-4d45-9f28-bfce6d16f24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:03.559434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820ce3b-5a85-430c-b232-bdc417f02fd5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:03.627932 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:03.628237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b9966-069a-4f99-b68a-059e9851cacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:03.629087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b9966-069a-4f99-b68a-059e9851cacc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:03.629087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b9966-069a-4f99-b68a-059e9851cacc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:03.630070 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b9966-069a-4f99-b68a-059e9851cacc None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:03.631123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b9966-069a-4f99-b68a-059e9851cacc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:03.632940 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b9966-069a-4f99-b68a-059e9851cacc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:03.636227 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b9966-069a-4f99-b68a-059e9851cacc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:03.653846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 481/944] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:52:03.653846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce05bf9-3a8b-43cb-9118-d7e6301128d6 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:03.653846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce05bf9-3a8b-43cb-9118-d7e6301128d6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:03.653846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce05bf9-3a8b-43cb-9118-d7e6301128d6 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:03.655885 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 482/945] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:03.667680 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 464/946] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:52:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:03.667848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e6fd5-a0de-46f2-afab-4ee2d5bbc795 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:03.667848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e6fd5-a0de-46f2-afab-4ee2d5bbc795 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:03.667848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e6fd5-a0de-46f2-afab-4ee2d5bbc795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:03.669251 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b9966-069a-4f99-b68a-059e9851cacc None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:03.690533 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-552e6fd5-a0de-46f2-afab-4ee2d5bbc795 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:03.692670 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-552e6fd5-a0de-46f2-afab-4ee2d5bbc795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:03.783802 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 483/947] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:03.784682 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e6fd5-a0de-46f2-afab-4ee2d5bbc795 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:03.836029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b9966-069a-4f99-b68a-059e9851cacc None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:03.846016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:03.876734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04f0d8-151e-4259-a0c3-dbec75cba3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:03.877638 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04f0d8-151e-4259-a0c3-dbec75cba3d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:03.877956 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04f0d8-151e-4259-a0c3-dbec75cba3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:03.878241 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04f0d8-151e-4259-a0c3-dbec75cba3d1 None admin] PATH_INFO: `/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/9692d55c8c924544a1bff62054731ed2/roles/dd4f2c1c23cf4468a005cb46a039f660` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:03.882585 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04f0d8-151e-4259-a0c3-dbec75cba3d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcd3afbb3e384cb2939647002c60bbba, user_id=9692d55c8c924544a1bff62054731ed2, role_id=dd4f2c1c23cf4468a005cb46a039f660)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:03.884301 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04f0d8-151e-4259-a0c3-dbec75cba3d1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:03.909936 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 465/948] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:52:03 2022] PUT /identity/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/9692d55c8c924544a1bff62054731ed2/roles/dd4f2c1c23cf4468a005cb46a039f660 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:52:03.909936 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04f0d8-151e-4259-a0c3-dbec75cba3d1 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:03.936988 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e6fd5-a0de-46f2-afab-4ee2d5bbc795 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:03.973393 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:04.003900 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843fb1c-3173-4b04-aedb-d8289b96b8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:04.005587 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843fb1c-3173-4b04-aedb-d8289b96b8ef None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:04.007180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843fb1c-3173-4b04-aedb-d8289b96b8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:04.007735 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843fb1c-3173-4b04-aedb-d8289b96b8ef None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:04.008960 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843fb1c-3173-4b04-aedb-d8289b96b8ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:04.010683 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843fb1c-3173-4b04-aedb-d8289b96b8ef None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:04.012435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: WARNING keystone.server.flask.common [None req-d843fb1c-3173-4b04-aedb-d8289b96b8ef None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 18 16:52:04.039657 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.sql.core [None req-d843fb1c-3173-4b04-aedb-d8289b96b8ef None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 18 16:52:04.039657 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 18 16:52:04.039657 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [parameters: {'id': 'd5906bd94a524475b4252491117f3ad2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 18 16:52:04.039657 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80345) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 18 16:52:04.060466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-d843fb1c-3173-4b04-aedb-d8289b96b8ef None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d5906bd94a524475b4252491117f3ad2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d5906bd94a524475b4252491117f3ad2. May 18 16:52:04.060466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:04.060466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 16:52:04.060466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 16:52:04.060466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 16:52:04.060466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 16:52:04.060466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 16:52:04.060466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application result = self._query(query) May 18 16:52:04.060466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 16:52:04.060466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application conn.query(q) May 18 16:52:04.060466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 16:52:04.060466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 16:52:04.060466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 16:52:04.061348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application result.read() May 18 16:52:04.061348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 16:52:04.061348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 16:52:04.061348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 16:52:04.061348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 16:52:04.061348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 16:52:04.061348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 16:52:04.061348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 16:52:04.061348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 16:52:04.061348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 18 16:52:04.061348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:04.061348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 18 16:52:04.061348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:04.061348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:04.061348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 18 16:52:04.061348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 18 16:52:04.061348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 18 16:52:04.061348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return project_ref.to_dict() May 18 16:52:04.063216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 16:52:04.063216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application next(self.gen) May 18 16:52:04.063216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 18 16:52:04.063216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application yield resource May 18 16:52:04.063216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 16:52:04.063216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application next(self.gen) May 18 16:52:04.063216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 18 16:52:04.063216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self.session.rollback() May 18 16:52:04.063216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 18 16:52:04.063216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self.force_reraise() May 18 16:52:04.063216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 18 16:52:04.063216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise self.value May 18 16:52:04.063216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 18 16:52:04.063216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 18 16:52:04.063216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 18 16:52:04.063216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application session.commit() May 18 16:52:04.063216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 18 16:52:04.064199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 18 16:52:04.064199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 18 16:52:04.064199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._prepare_impl() May 18 16:52:04.064199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 18 16:52:04.064199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self.session.flush() May 18 16:52:04.064199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 18 16:52:04.064199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._flush(objects) May 18 16:52:04.064199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 18 16:52:04.064199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 18 16:52:04.064199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 18 16:52:04.064199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application compat.raise_( May 18 16:52:04.064199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 16:52:04.064199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception May 18 16:52:04.064199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 18 16:52:04.064199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application flush_context.execute() May 18 16:52:04.064199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 18 16:52:04.064199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rec.execute(self) May 18 16:52:04.065112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 18 16:52:04.065112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 18 16:52:04.065112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 18 16:52:04.065112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application _emit_insert_statements( May 18 16:52:04.065112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 18 16:52:04.065112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application c = connection._execute_20( May 18 16:52:04.065112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 18 16:52:04.065112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 18 16:52:04.065112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 18 16:52:04.065112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 18 16:52:04.065112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 18 16:52:04.065112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ret = self._execute_context( May 18 16:52:04.065112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 18 16:52:04.065112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 18 16:52:04.065112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 18 16:52:04.067465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 18 16:52:04.067465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 16:52:04.067465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception May 18 16:52:04.067465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 16:52:04.067465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 16:52:04.067465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 16:52:04.067465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 16:52:04.067465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 16:52:04.067465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application result = self._query(query) May 18 16:52:04.067465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 16:52:04.067465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application conn.query(q) May 18 16:52:04.067465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 16:52:04.067465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 16:52:04.067465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 16:52:04.067465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application result.read() May 18 16:52:04.067465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 16:52:04.067465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 16:52:04.069556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 16:52:04.069556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 16:52:04.069556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 16:52:04.069556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 16:52:04.069556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 16:52:04.069556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 16:52:04.069556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 18 16:52:04.069556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 18 16:52:04.069556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [parameters: {'id': 'd5906bd94a524475b4252491117f3ad2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 18 16:52:04.069556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 18 16:52:04.069556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:04.069556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:52:04.069556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:04.069556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:04.069556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 18 16:52:04.077487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 18 16:52:04.077487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 18 16:52:04.077487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 18 16:52:04.077487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 18 16:52:04.077487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:04.077487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:52:04.077487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:04.077487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:04.077487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:04.077487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:04.077487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:04.077487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:04.077487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:04.077487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:04.077487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:04.077487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:04.077487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:04.080629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:04.080629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 18 16:52:04.080629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 18 16:52:04.080629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:04.080629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:04.080629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 18 16:52:04.080629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.Conflict( May 18 16:52:04.080629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d5906bd94a524475b4252491117f3ad2. May 18 16:52:04.080629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:04.080629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 484/949] 10.222.0.49 () {60 vars in 1140 bytes} [Wed May 18 16:52:03 2022] POST /identity/v3/projects => generated 262 bytes in 286 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:04.080629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843fb1c-3173-4b04-aedb-d8289b96b8ef None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:04.180400 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04f0d8-151e-4259-a0c3-dbec75cba3d1 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:04.229609 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aca4d6-f6f9-483e-9845-89c7e4921db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:04.230503 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aca4d6-f6f9-483e-9845-89c7e4921db8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:04.230824 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aca4d6-f6f9-483e-9845-89c7e4921db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:04.231737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aca4d6-f6f9-483e-9845-89c7e4921db8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:04.232658 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aca4d6-f6f9-483e-9845-89c7e4921db8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:04.234568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aca4d6-f6f9-483e-9845-89c7e4921db8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:04.242431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843fb1c-3173-4b04-aedb-d8289b96b8ef None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:04.251015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-c3aca4d6-f6f9-483e-9845-89c7e4921db8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 16:52:04.251015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:04.251015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:52:04.251015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:52:04.251015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:52:04.251015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:52:04.251015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:52:04.251015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:04.251015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 16:52:04.251015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:04.251015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:52:04.251015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:04.251015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:04.251015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:04.251015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:04.251015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:04.251015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:04.252279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:04.252279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:04.252279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:04.252279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:04.252279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:04.252279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:04.252279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:52:04.252279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:52:04.252279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:52:04.252279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:52:04.252279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:04.252279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:04.252279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:04.252279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:04.252279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:04.252279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:04.253124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:04.253124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:04.253124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:04.253124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:04.253124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:04.253124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:04.253124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:04.253124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:04.253124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:04.253124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:04.253124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:52:04.253124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:04.253124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 16:52:04.253124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:04.255657 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 466/950] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 18 16:52:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:04.263500 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aca4d6-f6f9-483e-9845-89c7e4921db8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:04.296283 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd40fa6-31e3-4ef6-a400-d4f62a6bbfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:04.297435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd40fa6-31e3-4ef6-a400-d4f62a6bbfaa None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:04.297746 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd40fa6-31e3-4ef6-a400-d4f62a6bbfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:04.298073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd40fa6-31e3-4ef6-a400-d4f62a6bbfaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:04.307820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:04.315065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd40fa6-31e3-4ef6-a400-d4f62a6bbfaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:04.326380 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd40fa6-31e3-4ef6-a400-d4f62a6bbfaa None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:04.345324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-4bd40fa6-31e3-4ef6-a400-d4f62a6bbfaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:52:04.345324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:04.345324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:04.345324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:04.345324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:04.345324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:04.345324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:04.345324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:04.345324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:04.345324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:04.345324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:04.345324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:04.345324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:52:04.345324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:52:04.345324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:52:04.346603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:52:04.346603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:04.346603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:04.346603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:04.346603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:04.346603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:04.346603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:04.346603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:04.346603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:04.346603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:04.346603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:04.346603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:04.346603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:04.346603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:04.346603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:04.346603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:04.346603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:04.347764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:52:04.347764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:52:04.347764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:52:04.347764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:52:04.347764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:52:04.347764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:52:04.347764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:52:04.347764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:04.349090 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 485/951] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:52:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:52:04.355109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd40fa6-31e3-4ef6-a400-d4f62a6bbfaa None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:04.396801 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:04.409735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aca4d6-f6f9-483e-9845-89c7e4921db8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:04.459082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf09cfa-7ec8-48f5-9b0f-36480fbf1c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:04.460116 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf09cfa-7ec8-48f5-9b0f-36480fbf1c3c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:04.460608 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf09cfa-7ec8-48f5-9b0f-36480fbf1c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:04.461710 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf09cfa-7ec8-48f5-9b0f-36480fbf1c3c None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:04.462977 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf09cfa-7ec8-48f5-9b0f-36480fbf1c3c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:04.463526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf09cfa-7ec8-48f5-9b0f-36480fbf1c3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:04.466090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf09cfa-7ec8-48f5-9b0f-36480fbf1c3c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:04.474598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 467/952] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 18 16:52:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:04.475232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd40fa6-31e3-4ef6-a400-d4f62a6bbfaa None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:04.479743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf09cfa-7ec8-48f5-9b0f-36480fbf1c3c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:04.525509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89683af5-219c-492a-83e4-8b0654e5b4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:04.527225 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89683af5-219c-492a-83e4-8b0654e5b4cb None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:04.527722 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89683af5-219c-492a-83e4-8b0654e5b4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:04.528228 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89683af5-219c-492a-83e4-8b0654e5b4cb None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:04.529722 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89683af5-219c-492a-83e4-8b0654e5b4cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:04.530650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89683af5-219c-492a-83e4-8b0654e5b4cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:04.532910 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89683af5-219c-492a-83e4-8b0654e5b4cb None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:04.564537 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 486/953] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 18 16:52:04 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:04.599516 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:04.607671 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf09cfa-7ec8-48f5-9b0f-36480fbf1c3c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:04.655875 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d03aa-794a-4cfa-b086-751113add19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:04.657265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d03aa-794a-4cfa-b086-751113add19f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:04.657816 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d03aa-794a-4cfa-b086-751113add19f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:04.658309 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d03aa-794a-4cfa-b086-751113add19f None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:04.659286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d03aa-794a-4cfa-b086-751113add19f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:04.659822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d03aa-794a-4cfa-b086-751113add19f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:04.662275 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d03aa-794a-4cfa-b086-751113add19f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:04.669157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 468/954] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 18 16:52:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:04.674883 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89683af5-219c-492a-83e4-8b0654e5b4cb None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:04.758981 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7813eaa-eb9f-46d3-97ab-05a9e49807f4 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:04.759181 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7813eaa-eb9f-46d3-97ab-05a9e49807f4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:04.759442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7813eaa-eb9f-46d3-97ab-05a9e49807f4 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:04.761105 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 469/955] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:52:04.767041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c6367-e179-4333-89ca-1a8f9000736f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:04.767343 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c6367-e179-4333-89ca-1a8f9000736f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:04.767589 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c6367-e179-4333-89ca-1a8f9000736f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:04.788744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-802c6367-e179-4333-89ca-1a8f9000736f None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:04.790126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-802c6367-e179-4333-89ca-1a8f9000736f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:04.805116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:04.813292 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89683af5-219c-492a-83e4-8b0654e5b4cb None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:04.858626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13366ee8-9108-4c8e-bb45-7d46d37fbae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:04.859318 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13366ee8-9108-4c8e-bb45-7d46d37fbae6 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:04.859687 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13366ee8-9108-4c8e-bb45-7d46d37fbae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:04.859963 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13366ee8-9108-4c8e-bb45-7d46d37fbae6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:04.860722 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13366ee8-9108-4c8e-bb45-7d46d37fbae6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:04.862148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13366ee8-9108-4c8e-bb45-7d46d37fbae6 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:04.888253 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 487/956] 10.222.0.49 () {60 vars in 1144 bytes} [Wed May 18 16:52:04 2022] POST /identity/v3/endpoints => generated 349 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:52:04.896964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 470/957] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:04.919524 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13366ee8-9108-4c8e-bb45-7d46d37fbae6 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:05.040271 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13366ee8-9108-4c8e-bb45-7d46d37fbae6 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:05.091320 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31600a-a32c-405b-beac-5cc0dabbfb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:05.092131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31600a-a32c-405b-beac-5cc0dabbfb7a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:05.092412 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31600a-a32c-405b-beac-5cc0dabbfb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:05.092687 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31600a-a32c-405b-beac-5cc0dabbfb7a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:05.093344 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31600a-a32c-405b-beac-5cc0dabbfb7a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:05.094810 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31600a-a32c-405b-beac-5cc0dabbfb7a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:05.107169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-8f31600a-a32c-405b-beac-5cc0dabbfb7a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 18 16:52:05.107169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:05.107169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:52:05.107169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:52:05.107169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:52:05.107169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:52:05.107169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:52:05.107169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:05.107169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 16:52:05.107169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:05.107169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:52:05.107169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:05.107169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:05.107169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:05.107169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:05.107169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:05.107169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:05.108421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:05.108421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:05.108421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:05.108421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:05.108421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:05.108421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:05.108421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:52:05.108421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:52:05.108421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:52:05.108421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:52:05.108421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:05.108421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:05.108421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:05.108421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:05.108421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:05.108421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:05.109265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:05.109265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:05.109265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:05.109265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:05.109265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:05.109265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:05.109265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:05.109265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:05.109265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:05.109265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:05.109265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:52:05.109265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:05.109265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 16:52:05.109265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:05.109265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 488/958] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:52:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:05.115676 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c6367-e179-4333-89ca-1a8f9000736f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:05.210173 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:05.226868 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c6367-e179-4333-89ca-1a8f9000736f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:05.267605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2812ab-4669-40f0-8b23-f1bc4839ce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:05.268279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2812ab-4669-40f0-8b23-f1bc4839ce89 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:05.268565 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2812ab-4669-40f0-8b23-f1bc4839ce89 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:05.268841 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2812ab-4669-40f0-8b23-f1bc4839ce89 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:05.269558 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2812ab-4669-40f0-8b23-f1bc4839ce89 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:05.270386 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2812ab-4669-40f0-8b23-f1bc4839ce89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:05.272110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2812ab-4669-40f0-8b23-f1bc4839ce89 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:05.277723 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 471/959] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 18 16:52:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:05.283389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31600a-a32c-405b-beac-5cc0dabbfb7a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:05.306221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:05.400610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31600a-a32c-405b-beac-5cc0dabbfb7a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:05.435692 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbe5da-b58e-4a94-9b7b-bb7a10f87038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:05.436368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbe5da-b58e-4a94-9b7b-bb7a10f87038 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:05.436654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbe5da-b58e-4a94-9b7b-bb7a10f87038 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:05.436936 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbe5da-b58e-4a94-9b7b-bb7a10f87038 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:05.437669 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbe5da-b58e-4a94-9b7b-bb7a10f87038 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:05.437979 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbe5da-b58e-4a94-9b7b-bb7a10f87038 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:05.439360 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbe5da-b58e-4a94-9b7b-bb7a10f87038 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:05.445050 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 489/960] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 18 16:52:05 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:06.384668 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4dd2c-3695-417d-8191-e624c1278e54 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:06.385164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4dd2c-3695-417d-8191-e624c1278e54 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:06.385244 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4dd2c-3695-417d-8191-e624c1278e54 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:06.386883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 472/961] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:06.392233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a937ae-e123-4011-905b-6b09c43aaa85 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:06.392636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a937ae-e123-4011-905b-6b09c43aaa85 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:06.392852 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a937ae-e123-4011-905b-6b09c43aaa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:06.412342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-77a937ae-e123-4011-905b-6b09c43aaa85 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:06.413910 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-77a937ae-e123-4011-905b-6b09c43aaa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:06.487440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 490/962] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:06.510928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4dd2c-3695-417d-8191-e624c1278e54 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:06.622838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4dd2c-3695-417d-8191-e624c1278e54 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:06.663064 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264393b-8bb3-41bd-bff2-18b8c374c7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:06.663772 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264393b-8bb3-41bd-bff2-18b8c374c7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:06.664057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264393b-8bb3-41bd-bff2-18b8c374c7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:06.664339 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264393b-8bb3-41bd-bff2-18b8c374c7d7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:06.675540 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264393b-8bb3-41bd-bff2-18b8c374c7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:52:06.684302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-3264393b-8bb3-41bd-bff2-18b8c374c7d7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 16:52:06.684302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:06.684302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:06.684302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:06.684302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:06.684302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:06.684302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:06.684302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:06.684302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:06.684302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:06.684302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:06.684302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:06.684302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:52:06.684302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:52:06.684302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:52:06.684302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:52:06.685270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:52:06.685270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:52:06.685270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:52:06.685270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:52:06.685270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:06.685270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:06.685270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:06.685270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:06.685270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:06.685270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:06.685270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:06.685270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:06.685270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:06.685270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:06.685270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:06.685270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:06.686870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:06.686870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:06.686870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:06.686870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:06.686870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:52:06.686870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:52:06.686870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:52:06.686870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:52:06.686870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:52:06.686870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:52:06.686870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 16:52:06.686870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:06.686870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 473/963] 10.222.0.49 () {56 vars in 1120 bytes} [Wed May 18 16:52:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:06.695060 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a937ae-e123-4011-905b-6b09c43aaa85 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:06.708860 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:06.810498 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a937ae-e123-4011-905b-6b09c43aaa85 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:06.848747 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f0a07-40e9-45da-94de-706d7a995e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:06.849385 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f0a07-40e9-45da-94de-706d7a995e4c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:06.849690 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f0a07-40e9-45da-94de-706d7a995e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:06.849966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f0a07-40e9-45da-94de-706d7a995e4c None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:06.850723 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f0a07-40e9-45da-94de-706d7a995e4c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:06.851032 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f0a07-40e9-45da-94de-706d7a995e4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:06.852421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f0a07-40e9-45da-94de-706d7a995e4c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:06.861794 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 491/964] 10.222.0.49 () {56 vars in 1115 bytes} [Wed May 18 16:52:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:06.867348 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264393b-8bb3-41bd-bff2-18b8c374c7d7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:06.882037 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:06.979361 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264393b-8bb3-41bd-bff2-18b8c374c7d7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:07.020868 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f302e-4fe5-42ae-a7d7-c09a0260d7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:07.022078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f302e-4fe5-42ae-a7d7-c09a0260d7cd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:07.022580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f302e-4fe5-42ae-a7d7-c09a0260d7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:07.023068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f302e-4fe5-42ae-a7d7-c09a0260d7cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:07.036282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f302e-4fe5-42ae-a7d7-c09a0260d7cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:07.038304 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f302e-4fe5-42ae-a7d7-c09a0260d7cd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:07.056482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-0b6f302e-4fe5-42ae-a7d7-c09a0260d7cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:07.056482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:07.056482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:07.056482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:07.056482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:07.056482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:07.056482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:07.056482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:07.056482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:07.056482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:07.056482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:07.056482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:07.056482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:52:07.056482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:52:07.056482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:52:07.057440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:52:07.057440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:07.057440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:07.057440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:07.057440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:07.057440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:07.057440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:07.057440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:07.057440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:07.057440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:07.057440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:07.057440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:07.057440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:07.057440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:07.057440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:07.057440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:07.057440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:07.058380 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:52:07.058380 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:52:07.058380 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:07.058380 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:07.060618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 474/965] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:07.066423 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f0a07-40e9-45da-94de-706d7a995e4c None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:07.143156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:07.175172 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f0a07-40e9-45da-94de-706d7a995e4c None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:07.209205 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef69b8-d4f7-4f3c-b4df-7709b0bab548 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:07.209925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef69b8-d4f7-4f3c-b4df-7709b0bab548 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:07.210438 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef69b8-d4f7-4f3c-b4df-7709b0bab548 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:07.212568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 475/966] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:52:07.216008 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159384c6-5ca0-40e6-9824-8b571def40cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:07.216710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159384c6-5ca0-40e6-9824-8b571def40cd None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:07.216994 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159384c6-5ca0-40e6-9824-8b571def40cd None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:07.217272 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159384c6-5ca0-40e6-9824-8b571def40cd None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:07.218373 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159384c6-5ca0-40e6-9824-8b571def40cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:07.218684 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159384c6-5ca0-40e6-9824-8b571def40cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:07.220155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6fec1-078d-4889-ac2a-88dd023193d9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:07.220295 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159384c6-5ca0-40e6-9824-8b571def40cd None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:07.220801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6fec1-078d-4889-ac2a-88dd023193d9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:07.221271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6fec1-078d-4889-ac2a-88dd023193d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:07.237793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 492/967] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:07.243031 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159384c6-5ca0-40e6-9824-8b571def40cd None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:07.243570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-eae6fec1-078d-4889-ac2a-88dd023193d9 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:07.245009 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-eae6fec1-078d-4889-ac2a-88dd023193d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:07.332052 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:07.355965 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 476/968] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:07.370592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159384c6-5ca0-40e6-9824-8b571def40cd None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:07.375427 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6fec1-078d-4889-ac2a-88dd023193d9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:07.408335 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:07.416639 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb04d3-f961-4776-a9f8-1eb21b8c1ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:07.417883 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb04d3-f961-4776-a9f8-1eb21b8c1ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:07.418328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb04d3-f961-4776-a9f8-1eb21b8c1ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:07.418745 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb04d3-f961-4776-a9f8-1eb21b8c1ad2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:07.427185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb04d3-f961-4776-a9f8-1eb21b8c1ad2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:07.428712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb04d3-f961-4776-a9f8-1eb21b8c1ad2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:07.446781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-06fb04d3-f961-4776-a9f8-1eb21b8c1ad2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 16:52:07.446781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:07.446781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:07.446781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:07.446781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:07.446781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:07.446781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:07.446781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:07.446781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:07.446781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:07.446781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:07.446781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:07.446781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:52:07.446781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:52:07.446781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:52:07.446781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:52:07.448057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:07.448057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:07.448057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:52:07.448057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:52:07.448057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:52:07.448057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:52:07.448057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:07.448057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:07.448057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:07.448057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:07.448057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:07.448057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:07.448057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:07.448057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:07.448057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:07.448057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:07.448057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:07.448057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:07.449230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:07.449230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:07.449230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:52:07.449230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:52:07.449230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:52:07.449230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:52:07.449230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:52:07.449230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:52:07.449230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 18 16:52:07.449230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:07.453247 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 493/969] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 18 16:52:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:07.454634 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770098f-34c6-45ab-81d0-d3cf0894d2dd None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:07.454915 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770098f-34c6-45ab-81d0-d3cf0894d2dd None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:07.455185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770098f-34c6-45ab-81d0-d3cf0894d2dd None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:07.461569 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 494/970] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:07.461569 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770098f-34c6-45ab-81d0-d3cf0894d2dd None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:07.498671 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6fec1-078d-4889-ac2a-88dd023193d9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:07.535893 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35822b27-6dbc-4a94-8552-e835b44e1256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:07.536680 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35822b27-6dbc-4a94-8552-e835b44e1256 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:07.536968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35822b27-6dbc-4a94-8552-e835b44e1256 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:07.537248 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35822b27-6dbc-4a94-8552-e835b44e1256 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:07.538124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35822b27-6dbc-4a94-8552-e835b44e1256 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:07.539704 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35822b27-6dbc-4a94-8552-e835b44e1256 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:07.541027 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: WARNING keystone.server.flask.common [None req-35822b27-6dbc-4a94-8552-e835b44e1256 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 18 16:52:07.555110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.sql.core [None req-35822b27-6dbc-4a94-8552-e835b44e1256 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 18 16:52:07.555110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 18 16:52:07.555110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [parameters: {'user_id': '5a206255440047c9a7a4dacfa14209af', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 18 16:52:07.555110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80344) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 18 16:52:07.563630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-35822b27-6dbc-4a94-8552-e835b44e1256 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 18 16:52:07.563630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:07.563630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 16:52:07.563630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 16:52:07.563630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 16:52:07.563630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 16:52:07.563630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 16:52:07.563630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application result = self._query(query) May 18 16:52:07.563630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 16:52:07.563630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application conn.query(q) May 18 16:52:07.563630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 16:52:07.563630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 16:52:07.563630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 16:52:07.563630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application result.read() May 18 16:52:07.563630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 16:52:07.564517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 16:52:07.564517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 16:52:07.564517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 16:52:07.564517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 16:52:07.564517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 16:52:07.564517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 16:52:07.564517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 16:52:07.564517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 18 16:52:07.564517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:07.564517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 18 16:52:07.564517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:07.564517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:07.564517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 18 16:52:07.564517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 18 16:52:07.564517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 18 16:52:07.564517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 18 16:52:07.564517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 16:52:07.564517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application next(self.gen) May 18 16:52:07.565524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 18 16:52:07.565524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application yield resource May 18 16:52:07.565524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 18 16:52:07.565524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application next(self.gen) May 18 16:52:07.565524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 18 16:52:07.565524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.session.rollback() May 18 16:52:07.565524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 18 16:52:07.565524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.force_reraise() May 18 16:52:07.565524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 18 16:52:07.565524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise self.value May 18 16:52:07.565524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 18 16:52:07.565524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 18 16:52:07.565524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 18 16:52:07.565524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application session.commit() May 18 16:52:07.565524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 18 16:52:07.565524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 18 16:52:07.565524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 18 16:52:07.566478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._prepare_impl() May 18 16:52:07.566478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 18 16:52:07.566478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.session.flush() May 18 16:52:07.566478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 18 16:52:07.566478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._flush(objects) May 18 16:52:07.566478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 18 16:52:07.566478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 18 16:52:07.566478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 18 16:52:07.566478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application compat.raise_( May 18 16:52:07.566478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 16:52:07.566478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception May 18 16:52:07.566478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 18 16:52:07.566478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application flush_context.execute() May 18 16:52:07.566478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 18 16:52:07.566478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rec.execute(self) May 18 16:52:07.566478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 18 16:52:07.566478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 18 16:52:07.567995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 18 16:52:07.567995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application _emit_insert_statements( May 18 16:52:07.567995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 18 16:52:07.567995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application result = connection._execute_20( May 18 16:52:07.567995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 18 16:52:07.567995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 18 16:52:07.567995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 18 16:52:07.567995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 18 16:52:07.567995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 18 16:52:07.567995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ret = self._execute_context( May 18 16:52:07.567995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 18 16:52:07.567995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 18 16:52:07.567995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 18 16:52:07.567995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 18 16:52:07.567995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 18 16:52:07.567995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception May 18 16:52:07.568865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 18 16:52:07.568865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self.dialect.do_execute( May 18 16:52:07.568865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 18 16:52:07.568865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 18 16:52:07.568865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 18 16:52:07.568865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application result = self._query(query) May 18 16:52:07.568865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 18 16:52:07.568865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application conn.query(q) May 18 16:52:07.568865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 18 16:52:07.568865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 18 16:52:07.568865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 18 16:52:07.568865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application result.read() May 18 16:52:07.568865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 18 16:52:07.568865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 18 16:52:07.568865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 18 16:52:07.568865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application packet.raise_for_error() May 18 16:52:07.571931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 18 16:52:07.571931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 18 16:52:07.571931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 18 16:52:07.571931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 18 16:52:07.571931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 18 16:52:07.571931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 18 16:52:07.571931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [parameters: {'user_id': '5a206255440047c9a7a4dacfa14209af', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 18 16:52:07.571931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 18 16:52:07.571931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:07.571931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:52:07.571931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:07.571931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:07.571931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:07.571931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:07.571931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:07.573028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:07.573028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:07.573028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:07.573028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:07.573028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:07.573028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:07.573028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:07.573028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 18 16:52:07.573028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 18 16:52:07.573028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:07.573028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:07.573028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:52:07.573028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:52:07.573028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:52:07.573028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:52:07.573028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 18 16:52:07.573028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 18 16:52:07.574185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 18 16:52:07.574185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 18 16:52:07.574185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 18 16:52:07.574185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 18 16:52:07.574185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 18 16:52:07.574185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:07.574185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 477/971] 10.222.0.49 () {60 vars in 1131 bytes} [Wed May 18 16:52:07 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 18 16:52:07.574185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e160ad2-08cd-41f4-bef6-57ce755b23b5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:07.574185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e160ad2-08cd-41f4-bef6-57ce755b23b5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:07.574185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e160ad2-08cd-41f4-bef6-57ce755b23b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:07.581954 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770098f-34c6-45ab-81d0-d3cf0894d2dd None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:07.588561 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6e160ad2-08cd-41f4-bef6-57ce755b23b5 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:07.590206 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6e160ad2-08cd-41f4-bef6-57ce755b23b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:07.621410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba7eeb-fef5-4011-86c6-ad33dedfcf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:07.622113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba7eeb-fef5-4011-86c6-ad33dedfcf7b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:07.622392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba7eeb-fef5-4011-86c6-ad33dedfcf7b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:07.622662 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba7eeb-fef5-4011-86c6-ad33dedfcf7b None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:07.623592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba7eeb-fef5-4011-86c6-ad33dedfcf7b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:07.623806 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba7eeb-fef5-4011-86c6-ad33dedfcf7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:07.625235 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba7eeb-fef5-4011-86c6-ad33dedfcf7b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:07.645559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 495/972] 10.222.0.49 () {56 vars in 1149 bytes} [Wed May 18 16:52:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:07.646299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba7eeb-fef5-4011-86c6-ad33dedfcf7b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:07.663732 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:07.688222 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 478/973] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:07.689317 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e160ad2-08cd-41f4-bef6-57ce755b23b5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:07.717745 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:07.778084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba7eeb-fef5-4011-86c6-ad33dedfcf7b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:07.819955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8196152-00fc-4ccb-ba8c-268d4f39f25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:07.820766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8196152-00fc-4ccb-ba8c-268d4f39f25d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:07.821062 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e160ad2-08cd-41f4-bef6-57ce755b23b5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:07.821179 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8196152-00fc-4ccb-ba8c-268d4f39f25d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:07.821457 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8196152-00fc-4ccb-ba8c-268d4f39f25d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:07.829082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8196152-00fc-4ccb-ba8c-268d4f39f25d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:07.830832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8196152-00fc-4ccb-ba8c-268d4f39f25d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:07.847399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-c8196152-00fc-4ccb-ba8c-268d4f39f25d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 18 16:52:07.847399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:07.847399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:07.847399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:07.847399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:07.847399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:07.847399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:07.847399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:07.847399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:07.847399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:07.847399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:07.847399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:07.847399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:52:07.847399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:52:07.847399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:52:07.847399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:52:07.848724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:07.848724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:07.848724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:52:07.848724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:52:07.848724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:52:07.848724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:52:07.848724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:07.848724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:07.848724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:07.848724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:07.848724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:07.848724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:07.848724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:07.848724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:07.848724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:07.848724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:07.848724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:07.848724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:07.850184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:07.850184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:07.850184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:52:07.850184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:52:07.850184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:52:07.850184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:52:07.850184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:52:07.850184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:52:07.850184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 18 16:52:07.850184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:07.850184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 496/974] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:52:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:07.850929 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8196152-00fc-4ccb-ba8c-268d4f39f25d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:07.869621 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb9dc6-7c7b-46b3-af67-7e01a41b62f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:07.870460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb9dc6-7c7b-46b3-af67-7e01a41b62f5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:07.870742 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb9dc6-7c7b-46b3-af67-7e01a41b62f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:07.871137 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb9dc6-7c7b-46b3-af67-7e01a41b62f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:07.932765 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:07.953046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb9dc6-7c7b-46b3-af67-7e01a41b62f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:07.954889 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb9dc6-7c7b-46b3-af67-7e01a41b62f5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:07.973110 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8196152-00fc-4ccb-ba8c-268d4f39f25d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:07.986201 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:08.015565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152656e-0bc5-4abd-aabd-db85a5114687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:08.016381 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152656e-0bc5-4abd-aabd-db85a5114687 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:08.016710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152656e-0bc5-4abd-aabd-db85a5114687 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:08.017091 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152656e-0bc5-4abd-aabd-db85a5114687 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:08.018075 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152656e-0bc5-4abd-aabd-db85a5114687 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:08.020417 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152656e-0bc5-4abd-aabd-db85a5114687 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:08.033301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-0152656e-0bc5-4abd-aabd-db85a5114687 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 16:52:08.033301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:08.033301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:52:08.033301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:52:08.033301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:52:08.033301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:52:08.033301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:52:08.033301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:08.033301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 16:52:08.033301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:08.033301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:52:08.033301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:08.033301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:08.033301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:08.033301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:08.033301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:08.033301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:08.034363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:08.034363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:08.034363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:08.034363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:08.034363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:08.034363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:08.034363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:52:08.034363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:52:08.034363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:52:08.034363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:52:08.034363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:08.034363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:08.034363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:08.034363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:08.034363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:08.034363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:08.035415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:08.035415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:08.035415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:08.035415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:08.035415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:08.035415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:08.035415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:08.035415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:08.035415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:08.035415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:08.035415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:52:08.035415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:08.035415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 16:52:08.035415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:08.035415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 497/975] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 18 16:52:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:08.036616 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152656e-0bc5-4abd-aabd-db85a5114687 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:08.086811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 479/976] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:52:07 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 16:52:08.086811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f919b-4fe3-48c2-8e43-746255177c6b None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:08.086811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f919b-4fe3-48c2-8e43-746255177c6b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:08.086811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f919b-4fe3-48c2-8e43-746255177c6b None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:08.090078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 480/977] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:08.090826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f919b-4fe3-48c2-8e43-746255177c6b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:08.148722 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152656e-0bc5-4abd-aabd-db85a5114687 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:08.193173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960763ea-f4ad-465c-b060-2b861b38f846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:08.194252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960763ea-f4ad-465c-b060-2b861b38f846 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:08.194618 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960763ea-f4ad-465c-b060-2b861b38f846 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:08.194913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960763ea-f4ad-465c-b060-2b861b38f846 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:08.195767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960763ea-f4ad-465c-b060-2b861b38f846 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:08.196195 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960763ea-f4ad-465c-b060-2b861b38f846 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:08.196435 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:08.197721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960763ea-f4ad-465c-b060-2b861b38f846 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:08.216547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f919b-4fe3-48c2-8e43-746255177c6b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:08.236950 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 498/978] 10.222.0.49 () {56 vars in 1101 bytes} [Wed May 18 16:52:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:08.238102 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960763ea-f4ad-465c-b060-2b861b38f846 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:08.260331 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879bd3f-40b9-44f3-9e73-3cd924d9ab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:08.261225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879bd3f-40b9-44f3-9e73-3cd924d9ab04 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:08.261528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879bd3f-40b9-44f3-9e73-3cd924d9ab04 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:08.261844 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879bd3f-40b9-44f3-9e73-3cd924d9ab04 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:08.262616 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879bd3f-40b9-44f3-9e73-3cd924d9ab04 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:08.262919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879bd3f-40b9-44f3-9e73-3cd924d9ab04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:08.264337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879bd3f-40b9-44f3-9e73-3cd924d9ab04 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:08.273613 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 481/979] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 18 16:52:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:08.274954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c9d1a-1265-472d-b127-bdf20a475460 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:08.275242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c9d1a-1265-472d-b127-bdf20a475460 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:08.275521 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c9d1a-1265-472d-b127-bdf20a475460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:08.291565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:08.295899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5f5c9d1a-1265-472d-b127-bdf20a475460 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:08.297181 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5f5c9d1a-1265-472d-b127-bdf20a475460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:08.385766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960763ea-f4ad-465c-b060-2b861b38f846 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:08.405285 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 482/980] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:08.406494 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c9d1a-1265-472d-b127-bdf20a475460 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:08.440476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b50a17-b2c2-4888-b583-2dd543c99c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:08.442672 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b50a17-b2c2-4888-b583-2dd543c99c80 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:08.443157 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b50a17-b2c2-4888-b583-2dd543c99c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:08.443618 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b50a17-b2c2-4888-b583-2dd543c99c80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:08.457237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b50a17-b2c2-4888-b583-2dd543c99c80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:08.459499 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b50a17-b2c2-4888-b583-2dd543c99c80 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:08.480249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-23b50a17-b2c2-4888-b583-2dd543c99c80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:08.480249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:08.480249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:08.480249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:08.480249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:08.480249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:08.480249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:08.480249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:08.480249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:08.480249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:08.480249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:08.480249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:08.480249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:52:08.480249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:52:08.480249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:52:08.481223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:52:08.481223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:08.481223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:08.481223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:08.481223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:08.481223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:08.481223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:08.481223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:08.481223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:08.481223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:08.481223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:08.481223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:08.481223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:08.481223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:08.481223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:08.481223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:08.481223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:08.482177 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:52:08.482177 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:52:08.482177 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:08.482177 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:08.483821 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 499/981] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:08.484851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b50a17-b2c2-4888-b583-2dd543c99c80 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:08.514582 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:08.545368 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c9d1a-1265-472d-b127-bdf20a475460 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:08.587091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e0ce1-4480-4d84-8812-9c1b99d09042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:08.587618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e0ce1-4480-4d84-8812-9c1b99d09042 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:08.587903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e0ce1-4480-4d84-8812-9c1b99d09042 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:08.588182 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e0ce1-4480-4d84-8812-9c1b99d09042 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:08.588901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e0ce1-4480-4d84-8812-9c1b99d09042 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:08.589211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e0ce1-4480-4d84-8812-9c1b99d09042 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:08.590630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e0ce1-4480-4d84-8812-9c1b99d09042 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:08.595583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 483/982] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 18 16:52:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:08.596362 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e0ce1-4480-4d84-8812-9c1b99d09042 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:08.601637 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:08.617838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b50a17-b2c2-4888-b583-2dd543c99c80 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:08.653433 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803160d3-31cf-41ea-b15e-aa1e355e8b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:08.654137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803160d3-31cf-41ea-b15e-aa1e355e8b93 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:08.654420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803160d3-31cf-41ea-b15e-aa1e355e8b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:08.654699 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803160d3-31cf-41ea-b15e-aa1e355e8b93 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:08.655427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803160d3-31cf-41ea-b15e-aa1e355e8b93 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:08.656805 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803160d3-31cf-41ea-b15e-aa1e355e8b93 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:08.670747 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 500/983] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 18 16:52:08 2022] POST /identity/v3/services => generated 242 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:52:08.672174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803160d3-31cf-41ea-b15e-aa1e355e8b93 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:08.711130 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e0ce1-4480-4d84-8812-9c1b99d09042 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:08.759777 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec216d-9ca8-465d-9af4-5b1ea0753bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:08.760454 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec216d-9ca8-465d-9af4-5b1ea0753bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:08.760744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec216d-9ca8-465d-9af4-5b1ea0753bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:08.761023 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec216d-9ca8-465d-9af4-5b1ea0753bd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:08.761802 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec216d-9ca8-465d-9af4-5b1ea0753bd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:08.762107 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec216d-9ca8-465d-9af4-5b1ea0753bd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:08.763532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec216d-9ca8-465d-9af4-5b1ea0753bd4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:08.772371 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:08.781441 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 484/984] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:08.787697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec216d-9ca8-465d-9af4-5b1ea0753bd4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:08.810612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803160d3-31cf-41ea-b15e-aa1e355e8b93 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:08.850856 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a5525-7cc7-4cdf-aa96-ce2f9f24d343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:08.851609 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a5525-7cc7-4cdf-aa96-ce2f9f24d343 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:08.851898 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a5525-7cc7-4cdf-aa96-ce2f9f24d343 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:08.852203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a5525-7cc7-4cdf-aa96-ce2f9f24d343 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:08.853049 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a5525-7cc7-4cdf-aa96-ce2f9f24d343 None admin] RBAC: Adding query filter params (interface=admin, service_id=46989271c2064ab8bdff9c3c7163dbf5, region_id=RegionOne) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:08.853364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a5525-7cc7-4cdf-aa96-ce2f9f24d343 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:08.854818 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a5525-7cc7-4cdf-aa96-ce2f9f24d343 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:08.862221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 501/985] 10.222.0.49 () {56 vars in 1249 bytes} [Wed May 18 16:52:08 2022] GET /identity/v3/endpoints?service_id=46989271c2064ab8bdff9c3c7163dbf5&interface=admin®ion_id=RegionOne => generated 193 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:08.869287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a5525-7cc7-4cdf-aa96-ce2f9f24d343 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:08.884228 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:08.911476 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec216d-9ca8-465d-9af4-5b1ea0753bd4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:08.947673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b49ec-9048-48be-b1b0-9632e95da5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:08.948469 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b49ec-9048-48be-b1b0-9632e95da5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:08.948758 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b49ec-9048-48be-b1b0-9632e95da5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:08.949033 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b49ec-9048-48be-b1b0-9632e95da5c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:08.956497 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b49ec-9048-48be-b1b0-9632e95da5c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:08.959084 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b49ec-9048-48be-b1b0-9632e95da5c3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:08.974020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-159b49ec-9048-48be-b1b0-9632e95da5c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:52:08.974020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:08.974020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:08.974020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:08.974020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:08.974020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:08.974020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:08.974020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:08.974020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:08.974020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:08.974020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:08.974020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:08.974020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:52:08.974020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:52:08.974020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:52:08.975252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:52:08.975252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:08.975252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:08.975252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:08.975252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:08.975252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:08.975252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:08.975252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:08.975252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:08.975252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:08.975252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:08.975252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:08.975252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:08.975252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:08.975252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:08.975252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:08.975252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:08.976624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:52:08.976624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:52:08.976624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:52:08.976624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:52:08.976624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:52:08.976624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:52:08.976624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:52:08.976624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:08.979865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 485/986] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:52:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:08.980696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b49ec-9048-48be-b1b0-9632e95da5c3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:08.986736 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a5525-7cc7-4cdf-aa96-ce2f9f24d343 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:09.024714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd19db-ae25-4dd0-b9a6-6e78c869f949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:09.025481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd19db-ae25-4dd0-b9a6-6e78c869f949 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:09.025852 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd19db-ae25-4dd0-b9a6-6e78c869f949 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:09.026204 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd19db-ae25-4dd0-b9a6-6e78c869f949 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:09.027027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd19db-ae25-4dd0-b9a6-6e78c869f949 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:09.028532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd19db-ae25-4dd0-b9a6-6e78c869f949 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:09.045688 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 502/987] 10.222.0.49 () {56 vars in 1087 bytes} [Wed May 18 16:52:08 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 16:52:09.050549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:09.114709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b49ec-9048-48be-b1b0-9632e95da5c3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:09.154443 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d96fb-4222-4ffc-b2d4-dbb727d4c08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:09.155122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d96fb-4222-4ffc-b2d4-dbb727d4c08f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:09.155531 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d96fb-4222-4ffc-b2d4-dbb727d4c08f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:09.155708 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d96fb-4222-4ffc-b2d4-dbb727d4c08f None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:09.156482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d96fb-4222-4ffc-b2d4-dbb727d4c08f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:09.156793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d96fb-4222-4ffc-b2d4-dbb727d4c08f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:09.158296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d96fb-4222-4ffc-b2d4-dbb727d4c08f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:09.173378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 486/988] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:52:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:09.179647 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd19db-ae25-4dd0-b9a6-6e78c869f949 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:09.264615 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:09.303298 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd19db-ae25-4dd0-b9a6-6e78c869f949 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:09.346062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971e59d-4087-4354-920f-47a2a893d825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:09.346648 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971e59d-4087-4354-920f-47a2a893d825 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:09.346934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971e59d-4087-4354-920f-47a2a893d825 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:09.347220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971e59d-4087-4354-920f-47a2a893d825 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:09.348475 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971e59d-4087-4354-920f-47a2a893d825 None admin] RBAC: Adding query filter params (role.id=dd4f2c1c23cf4468a005cb46a039f660, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=9692d55c8c924544a1bff62054731ed2) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:09.348790 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971e59d-4087-4354-920f-47a2a893d825 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:09.350290 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971e59d-4087-4354-920f-47a2a893d825 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:09.358317 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 503/989] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:52:09 2022] GET /identity/v3/role_assignments?user.id=9692d55c8c924544a1bff62054731ed2&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=dd4f2c1c23cf4468a005cb46a039f660 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:11.082278 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e97ca-0eb9-42eb-bb15-cb0c1f25776e None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:11.082734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e97ca-0eb9-42eb-bb15-cb0c1f25776e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:11.083007 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e97ca-0eb9-42eb-bb15-cb0c1f25776e None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:11.084568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 487/990] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:11.089679 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d2200-15a8-4bdd-83eb-f46774fd3ba4 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:11.090080 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d2200-15a8-4bdd-83eb-f46774fd3ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:11.090247 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d2200-15a8-4bdd-83eb-f46774fd3ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:11.108051 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ec8d2200-15a8-4bdd-83eb-f46774fd3ba4 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:11.109246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ec8d2200-15a8-4bdd-83eb-f46774fd3ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:11.185502 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 504/991] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:11.209020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e97ca-0eb9-42eb-bb15-cb0c1f25776e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:11.314130 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e97ca-0eb9-42eb-bb15-cb0c1f25776e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:11.331337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:11.349854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4360b-53e7-4a57-8e13-876ae158b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:11.350644 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4360b-53e7-4a57-8e13-876ae158b549 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:11.350921 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4360b-53e7-4a57-8e13-876ae158b549 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:11.351191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4360b-53e7-4a57-8e13-876ae158b549 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:11.351841 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4360b-53e7-4a57-8e13-876ae158b549 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:11.353211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4360b-53e7-4a57-8e13-876ae158b549 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:11.355039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c71688-4dd5-4afd-95f2-fa0ba2053fee None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:11.355330 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c71688-4dd5-4afd-95f2-fa0ba2053fee None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:11.355607 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c71688-4dd5-4afd-95f2-fa0ba2053fee None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:11.356996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 505/992] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:11.362268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9699f-1787-450e-a021-9660d9e38945 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:11.362632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9699f-1787-450e-a021-9660d9e38945 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:11.362983 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9699f-1787-450e-a021-9660d9e38945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:11.367586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-51e4360b-53e7-4a57-8e13-876ae158b549 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 18 16:52:11.367586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:11.367586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:52:11.367586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:52:11.367586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:52:11.367586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:52:11.367586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:52:11.367586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:11.367586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 16:52:11.367586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:11.367586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:52:11.367586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:11.367586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:11.367586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:11.367586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:11.367586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:11.367586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:11.368570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:11.368570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:11.368570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:11.368570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:11.368570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:11.368570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:11.368570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:52:11.368570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:52:11.368570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:52:11.368570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:52:11.368570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:11.368570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:11.368570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:11.368570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:11.368570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:11.368570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:11.369442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:11.369442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:11.369442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:11.369442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:11.369442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:11.369442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:11.369442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:11.369442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:11.369442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:11.369442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:11.369442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:52:11.369442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:11.369442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 16:52:11.369442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:11.370483 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 488/993] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:52:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:11.374558 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4360b-53e7-4a57-8e13-876ae158b549 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:11.384053 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5cc9699f-1787-450e-a021-9660d9e38945 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:11.385268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5cc9699f-1787-450e-a021-9660d9e38945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:11.460845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:11.470930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 506/994] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:52:11.493876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9699f-1787-450e-a021-9660d9e38945 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:11.496244 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4360b-53e7-4a57-8e13-876ae158b549 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:11.534048 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334c027-3fd2-4ff6-8588-d42591592812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:11.536518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334c027-3fd2-4ff6-8588-d42591592812 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:11.536813 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334c027-3fd2-4ff6-8588-d42591592812 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:11.537096 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334c027-3fd2-4ff6-8588-d42591592812 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:11.537842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334c027-3fd2-4ff6-8588-d42591592812 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:11.538152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334c027-3fd2-4ff6-8588-d42591592812 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:11.539541 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334c027-3fd2-4ff6-8588-d42591592812 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:11.545508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 489/995] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 18 16:52:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:11.551761 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334c027-3fd2-4ff6-8588-d42591592812 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:11.605515 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:11.606072 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9699f-1787-450e-a021-9660d9e38945 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:11.643401 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0be343-82aa-4f21-baae-aafdccb0392f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:11.644212 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0be343-82aa-4f21-baae-aafdccb0392f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:11.644500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0be343-82aa-4f21-baae-aafdccb0392f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:11.645714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0be343-82aa-4f21-baae-aafdccb0392f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:11.646480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0be343-82aa-4f21-baae-aafdccb0392f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:11.647868 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0be343-82aa-4f21-baae-aafdccb0392f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:11.661158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-7c0be343-82aa-4f21-baae-aafdccb0392f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 16:52:11.661158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:11.661158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:52:11.661158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:52:11.661158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:52:11.661158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:52:11.661158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:52:11.661158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:11.661158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 16:52:11.661158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:11.661158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:52:11.661158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:11.661158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:11.661158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:11.661158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:11.661158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:11.661158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:11.662421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:11.662421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:11.662421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:11.662421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:11.662421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:11.662421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:11.662421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:52:11.662421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:52:11.662421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:52:11.662421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:52:11.662421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:11.662421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:11.662421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:11.662421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:11.662421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:11.662421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:11.663293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:11.663293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:11.663293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:11.663293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:11.663293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:11.663293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:11.663293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:11.663293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:11.663293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:11.663293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:11.663293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:52:11.663293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:11.663293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 18 16:52:11.663293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:11.663293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 507/996] 10.222.0.49 () {56 vars in 1126 bytes} [Wed May 18 16:52:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:52:11.664143 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c5426-3f02-427a-a216-cbae182208c9 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:11.664143 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c5426-3f02-427a-a216-cbae182208c9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:11.664293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c5426-3f02-427a-a216-cbae182208c9 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:11.667620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 508/997] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:11.668159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c5426-3f02-427a-a216-cbae182208c9 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:11.670112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334c027-3fd2-4ff6-8588-d42591592812 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:11.706756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c13014-97c1-4eaa-962b-4e7c66562acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:11.708537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c13014-97c1-4eaa-962b-4e7c66562acc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:11.708832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c13014-97c1-4eaa-962b-4e7c66562acc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:11.709116 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c13014-97c1-4eaa-962b-4e7c66562acc None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:11.709870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c13014-97c1-4eaa-962b-4e7c66562acc None admin] RBAC: Adding query filter params (type=compute) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:11.710183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c13014-97c1-4eaa-962b-4e7c66562acc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:11.711571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c13014-97c1-4eaa-962b-4e7c66562acc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:11.716851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 490/998] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 18 16:52:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:52:11.718089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fad17-0eaa-426d-9fcd-3a90476af988 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:11.718383 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fad17-0eaa-426d-9fcd-3a90476af988 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:11.718659 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653fad17-0eaa-426d-9fcd-3a90476af988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:11.731409 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:11.735537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-653fad17-0eaa-426d-9fcd-3a90476af988 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:11.736739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-653fad17-0eaa-426d-9fcd-3a90476af988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:11.776351 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c5426-3f02-427a-a216-cbae182208c9 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:11.804575 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 491/999] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:11.805313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fad17-0eaa-426d-9fcd-3a90476af988 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:11.812872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b938e8-f77a-46e6-a32f-ca8bb739e434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:11.813795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b938e8-f77a-46e6-a32f-ca8bb739e434 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:11.814234 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b938e8-f77a-46e6-a32f-ca8bb739e434 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:11.814694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b938e8-f77a-46e6-a32f-ca8bb739e434 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:11.815560 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b938e8-f77a-46e6-a32f-ca8bb739e434 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:11.816023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b938e8-f77a-46e6-a32f-ca8bb739e434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:11.818804 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b938e8-f77a-46e6-a32f-ca8bb739e434 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:11.824694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 509/1000] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 18 16:52:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:52:11.827129 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b938e8-f77a-46e6-a32f-ca8bb739e434 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:11.854018 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:11.915649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653fad17-0eaa-426d-9fcd-3a90476af988 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:11.931645 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b938e8-f77a-46e6-a32f-ca8bb739e434 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:11.949515 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe086c-b8fa-4f3f-b906-dafb06ef3309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:11.950203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe086c-b8fa-4f3f-b906-dafb06ef3309 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:11.950492 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe086c-b8fa-4f3f-b906-dafb06ef3309 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:11.950762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe086c-b8fa-4f3f-b906-dafb06ef3309 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:11.951564 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe086c-b8fa-4f3f-b906-dafb06ef3309 None admin] RBAC: Adding query filter params (interface=public, service_id=e21538126f49478b82f4f9a9d58bf96c, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:11.951875 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe086c-b8fa-4f3f-b906-dafb06ef3309 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:11.953242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe086c-b8fa-4f3f-b906-dafb06ef3309 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:11.955268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:11.963938 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 492/1001] 10.222.0.49 () {56 vars in 1251 bytes} [Wed May 18 16:52:11 2022] GET /identity/v3/endpoints?service_id=e21538126f49478b82f4f9a9d58bf96c&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:11.963938 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe086c-b8fa-4f3f-b906-dafb06ef3309 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:11.967288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a80de-3f00-4ce1-a87c-4277caebf899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:11.968078 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a80de-3f00-4ce1-a87c-4277caebf899 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:11.968357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a80de-3f00-4ce1-a87c-4277caebf899 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:11.968626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a80de-3f00-4ce1-a87c-4277caebf899 None admin] PATH_INFO: `/v3/services/image` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:11.969276 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a80de-3f00-4ce1-a87c-4277caebf899 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:11.970667 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a80de-3f00-4ce1-a87c-4277caebf899 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:11.982823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-5d1a80de-3f00-4ce1-a87c-4277caebf899 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 18 16:52:11.982823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:11.982823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:52:11.982823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:52:11.982823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:52:11.982823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:52:11.982823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:52:11.982823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:11.982823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 16:52:11.982823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:11.982823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:52:11.982823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:11.982823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:11.982823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:11.982823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:11.982823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:11.982823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:11.984055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:11.984055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:11.984055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:11.984055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:11.984055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:11.984055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:11.984055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:52:11.984055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:52:11.984055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:52:11.984055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:52:11.984055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:11.984055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:11.984055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:11.984055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:11.984055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:11.984055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:11.985134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:11.985134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:11.985134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:11.985134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:11.985134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:11.985134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:11.985134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:11.985134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:11.985134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:11.985134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:11.985134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:52:11.985134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:11.985134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 16:52:11.985134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:11.985134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 510/1002] 10.222.0.49 () {56 vars in 1105 bytes} [Wed May 18 16:52:11 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:52:11.986008 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a80de-3f00-4ce1-a87c-4277caebf899 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:12.067224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe086c-b8fa-4f3f-b906-dafb06ef3309 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:12.069570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:12.089011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a80de-3f00-4ce1-a87c-4277caebf899 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:12.103538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988fbb6-bea5-44eb-9f9c-347a17caef5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:12.104203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988fbb6-bea5-44eb-9f9c-347a17caef5e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:12.104481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988fbb6-bea5-44eb-9f9c-347a17caef5e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:12.104757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988fbb6-bea5-44eb-9f9c-347a17caef5e None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:12.105465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988fbb6-bea5-44eb-9f9c-347a17caef5e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:12.105797 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988fbb6-bea5-44eb-9f9c-347a17caef5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:12.107158 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988fbb6-bea5-44eb-9f9c-347a17caef5e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:12.112089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 493/1003] 10.222.0.49 () {56 vars in 1122 bytes} [Wed May 18 16:52:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:12.112674 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988fbb6-bea5-44eb-9f9c-347a17caef5e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:12.127962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f0b1d-68c5-4fb5-99c4-583191885550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:12.129916 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f0b1d-68c5-4fb5-99c4-583191885550 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:12.130218 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f0b1d-68c5-4fb5-99c4-583191885550 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:12.130501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f0b1d-68c5-4fb5-99c4-583191885550 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:12.131198 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f0b1d-68c5-4fb5-99c4-583191885550 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:12.132595 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f0b1d-68c5-4fb5-99c4-583191885550 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:12.139138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 511/1004] 10.222.0.49 () {56 vars in 1087 bytes} [Wed May 18 16:52:11 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 16:52:12.139992 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f0b1d-68c5-4fb5-99c4-583191885550 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:12.208588 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:12.232275 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988fbb6-bea5-44eb-9f9c-347a17caef5e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:12.265179 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f0b1d-68c5-4fb5-99c4-583191885550 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:12.268534 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48958b44-b820-4ead-b410-666f54ad4d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:12.269214 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48958b44-b820-4ead-b410-666f54ad4d01 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:12.269644 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48958b44-b820-4ead-b410-666f54ad4d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:12.270435 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48958b44-b820-4ead-b410-666f54ad4d01 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:12.271156 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48958b44-b820-4ead-b410-666f54ad4d01 None admin] RBAC: Adding query filter params (name=image) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:12.271456 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48958b44-b820-4ead-b410-666f54ad4d01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:12.272852 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48958b44-b820-4ead-b410-666f54ad4d01 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:12.278381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 494/1005] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:12.284194 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48958b44-b820-4ead-b410-666f54ad4d01 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:12.311672 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b5d3e-8053-44b1-aa91-3c0e0678aa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:12.312345 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b5d3e-8053-44b1-aa91-3c0e0678aa1e None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:12.312632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b5d3e-8053-44b1-aa91-3c0e0678aa1e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:12.312913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b5d3e-8053-44b1-aa91-3c0e0678aa1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:12.313691 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b5d3e-8053-44b1-aa91-3c0e0678aa1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:12.315090 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b5d3e-8053-44b1-aa91-3c0e0678aa1e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:12.317711 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:12.334557 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 512/1006] 10.222.0.49 () {60 vars in 1144 bytes} [Wed May 18 16:52:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:52:12.401464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48958b44-b820-4ead-b410-666f54ad4d01 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:12.450755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145c7c0-7fb1-406f-b84f-d24573212a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:12.451430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145c7c0-7fb1-406f-b84f-d24573212a81 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:12.451712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145c7c0-7fb1-406f-b84f-d24573212a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:12.451984 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145c7c0-7fb1-406f-b84f-d24573212a81 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:12.452699 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145c7c0-7fb1-406f-b84f-d24573212a81 None admin] RBAC: Adding query filter params (type=image) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:12.453000 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145c7c0-7fb1-406f-b84f-d24573212a81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:12.454428 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145c7c0-7fb1-406f-b84f-d24573212a81 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:12.469793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 495/1007] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:52:14.431883 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4312c3a-36c0-45bc-b09c-1b3f51263f5d None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:14.432409 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4312c3a-36c0-45bc-b09c-1b3f51263f5d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:14.432487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4312c3a-36c0-45bc-b09c-1b3f51263f5d None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:14.433896 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 513/1008] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:14.439180 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f590e-4b75-42f8-9829-602fafd92b7e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:14.439620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f590e-4b75-42f8-9829-602fafd92b7e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:14.439812 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f590e-4b75-42f8-9829-602fafd92b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:14.458090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e52f590e-4b75-42f8-9829-602fafd92b7e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:14.459281 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e52f590e-4b75-42f8-9829-602fafd92b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:14.531507 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 496/1009] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:14 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:14.556539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4312c3a-36c0-45bc-b09c-1b3f51263f5d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:14.580031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237e4ae-df0e-4610-9846-1c196d577e89 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:14.580321 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237e4ae-df0e-4610-9846-1c196d577e89 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:14.580855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237e4ae-df0e-4610-9846-1c196d577e89 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:14.582573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 497/1010] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:14.587740 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666e7f0-5172-47c1-a887-858e3749bf9b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:14.588029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666e7f0-5172-47c1-a887-858e3749bf9b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:14.588311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666e7f0-5172-47c1-a887-858e3749bf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:14.605701 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4666e7f0-5172-47c1-a887-858e3749bf9b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:14.606909 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4666e7f0-5172-47c1-a887-858e3749bf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:14.625223 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:14.669324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4312c3a-36c0-45bc-b09c-1b3f51263f5d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:14.689590 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 498/1011] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:14 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:52:14.691210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:14.708671 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e7264-8ae7-4378-8042-633ba307868e None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:14.709037 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e7264-8ae7-4378-8042-633ba307868e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:14.709334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e7264-8ae7-4378-8042-633ba307868e None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:14.710759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 499/1012] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:14.711009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a6235-7b69-4cbf-ac4f-8789877cbe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:14.711462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e7264-8ae7-4378-8042-633ba307868e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:14.711862 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a6235-7b69-4cbf-ac4f-8789877cbe3d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:14.712358 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a6235-7b69-4cbf-ac4f-8789877cbe3d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:14.712739 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a6235-7b69-4cbf-ac4f-8789877cbe3d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:14.713407 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a6235-7b69-4cbf-ac4f-8789877cbe3d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:14.714836 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a6235-7b69-4cbf-ac4f-8789877cbe3d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:14.727371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-9c0a6235-7b69-4cbf-ac4f-8789877cbe3d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 18 16:52:14.727371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:14.727371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:52:14.727371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:52:14.727371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:52:14.727371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:52:14.727371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:52:14.727371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:14.727371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 16:52:14.727371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:14.727371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:52:14.727371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:14.727371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:14.727371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:14.727371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:14.727371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:14.727371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:14.728411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:14.728411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:14.728411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:14.728411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:14.728411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:14.728411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:14.728411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:52:14.728411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:52:14.728411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:52:14.728411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:52:14.728411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:14.728411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:14.728411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:14.728411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:14.728411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:14.728411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:14.729509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:14.729509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:14.729509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:14.729509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:14.729509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:14.729509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:14.729509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:14.729509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:14.729509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:14.729509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:14.729509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:52:14.729509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:14.729509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 18 16:52:14.729509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:14.729509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 514/1013] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:52:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:14.730371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcdc34-835f-4056-9897-6a449422116b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:14.730371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcdc34-835f-4056-9897-6a449422116b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:14.731041 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcdc34-835f-4056-9897-6a449422116b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:14.747839 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ddbcdc34-835f-4056-9897-6a449422116b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:14.749029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ddbcdc34-835f-4056-9897-6a449422116b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:14.814633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 515/1014] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:14 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:14.815352 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcdc34-835f-4056-9897-6a449422116b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:14.816562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e7264-8ae7-4378-8042-633ba307868e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:14.853145 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2cddb-7573-4b49-a327-fcaf518349d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:14.853964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2cddb-7573-4b49-a327-fcaf518349d5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:14.854253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2cddb-7573-4b49-a327-fcaf518349d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:14.854537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2cddb-7573-4b49-a327-fcaf518349d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:14.855741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2cddb-7573-4b49-a327-fcaf518349d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:14.857185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2cddb-7573-4b49-a327-fcaf518349d5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:14.858865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 500/1015] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:14.859610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2cddb-7573-4b49-a327-fcaf518349d5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:14.884336 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:14.917643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcdc34-835f-4056-9897-6a449422116b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:14.925170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:14.953539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d9be3-990d-419e-97b2-2691d14347e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:14.954154 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d9be3-990d-419e-97b2-2691d14347e5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:14.954440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d9be3-990d-419e-97b2-2691d14347e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:14.954714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d9be3-990d-419e-97b2-2691d14347e5 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:14.955670 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d9be3-990d-419e-97b2-2691d14347e5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:14.955986 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d9be3-990d-419e-97b2-2691d14347e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:14.957875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d9be3-990d-419e-97b2-2691d14347e5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:14.962604 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 516/1016] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 18 16:52:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:14.963361 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d9be3-990d-419e-97b2-2691d14347e5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:14.965843 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2cddb-7573-4b49-a327-fcaf518349d5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:15.004668 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1dc63-a67c-4389-b230-7f05b0aa9edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:15.005035 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1dc63-a67c-4389-b230-7f05b0aa9edc None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:15.005316 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1dc63-a67c-4389-b230-7f05b0aa9edc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:15.005589 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1dc63-a67c-4389-b230-7f05b0aa9edc None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:15.006408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1dc63-a67c-4389-b230-7f05b0aa9edc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:15.007767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1dc63-a67c-4389-b230-7f05b0aa9edc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:15.022742 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 501/1017] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 18 16:52:14 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:52:15.023548 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1dc63-a67c-4389-b230-7f05b0aa9edc None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:15.079299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d9be3-990d-419e-97b2-2691d14347e5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:15.126573 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdb961-b852-45d3-aa54-f9ad2ac01228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:15.127276 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdb961-b852-45d3-aa54-f9ad2ac01228 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:15.127555 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdb961-b852-45d3-aa54-f9ad2ac01228 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:15.127843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdb961-b852-45d3-aa54-f9ad2ac01228 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:15.128567 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdb961-b852-45d3-aa54-f9ad2ac01228 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:15.130116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdb961-b852-45d3-aa54-f9ad2ac01228 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:15.137172 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:15.173691 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 517/1018] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 18 16:52:14 2022] POST /identity/v3/projects => generated 311 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:52:15.175468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1dc63-a67c-4389-b230-7f05b0aa9edc None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:15.218299 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fad9e-728c-4294-8b46-fd2d8f8efb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:15.218706 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fad9e-728c-4294-8b46-fd2d8f8efb0c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:15.218991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fad9e-728c-4294-8b46-fd2d8f8efb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:15.219393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fad9e-728c-4294-8b46-fd2d8f8efb0c None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:15.219999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fad9e-728c-4294-8b46-fd2d8f8efb0c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:15.220304 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fad9e-728c-4294-8b46-fd2d8f8efb0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:15.221770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fad9e-728c-4294-8b46-fd2d8f8efb0c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:15.232240 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 502/1019] 10.222.0.49 () {56 vars in 1112 bytes} [Wed May 18 16:52:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:15.238140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdb961-b852-45d3-aa54-f9ad2ac01228 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:15.262232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:15.360264 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdb961-b852-45d3-aa54-f9ad2ac01228 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:15.399688 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad93e10-640d-46ce-b0fb-79874f545cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:15.400354 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad93e10-640d-46ce-b0fb-79874f545cc7 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:15.400633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad93e10-640d-46ce-b0fb-79874f545cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:15.400906 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad93e10-640d-46ce-b0fb-79874f545cc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:15.401724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad93e10-640d-46ce-b0fb-79874f545cc7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:15.403065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad93e10-640d-46ce-b0fb-79874f545cc7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:15.425151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 518/1020] 10.222.0.49 () {60 vars in 1144 bytes} [Wed May 18 16:52:15 2022] POST /identity/v3/endpoints => generated 334 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 16:52:17.315259 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaae287-2c9d-4bab-b1cd-00415ff11f0b None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:17.315819 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaae287-2c9d-4bab-b1cd-00415ff11f0b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:17.315819 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaae287-2c9d-4bab-b1cd-00415ff11f0b None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:17.317822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 503/1021] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:17.323500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c96a4-d1f0-4d97-a801-0a4601f7ba5c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:17.324049 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c96a4-d1f0-4d97-a801-0a4601f7ba5c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:17.324049 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c96a4-d1f0-4d97-a801-0a4601f7ba5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:17.344904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e58c96a4-d1f0-4d97-a801-0a4601f7ba5c None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:17.346240 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e58c96a4-d1f0-4d97-a801-0a4601f7ba5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:17.422986 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:17.430405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 519/1022] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:17.453407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaae287-2c9d-4bab-b1cd-00415ff11f0b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:17.500871 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4a48a-ea89-4da5-bf8b-6ad91e734a56 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:17.501194 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4a48a-ea89-4da5-bf8b-6ad91e734a56 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:17.501446 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4a48a-ea89-4da5-bf8b-6ad91e734a56 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:17.503027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 520/1023] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:52:17.511430 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba2f7f-104c-4aa7-bd65-c7732cf732e7 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:17.511725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba2f7f-104c-4aa7-bd65-c7732cf732e7 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:17.512008 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba2f7f-104c-4aa7-bd65-c7732cf732e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:17.529573 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-42ba2f7f-104c-4aa7-bd65-c7732cf732e7 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:17.530821 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-42ba2f7f-104c-4aa7-bd65-c7732cf732e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:17.565811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaae287-2c9d-4bab-b1cd-00415ff11f0b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:17.606879 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ca828-0e5d-4b61-9198-a3da7f2775e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:17.607609 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ca828-0e5d-4b61-9198-a3da7f2775e4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:17.607887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ca828-0e5d-4b61-9198-a3da7f2775e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:17.609859 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 521/1024] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:52:17.609976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ca828-0e5d-4b61-9198-a3da7f2775e4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:17.609976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ca828-0e5d-4b61-9198-a3da7f2775e4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:17.610462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ca828-0e5d-4b61-9198-a3da7f2775e4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:17.627518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-514ca828-0e5d-4b61-9198-a3da7f2775e4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 18 16:52:17.627518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:17.627518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:52:17.627518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:52:17.627518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:52:17.627518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:52:17.627518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:52:17.627518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:17.627518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 16:52:17.627518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:17.627518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:52:17.627518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:17.627518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:17.627518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:17.627518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:17.627518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:17.627518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:17.629403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:17.629403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:17.629403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:17.629403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:17.629403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:17.629403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:17.629403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:52:17.629403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:52:17.629403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:52:17.629403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:52:17.629403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:17.629403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:17.629403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:17.629403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:17.629403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:17.629403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:17.630556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:17.630556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:17.630556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:17.630556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:17.630556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:17.630556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:17.630556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:17.630556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:17.630556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:17.630556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:17.630556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:52:17.630556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:17.630556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 16:52:17.630556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:17.630556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 504/1025] 10.222.0.49 () {56 vars in 1105 bytes} [Wed May 18 16:52:17 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:17.635256 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ca828-0e5d-4b61-9198-a3da7f2775e4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:17.635400 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba2f7f-104c-4aa7-bd65-c7732cf732e7 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:17.652096 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:17.743910 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba2f7f-104c-4aa7-bd65-c7732cf732e7 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:17.759280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ca828-0e5d-4b61-9198-a3da7f2775e4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:17.778453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:17.785631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88229a-27e1-4733-871a-f1ea8524878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:17.786465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88229a-27e1-4733-871a-f1ea8524878a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:17.786745 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88229a-27e1-4733-871a-f1ea8524878a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:17.787016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88229a-27e1-4733-871a-f1ea8524878a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:17.788232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88229a-27e1-4733-871a-f1ea8524878a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:17.789700 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88229a-27e1-4733-871a-f1ea8524878a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:17.791346 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 522/1026] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:17.792555 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39da881-0000-487f-874f-d00925154cfa None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:17.792839 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39da881-0000-487f-874f-d00925154cfa None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:17.793699 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39da881-0000-487f-874f-d00925154cfa None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:17.794431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 523/1027] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:17.797749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39da881-0000-487f-874f-d00925154cfa None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:17.799570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f924738-d5d5-410a-b358-3f85193b0f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:17.800236 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f924738-d5d5-410a-b358-3f85193b0f2f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:17.800555 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f924738-d5d5-410a-b358-3f85193b0f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:17.801392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f924738-d5d5-410a-b358-3f85193b0f2f None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:17.802143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f924738-d5d5-410a-b358-3f85193b0f2f None admin] RBAC: Adding query filter params (name=image) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:17.802643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f924738-d5d5-410a-b358-3f85193b0f2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:17.804006 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f924738-d5d5-410a-b358-3f85193b0f2f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:17.813596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 505/1028] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:17.813596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869894c-56df-49e1-9a2c-c1ab90657388 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:17.813596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869894c-56df-49e1-9a2c-c1ab90657388 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:17.813596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869894c-56df-49e1-9a2c-c1ab90657388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:17.827381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1869894c-56df-49e1-9a2c-c1ab90657388 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:17.828573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1869894c-56df-49e1-9a2c-c1ab90657388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:17.897030 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 506/1029] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:17.898187 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869894c-56df-49e1-9a2c-c1ab90657388 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:17.900746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:17.906794 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39da881-0000-487f-874f-d00925154cfa None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:17.942483 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319b955-e31c-42f8-9259-86434e0a8a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:17.943202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319b955-e31c-42f8-9259-86434e0a8a82 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:17.943493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319b955-e31c-42f8-9259-86434e0a8a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:17.943779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319b955-e31c-42f8-9259-86434e0a8a82 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:17.944493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319b955-e31c-42f8-9259-86434e0a8a82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:17.945971 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319b955-e31c-42f8-9259-86434e0a8a82 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:17.967151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 524/1030] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 18 16:52:17 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:52:17.968169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319b955-e31c-42f8-9259-86434e0a8a82 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:18.010321 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869894c-56df-49e1-9a2c-c1ab90657388 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:18.047287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:18.058583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88875bfc-594c-442e-af9d-f4b003f6c0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:18.059274 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88875bfc-594c-442e-af9d-f4b003f6c0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:18.059560 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88875bfc-594c-442e-af9d-f4b003f6c0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:18.059841 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88875bfc-594c-442e-af9d-f4b003f6c0e8 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:18.061352 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88875bfc-594c-442e-af9d-f4b003f6c0e8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:18.062043 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88875bfc-594c-442e-af9d-f4b003f6c0e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:18.063271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88875bfc-594c-442e-af9d-f4b003f6c0e8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:18.074699 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 507/1031] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:18.075990 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88875bfc-594c-442e-af9d-f4b003f6c0e8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:18.117555 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319b955-e31c-42f8-9259-86434e0a8a82 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:18.154298 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:18.158858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f183b6-b138-499b-bb5d-65ce34c0816a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:18.159666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f183b6-b138-499b-bb5d-65ce34c0816a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:18.159951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f183b6-b138-499b-bb5d-65ce34c0816a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:18.160912 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f183b6-b138-499b-bb5d-65ce34c0816a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:18.175256 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f183b6-b138-499b-bb5d-65ce34c0816a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:52:18.183825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-76f183b6-b138-499b-bb5d-65ce34c0816a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 16:52:18.183825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:18.183825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:18.183825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:18.183825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:18.183825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:18.183825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:18.183825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:18.183825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:18.183825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:18.183825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:18.183825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:18.183825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:52:18.183825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:52:18.183825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:52:18.183825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:52:18.185040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:52:18.185040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:52:18.185040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:52:18.185040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:52:18.185040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:18.185040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:18.185040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:18.185040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:18.185040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:18.185040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:18.185040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:18.185040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:18.185040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:18.185040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:18.185040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:18.185040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:18.186027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:18.186027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:18.186027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:18.186027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:18.186027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:52:18.186027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:52:18.186027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:52:18.186027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:52:18.186027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:52:18.186027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:52:18.186027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 16:52:18.186027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:18.186027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 525/1032] 10.222.0.49 () {56 vars in 1120 bytes} [Wed May 18 16:52:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:18.191234 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f183b6-b138-499b-bb5d-65ce34c0816a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:18.201105 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88875bfc-594c-442e-af9d-f4b003f6c0e8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:18.245430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38389f7b-d9d6-491f-a018-e1abe78ba707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:18.246131 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38389f7b-d9d6-491f-a018-e1abe78ba707 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:18.246413 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38389f7b-d9d6-491f-a018-e1abe78ba707 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:18.246687 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38389f7b-d9d6-491f-a018-e1abe78ba707 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:18.247487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38389f7b-d9d6-491f-a018-e1abe78ba707 None admin] RBAC: Adding query filter params (interface=public, service_id=1f64b80725724b468b9c55d35ca3a0d3, region_id=RegionOne) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:18.247797 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38389f7b-d9d6-491f-a018-e1abe78ba707 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:18.249168 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38389f7b-d9d6-491f-a018-e1abe78ba707 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:18.255840 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 508/1033] 10.222.0.49 () {56 vars in 1251 bytes} [Wed May 18 16:52:18 2022] GET /identity/v3/endpoints?service_id=1f64b80725724b468b9c55d35ca3a0d3&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:18.261035 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38389f7b-d9d6-491f-a018-e1abe78ba707 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:18.312126 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f183b6-b138-499b-bb5d-65ce34c0816a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:18.328056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:18.352183 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c47599-97b9-441c-aba1-abf09cfe8751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:18.352854 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c47599-97b9-441c-aba1-abf09cfe8751 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:18.353137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c47599-97b9-441c-aba1-abf09cfe8751 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:18.353410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c47599-97b9-441c-aba1-abf09cfe8751 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:18.354194 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c47599-97b9-441c-aba1-abf09cfe8751 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:18.354498 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c47599-97b9-441c-aba1-abf09cfe8751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:18.355870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c47599-97b9-441c-aba1-abf09cfe8751 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:18.365868 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 526/1034] 10.222.0.49 () {56 vars in 1115 bytes} [Wed May 18 16:52:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:18.371495 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c47599-97b9-441c-aba1-abf09cfe8751 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:18.373749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38389f7b-d9d6-491f-a018-e1abe78ba707 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:18.411327 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:18.420050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803303c-9b16-45f9-b613-1409f74560df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:18.421184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803303c-9b16-45f9-b613-1409f74560df None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:18.421688 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803303c-9b16-45f9-b613-1409f74560df None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:18.422004 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803303c-9b16-45f9-b613-1409f74560df None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:18.422737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803303c-9b16-45f9-b613-1409f74560df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:18.424172 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803303c-9b16-45f9-b613-1409f74560df None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:18.432257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 509/1035] 10.222.0.49 () {56 vars in 1087 bytes} [Wed May 18 16:52:18 2022] GET /identity/v3/services => generated 1957 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 16:52:18.555075 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c47599-97b9-441c-aba1-abf09cfe8751 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:18.593029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe067a1-a3a7-4e0b-8b5c-3903fee7bcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:18.593871 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe067a1-a3a7-4e0b-8b5c-3903fee7bcf1 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:18.594157 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe067a1-a3a7-4e0b-8b5c-3903fee7bcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:18.594432 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe067a1-a3a7-4e0b-8b5c-3903fee7bcf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:18.607594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe067a1-a3a7-4e0b-8b5c-3903fee7bcf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:18.609147 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe067a1-a3a7-4e0b-8b5c-3903fee7bcf1 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:18.627789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-8fe067a1-a3a7-4e0b-8b5c-3903fee7bcf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:18.627789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:18.627789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:18.627789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:18.627789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:18.627789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:18.627789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:18.627789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:18.627789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:18.627789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:18.627789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:18.627789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:18.627789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:52:18.627789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:52:18.627789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:52:18.628743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:52:18.628743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:18.628743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:18.628743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:18.628743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:18.628743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:18.628743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:18.628743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:18.628743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:18.628743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:18.628743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:18.628743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:18.628743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:18.628743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:18.628743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:18.628743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:18.628743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:18.630396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:52:18.630396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:52:18.630396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:18.630396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:18.630396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 527/1036] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:18.634742 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803303c-9b16-45f9-b613-1409f74560df None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:18.740401 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803303c-9b16-45f9-b613-1409f74560df None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:18.775645 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46b3e6-4fd6-42ea-9c97-2ee19b8b165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:18.776315 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46b3e6-4fd6-42ea-9c97-2ee19b8b165c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:18.776602 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46b3e6-4fd6-42ea-9c97-2ee19b8b165c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:18.776887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46b3e6-4fd6-42ea-9c97-2ee19b8b165c None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:18.777618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46b3e6-4fd6-42ea-9c97-2ee19b8b165c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:18.777960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46b3e6-4fd6-42ea-9c97-2ee19b8b165c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:18.779465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46b3e6-4fd6-42ea-9c97-2ee19b8b165c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:18.796905 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 510/1037] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:18.798562 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe067a1-a3a7-4e0b-8b5c-3903fee7bcf1 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:18.829118 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:18.908277 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe067a1-a3a7-4e0b-8b5c-3903fee7bcf1 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:18.945753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc347a-b75d-4917-af9f-6efe719b4994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:18.946497 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc347a-b75d-4917-af9f-6efe719b4994 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:18.946781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc347a-b75d-4917-af9f-6efe719b4994 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:18.947063 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc347a-b75d-4917-af9f-6efe719b4994 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:18.955248 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc347a-b75d-4917-af9f-6efe719b4994 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:18.957031 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc347a-b75d-4917-af9f-6efe719b4994 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:18.972404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-0bcc347a-b75d-4917-af9f-6efe719b4994 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 16:52:18.972404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:18.972404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:18.972404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:18.972404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:18.972404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:18.972404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:18.972404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:18.972404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:18.972404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:18.972404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:18.972404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:18.972404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:52:18.972404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:52:18.972404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:52:18.972404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:52:18.973491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:18.973491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:18.973491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:52:18.973491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:52:18.973491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:52:18.973491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:52:18.973491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:18.973491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:18.973491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:18.973491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:18.973491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:18.973491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:18.973491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:18.973491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:18.973491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:18.973491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:18.973491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:18.973491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:18.979210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:18.979210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:18.979210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:52:18.979210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:52:18.979210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:52:18.979210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:52:18.979210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:52:18.979210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:52:18.979210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 16:52:18.979210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:18.979210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 528/1038] 10.222.0.49 () {56 vars in 1093 bytes} [Wed May 18 16:52:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:18.981381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46b3e6-4fd6-42ea-9c97-2ee19b8b165c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:19.041392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:19.094575 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46b3e6-4fd6-42ea-9c97-2ee19b8b165c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:19.129674 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45d594-8f6c-48dc-92f3-9af50dfb8eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:19.130589 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45d594-8f6c-48dc-92f3-9af50dfb8eff None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:19.130990 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45d594-8f6c-48dc-92f3-9af50dfb8eff None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:19.131383 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45d594-8f6c-48dc-92f3-9af50dfb8eff None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:19.132607 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45d594-8f6c-48dc-92f3-9af50dfb8eff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:19.132917 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45d594-8f6c-48dc-92f3-9af50dfb8eff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:19.134686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45d594-8f6c-48dc-92f3-9af50dfb8eff None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:19.158255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 511/1039] 10.222.0.49 () {56 vars in 1133 bytes} [Wed May 18 16:52:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:19.159656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc347a-b75d-4917-af9f-6efe719b4994 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:19.268555 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:19.283537 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc347a-b75d-4917-af9f-6efe719b4994 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:19.320472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd62798-7899-4311-b521-a96d299fa3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:19.321116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd62798-7899-4311-b521-a96d299fa3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:19.321328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd62798-7899-4311-b521-a96d299fa3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:19.321605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd62798-7899-4311-b521-a96d299fa3c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:19.389906 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd62798-7899-4311-b521-a96d299fa3c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:19.391376 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd62798-7899-4311-b521-a96d299fa3c4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:19.484136 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:19.498547 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 529/1040] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:52:19 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 16:52:19.504363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45d594-8f6c-48dc-92f3-9af50dfb8eff None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:19.614351 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45d594-8f6c-48dc-92f3-9af50dfb8eff None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:19.627444 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:19.652179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626f6a9-5a68-4e53-a7f1-95281e61ac20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:19.652976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626f6a9-5a68-4e53-a7f1-95281e61ac20 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:19.653258 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626f6a9-5a68-4e53-a7f1-95281e61ac20 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:19.653530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626f6a9-5a68-4e53-a7f1-95281e61ac20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:19.665482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626f6a9-5a68-4e53-a7f1-95281e61ac20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:19.667026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626f6a9-5a68-4e53-a7f1-95281e61ac20 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:19.685461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-2626f6a9-5a68-4e53-a7f1-95281e61ac20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:19.685461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:19.685461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:19.685461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:19.685461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:19.685461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:19.685461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:19.685461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:19.685461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:19.685461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:19.685461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:19.685461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:19.685461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:52:19.685461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:52:19.685461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:52:19.686804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:52:19.686804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:19.686804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:19.686804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:19.686804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:19.686804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:19.686804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:19.686804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:19.686804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:19.686804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:19.686804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:19.686804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:19.686804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:19.686804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:19.686804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:19.686804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:19.686804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:19.687782 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:52:19.687782 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:52:19.687782 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:19.687782 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:19.687782 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 512/1041] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:19.693740 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd62798-7899-4311-b521-a96d299fa3c4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:19.799474 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd62798-7899-4311-b521-a96d299fa3c4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:19.837976 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0087d59-6a79-40d3-b71d-76237785ef8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:19.838643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0087d59-6a79-40d3-b71d-76237785ef8b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:19.838929 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0087d59-6a79-40d3-b71d-76237785ef8b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:19.839208 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0087d59-6a79-40d3-b71d-76237785ef8b None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:19.839935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0087d59-6a79-40d3-b71d-76237785ef8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:19.840245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0087d59-6a79-40d3-b71d-76237785ef8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:19.841625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0087d59-6a79-40d3-b71d-76237785ef8b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:19.858811 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 530/1042] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:19.860108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626f6a9-5a68-4e53-a7f1-95281e61ac20 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:19.964176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626f6a9-5a68-4e53-a7f1-95281e61ac20 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:20.001958 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb4d4b-9167-4e3c-bc64-7b1892074509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:20.002756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb4d4b-9167-4e3c-bc64-7b1892074509 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:20.003038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb4d4b-9167-4e3c-bc64-7b1892074509 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:20.003315 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb4d4b-9167-4e3c-bc64-7b1892074509 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:20.010911 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb4d4b-9167-4e3c-bc64-7b1892074509 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:20.012350 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb4d4b-9167-4e3c-bc64-7b1892074509 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:20.026085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-9cbb4d4b-9167-4e3c-bc64-7b1892074509 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:52:20.026085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:20.026085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:20.026085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:20.026085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:20.026085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:20.026085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:20.026085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:20.026085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:20.026085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:20.026085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:20.026085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:20.026085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:52:20.026085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:52:20.026085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:52:20.027041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:52:20.027041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:20.027041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:20.027041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:20.027041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:20.027041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:20.027041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:20.027041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:20.027041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:20.027041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:20.027041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:20.027041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:20.027041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:20.027041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:20.027041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:20.027041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:20.027041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:20.027961 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:52:20.027961 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:52:20.027961 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:52:20.027961 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:52:20.027961 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:52:20.027961 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:52:20.027961 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:52:20.027961 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:20.029757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 513/1043] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:52:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:20.033107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0087d59-6a79-40d3-b71d-76237785ef8b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:20.096916 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:20.154288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0087d59-6a79-40d3-b71d-76237785ef8b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:20.195328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c152e-d3b2-41e8-8b61-b936fc2e0977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:20.196027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c152e-d3b2-41e8-8b61-b936fc2e0977 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:20.196360 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c152e-d3b2-41e8-8b61-b936fc2e0977 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:20.196592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c152e-d3b2-41e8-8b61-b936fc2e0977 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:20.197415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c152e-d3b2-41e8-8b61-b936fc2e0977 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:20.197760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c152e-d3b2-41e8-8b61-b936fc2e0977 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:20.199258 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c152e-d3b2-41e8-8b61-b936fc2e0977 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:20.218983 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 531/1044] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:52:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:20.220306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb4d4b-9167-4e3c-bc64-7b1892074509 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:20.250898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:20.342059 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb4d4b-9167-4e3c-bc64-7b1892074509 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:20.370892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325415e-3caa-4a79-a09b-4a4e47348452 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:20.371236 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325415e-3caa-4a79-a09b-4a4e47348452 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:20.371455 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325415e-3caa-4a79-a09b-4a4e47348452 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:20.373690 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 532/1045] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:52:20.378046 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a0d1d-68f0-43e7-a6e7-9a4e5ab2e617 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:20.378355 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a0d1d-68f0-43e7-a6e7-9a4e5ab2e617 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:20.378633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a0d1d-68f0-43e7-a6e7-9a4e5ab2e617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:20.389129 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35dd31-f24a-4c08-8694-0beeb10b3961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:20.389834 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35dd31-f24a-4c08-8694-0beeb10b3961 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:20.390120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35dd31-f24a-4c08-8694-0beeb10b3961 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:20.390396 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35dd31-f24a-4c08-8694-0beeb10b3961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:20.391248 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35dd31-f24a-4c08-8694-0beeb10b3961 None admin] RBAC: Adding query filter params (role.id=dd4f2c1c23cf4468a005cb46a039f660, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=c9e3c0ef5ed943d183b064f383fc01f3) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:20.391563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35dd31-f24a-4c08-8694-0beeb10b3961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:20.393017 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35dd31-f24a-4c08-8694-0beeb10b3961 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:20.396734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d91a0d1d-68f0-43e7-a6e7-9a4e5ab2e617 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:20.397980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d91a0d1d-68f0-43e7-a6e7-9a4e5ab2e617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:20.409684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 514/1046] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:52:20 2022] GET /identity/v3/role_assignments?user.id=c9e3c0ef5ed943d183b064f383fc01f3&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=dd4f2c1c23cf4468a005cb46a039f660 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:20.479009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 533/1047] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:52:20.502916 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35dd31-f24a-4c08-8694-0beeb10b3961 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:20.606770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:20.620483 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35dd31-f24a-4c08-8694-0beeb10b3961 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:20.655966 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d61fb8-83a8-4841-a3fc-5eb5970d228c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:20.656775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d61fb8-83a8-4841-a3fc-5eb5970d228c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:20.657056 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d61fb8-83a8-4841-a3fc-5eb5970d228c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:20.657330 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d61fb8-83a8-4841-a3fc-5eb5970d228c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:20.669126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d61fb8-83a8-4841-a3fc-5eb5970d228c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:52:20.677029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a8d61fb8-83a8-4841-a3fc-5eb5970d228c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:52:20.677029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:20.677029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:20.677029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:20.677029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:20.677029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:20.677029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:20.677029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:20.677029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:20.677029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:20.677029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:20.677029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:20.677029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:52:20.677029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:52:20.677029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:52:20.677029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:52:20.678119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:52:20.678119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:52:20.678119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:52:20.678119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:52:20.678119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:20.678119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:20.678119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:20.678119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:20.678119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:20.678119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:20.678119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:20.678119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:20.678119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:20.678119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:20.678119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:20.678119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:20.683801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:20.683801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:20.683801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:20.683801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:20.683801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:52:20.683801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:52:20.683801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:52:20.683801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:52:20.683801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:52:20.683801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:52:20.683801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:52:20.683801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:20.683801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 515/1048] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:52:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:20.686031 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a0d1d-68f0-43e7-a6e7-9a4e5ab2e617 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:20.724817 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d92ff-1b0e-4310-b953-2d349417335f None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:20.725120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d92ff-1b0e-4310-b953-2d349417335f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:20.725379 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d92ff-1b0e-4310-b953-2d349417335f None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:20.726814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 516/1049] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:52:20.731981 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2654d7-6bc6-441f-a7a7-73a87bd02f82 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:20.732203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2654d7-6bc6-441f-a7a7-73a87bd02f82 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:20.732475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2654d7-6bc6-441f-a7a7-73a87bd02f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:20.734382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:20.750116 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-db2654d7-6bc6-441f-a7a7-73a87bd02f82 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:20.751313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-db2654d7-6bc6-441f-a7a7-73a87bd02f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:20.800531 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a0d1d-68f0-43e7-a6e7-9a4e5ab2e617 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:20.840155 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b96f09-7ad3-462a-b1aa-67b55cc12b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:20.840832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b96f09-7ad3-462a-b1aa-67b55cc12b3f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:20.841118 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b96f09-7ad3-462a-b1aa-67b55cc12b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:20.841393 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b96f09-7ad3-462a-b1aa-67b55cc12b3f None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:20.845699 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b96f09-7ad3-462a-b1aa-67b55cc12b3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:20.845858 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 517/1050] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:52:20.845960 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b96f09-7ad3-462a-b1aa-67b55cc12b3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:20.845960 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b96f09-7ad3-462a-b1aa-67b55cc12b3f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:20.862015 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 534/1051] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:52:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:52:20.863830 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2654d7-6bc6-441f-a7a7-73a87bd02f82 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:20.865181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b96f09-7ad3-462a-b1aa-67b55cc12b3f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:20.955359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:20.971414 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:20.975498 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b96f09-7ad3-462a-b1aa-67b55cc12b3f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:20.983952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2654d7-6bc6-441f-a7a7-73a87bd02f82 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:21.013527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34390b50-36ca-43aa-a398-1cb9b1699e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:21.014658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34390b50-36ca-43aa-a398-1cb9b1699e0d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:21.015137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34390b50-36ca-43aa-a398-1cb9b1699e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:21.015413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34390b50-36ca-43aa-a398-1cb9b1699e0d None admin] PATH_INFO: `/v3/services/image` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:21.016078 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34390b50-36ca-43aa-a398-1cb9b1699e0d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:21.017448 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34390b50-36ca-43aa-a398-1cb9b1699e0d None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:21.023414 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0014c0-acff-4eb2-bac7-4813d621a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:21.024290 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0014c0-acff-4eb2-bac7-4813d621a8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:21.024626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0014c0-acff-4eb2-bac7-4813d621a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:21.024901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0014c0-acff-4eb2-bac7-4813d621a8e3 None admin] PATH_INFO: `/v3/users/82c3c651a0044bc5a9885e8879a76f77` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:21.030461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-34390b50-36ca-43aa-a398-1cb9b1699e0d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 18 16:52:21.030461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:21.030461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:52:21.030461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:52:21.030461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:52:21.030461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:52:21.030461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:52:21.030461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:21.030461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 16:52:21.030461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:21.030461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:52:21.030461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:21.030461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:21.030461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:21.030461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:21.030461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:21.030461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:21.031509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:21.031509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:21.031509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:21.031509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:21.031509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:21.031509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:21.031509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:52:21.031509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:52:21.031509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:52:21.031509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:52:21.031509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:21.031509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:21.031509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:21.031509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:21.031509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:21.031509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:21.032521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:21.032521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:21.032521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:21.032521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:21.032521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:21.032521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:21.032521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:21.032521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:21.032521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:21.032521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:21.032521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:52:21.032521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:52:21.032521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 18 16:52:21.032521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:21.032521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 535/1052] 10.222.0.49 () {56 vars in 1105 bytes} [Wed May 18 16:52:20 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:52:21.038352 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34390b50-36ca-43aa-a398-1cb9b1699e0d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:21.040405 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0014c0-acff-4eb2-bac7-4813d621a8e3 None admin] RBAC: Authorizing `identity:get_user(user_id=82c3c651a0044bc5a9885e8879a76f77)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:21.041896 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0014c0-acff-4eb2-bac7-4813d621a8e3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:21.048383 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 518/1053] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:52:20 2022] GET /identity/v3/users/82c3c651a0044bc5a9885e8879a76f77 => generated 285 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:21.049268 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0014c0-acff-4eb2-bac7-4813d621a8e3 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:21.155808 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34390b50-36ca-43aa-a398-1cb9b1699e0d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:21.165890 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0014c0-acff-4eb2-bac7-4813d621a8e3 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:21.197467 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15605762-22f7-433e-a929-d4e736163bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:21.198525 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15605762-22f7-433e-a929-d4e736163bdd None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:21.198993 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15605762-22f7-433e-a929-d4e736163bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:21.199472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15605762-22f7-433e-a929-d4e736163bdd None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:21.200381 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15605762-22f7-433e-a929-d4e736163bdd None admin] RBAC: Adding query filter params (name=image) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:21.200880 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15605762-22f7-433e-a929-d4e736163bdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:21.201727 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8979d-d830-4a3b-8ba5-d3913ff40914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:21.202376 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8979d-d830-4a3b-8ba5-d3913ff40914 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:21.202656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8979d-d830-4a3b-8ba5-d3913ff40914 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:21.202925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8979d-d830-4a3b-8ba5-d3913ff40914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:21.203327 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15605762-22f7-433e-a929-d4e736163bdd None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:21.207520 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:21.210865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 536/1054] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:21.216478 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15605762-22f7-433e-a929-d4e736163bdd None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:21.248288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:21.289258 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8979d-d830-4a3b-8ba5-d3913ff40914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:21.291079 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8979d-d830-4a3b-8ba5-d3913ff40914 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:21.338919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15605762-22f7-433e-a929-d4e736163bdd None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:21.381802 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40502751-7646-4446-bcfe-32f8152e7406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:21.382481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40502751-7646-4446-bcfe-32f8152e7406 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:21.382942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40502751-7646-4446-bcfe-32f8152e7406 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:21.383048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40502751-7646-4446-bcfe-32f8152e7406 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:21.383773 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40502751-7646-4446-bcfe-32f8152e7406 None admin] RBAC: Adding query filter params (type=image) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:21.384078 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40502751-7646-4446-bcfe-32f8152e7406 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:21.385449 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40502751-7646-4446-bcfe-32f8152e7406 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:21.396519 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 537/1055] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:52:21.397697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40502751-7646-4446-bcfe-32f8152e7406 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:21.413534 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 519/1056] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:52:21 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 16:52:21.419457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8979d-d830-4a3b-8ba5-d3913ff40914 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:21.466992 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:21.502223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:21.513564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40502751-7646-4446-bcfe-32f8152e7406 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:21.548493 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8979d-d830-4a3b-8ba5-d3913ff40914 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:21.557955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be62d1-0526-4299-9341-52f8f6eec1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:21.558633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be62d1-0526-4299-9341-52f8f6eec1fc None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:21.558924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be62d1-0526-4299-9341-52f8f6eec1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:21.559208 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be62d1-0526-4299-9341-52f8f6eec1fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:21.559967 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be62d1-0526-4299-9341-52f8f6eec1fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:21.561358 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be62d1-0526-4299-9341-52f8f6eec1fc None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:21.593416 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 538/1057] 10.222.0.49 () {60 vars in 1144 bytes} [Wed May 18 16:52:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 16:52:21.609559 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf287c-ec3d-47d7-b52f-f307653d8ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:21.610474 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf287c-ec3d-47d7-b52f-f307653d8ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:21.610756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf287c-ec3d-47d7-b52f-f307653d8ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:21.611034 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf287c-ec3d-47d7-b52f-f307653d8ad9 None admin] PATH_INFO: `/v3/projects/5919823a514f4cd18755fddacf33eab4` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:21.612337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf287c-ec3d-47d7-b52f-f307653d8ad9 None admin] RBAC: Authorizing `identity:get_project(project_id=5919823a514f4cd18755fddacf33eab4)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:21.614411 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf287c-ec3d-47d7-b52f-f307653d8ad9 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:21.616355 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 520/1058] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:52:21 2022] GET /identity/v3/projects/5919823a514f4cd18755fddacf33eab4 => generated 311 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:52:21.622768 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be62d1-0526-4299-9341-52f8f6eec1fc None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:21.747372 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be62d1-0526-4299-9341-52f8f6eec1fc None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:21.796130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aed906-0a2e-44db-86d4-ae1380ea407e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:21.797045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aed906-0a2e-44db-86d4-ae1380ea407e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:21.797477 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aed906-0a2e-44db-86d4-ae1380ea407e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:21.797895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aed906-0a2e-44db-86d4-ae1380ea407e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:21.799246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aed906-0a2e-44db-86d4-ae1380ea407e None admin] RBAC: Adding query filter params (role.id=b3f3f4910bf646699f30b749edeef422, scope.project.id=5919823a514f4cd18755fddacf33eab4, user.id=82c3c651a0044bc5a9885e8879a76f77) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:21.799729 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aed906-0a2e-44db-86d4-ae1380ea407e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:21.802110 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aed906-0a2e-44db-86d4-ae1380ea407e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:21.811354 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 539/1059] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:52:21 2022] GET /identity/v3/role_assignments?user.id=82c3c651a0044bc5a9885e8879a76f77&scope.project.id=5919823a514f4cd18755fddacf33eab4&role.id=b3f3f4910bf646699f30b749edeef422 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:22.687532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c568a57-c5df-49f2-8b4b-44b9edd666ce None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:22.688082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c568a57-c5df-49f2-8b4b-44b9edd666ce None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:22.688082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c568a57-c5df-49f2-8b4b-44b9edd666ce None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:22.689596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 521/1060] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:22.695524 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c44cca-4dc7-477c-a74c-4dd53f80ee3d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:22.696234 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c44cca-4dc7-477c-a74c-4dd53f80ee3d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:22.696234 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c44cca-4dc7-477c-a74c-4dd53f80ee3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:22.713743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-37c44cca-4dc7-477c-a74c-4dd53f80ee3d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:22.714932 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-37c44cca-4dc7-477c-a74c-4dd53f80ee3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:22.722729 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:22.786222 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 540/1061] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:52:22.809141 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c568a57-c5df-49f2-8b4b-44b9edd666ce None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:22.918686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:22.924978 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c568a57-c5df-49f2-8b4b-44b9edd666ce None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:22.963828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da38ddc-7ade-40d3-8ae7-96935a1b675b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:22.964570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da38ddc-7ade-40d3-8ae7-96935a1b675b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:22.964855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da38ddc-7ade-40d3-8ae7-96935a1b675b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:22.965130 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da38ddc-7ade-40d3-8ae7-96935a1b675b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:22.976203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da38ddc-7ade-40d3-8ae7-96935a1b675b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:52:22.984478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-6da38ddc-7ade-40d3-8ae7-96935a1b675b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 16:52:22.984478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:22.984478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:22.984478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:22.984478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:22.984478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:22.984478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:22.984478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:22.984478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:22.984478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:22.984478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:22.984478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:22.984478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:52:22.984478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:52:22.984478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:52:22.984478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:52:22.985442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:52:22.985442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:52:22.985442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:52:22.985442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:52:22.985442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:22.985442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:22.985442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:22.985442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:22.985442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:22.985442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:22.985442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:22.985442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:22.985442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:22.985442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:22.985442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:22.985442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:22.986988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:22.986988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:22.986988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:22.986988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:22.986988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:52:22.986988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:52:22.986988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:52:22.986988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:52:22.986988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:52:22.986988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:52:22.986988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 16:52:22.986988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:22.986988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 522/1062] 10.222.0.49 () {56 vars in 1120 bytes} [Wed May 18 16:52:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:22.993634 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c44cca-4dc7-477c-a74c-4dd53f80ee3d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:23.105344 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c44cca-4dc7-477c-a74c-4dd53f80ee3d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:23.140039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c545b-0792-4d46-8ac5-4bb6d2318ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:23.140709 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c545b-0792-4d46-8ac5-4bb6d2318ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:23.140993 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c545b-0792-4d46-8ac5-4bb6d2318ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:23.141270 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c545b-0792-4d46-8ac5-4bb6d2318ce4 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:23.142054 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c545b-0792-4d46-8ac5-4bb6d2318ce4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:23.142506 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c545b-0792-4d46-8ac5-4bb6d2318ce4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:23.143886 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c545b-0792-4d46-8ac5-4bb6d2318ce4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:23.152718 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 541/1063] 10.222.0.49 () {56 vars in 1115 bytes} [Wed May 18 16:52:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:52:23.158320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da38ddc-7ade-40d3-8ae7-96935a1b675b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:23.263098 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da38ddc-7ade-40d3-8ae7-96935a1b675b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:23.297212 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5a038-8b6a-4321-9804-bafc8a105f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:23.298030 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5a038-8b6a-4321-9804-bafc8a105f88 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:23.298317 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5a038-8b6a-4321-9804-bafc8a105f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:23.298592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5a038-8b6a-4321-9804-bafc8a105f88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:23.310245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5a038-8b6a-4321-9804-bafc8a105f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:23.311703 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c5a038-8b6a-4321-9804-bafc8a105f88 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:23.329869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-b8c5a038-8b6a-4321-9804-bafc8a105f88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:23.329869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:23.329869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:23.329869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:23.329869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:23.329869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:23.329869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:23.329869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:23.329869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:23.329869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:23.329869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:23.329869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:23.329869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:52:23.329869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:52:23.329869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:52:23.331075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:52:23.331075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:23.331075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:23.331075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:23.331075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:23.331075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:23.331075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:23.331075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:23.331075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:23.331075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:23.331075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:23.331075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:23.331075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:23.331075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:23.331075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:23.331075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:23.331075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:23.332799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:52:23.332799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:52:23.332799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:23.332799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:23.332799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 523/1064] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:23.337100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c545b-0792-4d46-8ac5-4bb6d2318ce4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:23.341947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:23.447448 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c545b-0792-4d46-8ac5-4bb6d2318ce4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:23.484381 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda99f3-01b9-420e-800c-c2375fd13971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:23.485340 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda99f3-01b9-420e-800c-c2375fd13971 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:23.485810 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda99f3-01b9-420e-800c-c2375fd13971 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:23.486238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda99f3-01b9-420e-800c-c2375fd13971 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:23.487138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda99f3-01b9-420e-800c-c2375fd13971 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:23.487599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda99f3-01b9-420e-800c-c2375fd13971 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:23.489522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda99f3-01b9-420e-800c-c2375fd13971 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:23.503612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 542/1065] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:23.509501 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5a038-8b6a-4321-9804-bafc8a105f88 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:23.526274 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:23.622268 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5a038-8b6a-4321-9804-bafc8a105f88 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:23.658754 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94759a-5242-44ef-b5b4-bd0b2fca6487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:23.659545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94759a-5242-44ef-b5b4-bd0b2fca6487 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:23.659834 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94759a-5242-44ef-b5b4-bd0b2fca6487 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:23.660539 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94759a-5242-44ef-b5b4-bd0b2fca6487 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:23.669273 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94759a-5242-44ef-b5b4-bd0b2fca6487 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:23.670766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94759a-5242-44ef-b5b4-bd0b2fca6487 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:23.685296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-bd94759a-5242-44ef-b5b4-bd0b2fca6487 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 16:52:23.685296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:23.685296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:23.685296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:23.685296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:23.685296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:23.685296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:23.685296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:23.685296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:23.685296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:23.685296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:23.685296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:23.685296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:52:23.685296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:52:23.685296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:52:23.685296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:52:23.686349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:23.686349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:23.686349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:52:23.686349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:52:23.686349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:52:23.686349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:52:23.686349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:23.686349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:23.686349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:23.686349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:23.686349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:23.686349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:23.686349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:23.686349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:23.686349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:23.686349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:23.686349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:23.686349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:23.688334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:23.688334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:23.688334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:52:23.688334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:52:23.688334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:52:23.688334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:52:23.688334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:52:23.688334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:52:23.688334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 16:52:23.688334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:23.688334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 524/1066] 10.222.0.49 () {56 vars in 1093 bytes} [Wed May 18 16:52:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:23.692705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda99f3-01b9-420e-800c-c2375fd13971 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:23.758858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:23.801792 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda99f3-01b9-420e-800c-c2375fd13971 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:23.862547 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2aa722-4c09-4a28-b79d-95a4b9d5e076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:23.863248 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2aa722-4c09-4a28-b79d-95a4b9d5e076 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:23.863527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2aa722-4c09-4a28-b79d-95a4b9d5e076 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:23.863798 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2aa722-4c09-4a28-b79d-95a4b9d5e076 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:23.864774 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2aa722-4c09-4a28-b79d-95a4b9d5e076 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:23.865064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2aa722-4c09-4a28-b79d-95a4b9d5e076 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:23.866498 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2aa722-4c09-4a28-b79d-95a4b9d5e076 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:23.895395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 543/1067] 10.222.0.49 () {56 vars in 1133 bytes} [Wed May 18 16:52:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:23.896913 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94759a-5242-44ef-b5b4-bd0b2fca6487 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:23.977229 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:23.991155 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84d89f-cc64-4f4b-bd32-4a4d08afb4a2 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:23.991376 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84d89f-cc64-4f4b-bd32-4a4d08afb4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:23.991658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84d89f-cc64-4f4b-bd32-4a4d08afb4a2 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:23.993317 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 544/1068] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:23.998407 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2ec30-3a5a-4a95-8c68-1049771ed61c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:23.998705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2ec30-3a5a-4a95-8c68-1049771ed61c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:23.998992 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2ec30-3a5a-4a95-8c68-1049771ed61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:24.013615 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94759a-5242-44ef-b5b4-bd0b2fca6487 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:24.016710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4ba2ec30-3a5a-4a95-8c68-1049771ed61c None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:24.017943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4ba2ec30-3a5a-4a95-8c68-1049771ed61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:24.047681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6a796-48af-45d6-92a7-ecab7420e0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:24.048473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6a796-48af-45d6-92a7-ecab7420e0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:24.048755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6a796-48af-45d6-92a7-ecab7420e0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:24.049031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6a796-48af-45d6-92a7-ecab7420e0d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:24.060788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6a796-48af-45d6-92a7-ecab7420e0d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:24.062229 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6a796-48af-45d6-92a7-ecab7420e0d5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:24.079951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-4ec6a796-48af-45d6-92a7-ecab7420e0d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:24.079951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:24.079951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:24.079951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:24.079951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:24.079951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:24.079951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:24.079951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:24.079951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:24.079951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:24.079951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:24.079951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:24.079951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:52:24.079951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:52:24.079951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:52:24.081207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:52:24.081207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:24.081207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:24.081207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:24.081207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:24.081207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:24.081207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:24.081207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:24.081207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:24.081207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:24.081207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:24.081207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:24.081207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:24.081207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:24.081207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:24.081207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:24.081207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:24.082184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:52:24.082184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:52:24.082184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:24.082184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:24.082184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 525/1069] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:24.083094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1da527-ae26-463a-9a1b-e2b765b19387 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:24.083378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1da527-ae26-463a-9a1b-e2b765b19387 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:24.083658 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1da527-ae26-463a-9a1b-e2b765b19387 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:24.084931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 526/1070] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:24.087777 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1da527-ae26-463a-9a1b-e2b765b19387 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:24.094820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 545/1071] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:52:24.096322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1cddb-3721-4e0e-8f0f-da59bf5c36bc None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:24.096610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1cddb-3721-4e0e-8f0f-da59bf5c36bc None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:24.097240 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1cddb-3721-4e0e-8f0f-da59bf5c36bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:24.115771 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4cb1cddb-3721-4e0e-8f0f-da59bf5c36bc None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:24.117075 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4cb1cddb-3721-4e0e-8f0f-da59bf5c36bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:24.172057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:24.193399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1da527-ae26-463a-9a1b-e2b765b19387 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:24.195121 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 546/1072] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:24.195984 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1cddb-3721-4e0e-8f0f-da59bf5c36bc None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:24.223637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:24.236210 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230ac0a-ec5d-43f6-b0f8-c193a428658a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:24.236635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230ac0a-ec5d-43f6-b0f8-c193a428658a None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:24.236920 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230ac0a-ec5d-43f6-b0f8-c193a428658a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:24.237199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230ac0a-ec5d-43f6-b0f8-c193a428658a None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:24.237966 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230ac0a-ec5d-43f6-b0f8-c193a428658a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:24.238917 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230ac0a-ec5d-43f6-b0f8-c193a428658a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:24.240296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230ac0a-ec5d-43f6-b0f8-c193a428658a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:24.252631 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 527/1073] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:52:24.253333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230ac0a-ec5d-43f6-b0f8-c193a428658a None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:24.308589 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1cddb-3721-4e0e-8f0f-da59bf5c36bc None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:24.343145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3cd8b-c15f-48f6-9fba-fff6ae1757e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:24.343717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3cd8b-c15f-48f6-9fba-fff6ae1757e5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:24.344003 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3cd8b-c15f-48f6-9fba-fff6ae1757e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:24.344292 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3cd8b-c15f-48f6-9fba-fff6ae1757e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:24.352917 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230ac0a-ec5d-43f6-b0f8-c193a428658a None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:24.388592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02de4b-966a-46e4-8387-b69b5fe36ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:24.389362 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02de4b-966a-46e4-8387-b69b5fe36ffe None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:24.389647 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02de4b-966a-46e4-8387-b69b5fe36ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:24.389952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02de4b-966a-46e4-8387-b69b5fe36ffe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:24.395956 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:24.401535 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02de4b-966a-46e4-8387-b69b5fe36ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:52:24.409100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-fa02de4b-966a-46e4-8387-b69b5fe36ffe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:52:24.409100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:24.409100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:24.409100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:24.409100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:24.409100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:24.409100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:24.409100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:24.409100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:24.409100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:24.409100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:24.409100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:24.409100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:52:24.409100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:52:24.409100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:52:24.409100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:52:24.410828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:52:24.410828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:52:24.410828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:52:24.410828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:52:24.410828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:24.410828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:24.410828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:24.410828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:24.410828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:24.410828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:24.410828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:24.410828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:24.410828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:24.410828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:24.410828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:24.410828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:24.411987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:24.411987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:24.411987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:24.411987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:24.411987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:52:24.411987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:52:24.411987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:52:24.411987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:52:24.411987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:52:24.411987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:52:24.411987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:52:24.411987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:24.411987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 528/1074] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:52:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:24.412841 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02de4b-966a-46e4-8387-b69b5fe36ffe None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:24.419492 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3cd8b-c15f-48f6-9fba-fff6ae1757e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:24.420949 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3cd8b-c15f-48f6-9fba-fff6ae1757e5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:24.457880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:24.515373 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02de4b-966a-46e4-8387-b69b5fe36ffe None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:24.523999 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 547/1075] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:52:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 16:52:24.524846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3cd8b-c15f-48f6-9fba-fff6ae1757e5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:24.551217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e848e-3106-4089-8e2c-af9f897b8823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:24.552013 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e848e-3106-4089-8e2c-af9f897b8823 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:24.552558 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e848e-3106-4089-8e2c-af9f897b8823 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:24.552558 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e848e-3106-4089-8e2c-af9f897b8823 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:24.559286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e848e-3106-4089-8e2c-af9f897b8823 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:24.560718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e848e-3106-4089-8e2c-af9f897b8823 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:24.575101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1a7e848e-3106-4089-8e2c-af9f897b8823 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:52:24.575101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:24.575101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:24.575101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:24.575101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:24.575101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:24.575101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:24.575101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:24.575101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:24.575101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:24.575101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:24.575101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:24.575101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:52:24.575101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:52:24.575101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:52:24.576198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:52:24.576198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:24.576198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:24.576198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:24.576198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:24.576198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:24.576198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:24.576198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:24.576198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:24.576198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:24.576198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:24.576198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:24.576198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:24.576198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:24.576198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:24.576198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:24.576198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:24.577426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:52:24.577426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:52:24.577426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:52:24.577426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:52:24.577426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:52:24.577426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:52:24.577426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:52:24.577426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:24.577426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 529/1076] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:52:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:24.577426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e848e-3106-4089-8e2c-af9f897b8823 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:24.612191 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:24.631568 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3cd8b-c15f-48f6-9fba-fff6ae1757e5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:24.668151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d698d-78d4-47fe-a0f4-834fb0a5727c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:24.668826 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d698d-78d4-47fe-a0f4-834fb0a5727c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:24.669108 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d698d-78d4-47fe-a0f4-834fb0a5727c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:24.669382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d698d-78d4-47fe-a0f4-834fb0a5727c None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:24.670161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d698d-78d4-47fe-a0f4-834fb0a5727c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:24.670472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d698d-78d4-47fe-a0f4-834fb0a5727c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:24.671840 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d698d-78d4-47fe-a0f4-834fb0a5727c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:24.680576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 548/1077] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:52:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:24.681285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d698d-78d4-47fe-a0f4-834fb0a5727c None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:24.687995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e848e-3106-4089-8e2c-af9f897b8823 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:24.690453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:24.725585 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c35118-22a7-4a34-9378-4cbba1d8aa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:24.726402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c35118-22a7-4a34-9378-4cbba1d8aa95 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:24.726683 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c35118-22a7-4a34-9378-4cbba1d8aa95 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:24.726958 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c35118-22a7-4a34-9378-4cbba1d8aa95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:24.737273 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c35118-22a7-4a34-9378-4cbba1d8aa95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:24.739372 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c35118-22a7-4a34-9378-4cbba1d8aa95 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:24.756729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-f5c35118-22a7-4a34-9378-4cbba1d8aa95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:24.756729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:24.756729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:24.756729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:24.756729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:24.756729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:24.756729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:24.756729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:24.756729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:24.756729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:24.756729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:24.756729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:24.756729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:52:24.756729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:52:24.756729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:52:24.757859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:52:24.757859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:24.757859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:24.757859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:24.757859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:24.757859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:24.757859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:24.757859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:24.757859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:24.757859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:24.757859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:24.757859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:24.757859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:24.757859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:24.757859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:24.757859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:24.757859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:24.758814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:52:24.758814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:52:24.758814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:24.758814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:24.758814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 530/1078] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:24.759253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c35118-22a7-4a34-9378-4cbba1d8aa95 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:24.788690 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d698d-78d4-47fe-a0f4-834fb0a5727c None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:24.822633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843da7e9-8465-4675-ad3a-f5452c920dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:24.823379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843da7e9-8465-4675-ad3a-f5452c920dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:24.823609 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843da7e9-8465-4675-ad3a-f5452c920dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:24.823890 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843da7e9-8465-4675-ad3a-f5452c920dd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:24.824686 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843da7e9-8465-4675-ad3a-f5452c920dd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:24.825110 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843da7e9-8465-4675-ad3a-f5452c920dd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:24.826474 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843da7e9-8465-4675-ad3a-f5452c920dd0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:24.839751 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 549/1079] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:52:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:24.840661 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843da7e9-8465-4675-ad3a-f5452c920dd0 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:24.844906 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:24.868418 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c35118-22a7-4a34-9378-4cbba1d8aa95 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:24.902638 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811c45a-0ed0-4380-b6fa-dd273b6b0517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:24.903509 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811c45a-0ed0-4380-b6fa-dd273b6b0517 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:24.903794 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811c45a-0ed0-4380-b6fa-dd273b6b0517 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:24.904073 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811c45a-0ed0-4380-b6fa-dd273b6b0517 None admin] PATH_INFO: `/v3/users/82c3c651a0044bc5a9885e8879a76f77` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:24.905281 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811c45a-0ed0-4380-b6fa-dd273b6b0517 None admin] RBAC: Authorizing `identity:get_user(user_id=82c3c651a0044bc5a9885e8879a76f77)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:24.906785 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811c45a-0ed0-4380-b6fa-dd273b6b0517 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:24.908710 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 531/1080] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:52:24 2022] GET /identity/v3/users/82c3c651a0044bc5a9885e8879a76f77 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:24.909349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811c45a-0ed0-4380-b6fa-dd273b6b0517 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:24.935462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:24.948127 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843da7e9-8465-4675-ad3a-f5452c920dd0 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:24.982828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d599b1-2172-4e33-ae47-60a3b8836296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:24.983493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d599b1-2172-4e33-ae47-60a3b8836296 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:24.983775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d599b1-2172-4e33-ae47-60a3b8836296 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:24.984052 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d599b1-2172-4e33-ae47-60a3b8836296 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:24.984776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d599b1-2172-4e33-ae47-60a3b8836296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:24.985084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d599b1-2172-4e33-ae47-60a3b8836296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:24.986507 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d599b1-2172-4e33-ae47-60a3b8836296 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:24.997640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 550/1081] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:24.998462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d599b1-2172-4e33-ae47-60a3b8836296 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:25.021448 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811c45a-0ed0-4380-b6fa-dd273b6b0517 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:25.063341 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c0b66-0d9e-471e-9b89-652c3e340c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:25.064373 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c0b66-0d9e-471e-9b89-652c3e340c98 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:25.064726 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c0b66-0d9e-471e-9b89-652c3e340c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:25.065083 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c0b66-0d9e-471e-9b89-652c3e340c98 None admin] PATH_INFO: `/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/c9e3c0ef5ed943d183b064f383fc01f3/roles/dd4f2c1c23cf4468a005cb46a039f660` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:25.068496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c0b66-0d9e-471e-9b89-652c3e340c98 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcd3afbb3e384cb2939647002c60bbba, user_id=c9e3c0ef5ed943d183b064f383fc01f3, role_id=dd4f2c1c23cf4468a005cb46a039f660)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:25.069644 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c0b66-0d9e-471e-9b89-652c3e340c98 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:25.085536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:25.095435 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 532/1082] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:52:24 2022] PUT /identity/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/c9e3c0ef5ed943d183b064f383fc01f3/roles/dd4f2c1c23cf4468a005cb46a039f660 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:52:25.135708 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d599b1-2172-4e33-ae47-60a3b8836296 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:25.179020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca05c6-fe96-416e-b958-9fb9f78eed83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:25.179917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca05c6-fe96-416e-b958-9fb9f78eed83 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:25.180206 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca05c6-fe96-416e-b958-9fb9f78eed83 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:25.180591 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca05c6-fe96-416e-b958-9fb9f78eed83 None admin] PATH_INFO: `/v3/projects/5919823a514f4cd18755fddacf33eab4` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:25.181878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca05c6-fe96-416e-b958-9fb9f78eed83 None admin] RBAC: Authorizing `identity:get_project(project_id=5919823a514f4cd18755fddacf33eab4)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:25.183372 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca05c6-fe96-416e-b958-9fb9f78eed83 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:25.185407 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 551/1083] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:52:24 2022] GET /identity/v3/projects/5919823a514f4cd18755fddacf33eab4 => generated 311 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:25.191899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c0b66-0d9e-471e-9b89-652c3e340c98 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:25.299478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:25.319151 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c0b66-0d9e-471e-9b89-652c3e340c98 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:25.355415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6941ce3-829b-4859-85fe-de5fae60612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:25.356317 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6941ce3-829b-4859-85fe-de5fae60612a None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:25.356601 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6941ce3-829b-4859-85fe-de5fae60612a None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:25.356879 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6941ce3-829b-4859-85fe-de5fae60612a None admin] PATH_INFO: `/v3/projects/5919823a514f4cd18755fddacf33eab4/users/82c3c651a0044bc5a9885e8879a76f77/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:25.359823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6941ce3-829b-4859-85fe-de5fae60612a None admin] RBAC: Authorizing `identity:create_grant(project_id=5919823a514f4cd18755fddacf33eab4, user_id=82c3c651a0044bc5a9885e8879a76f77, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:25.361625 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6941ce3-829b-4859-85fe-de5fae60612a None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:25.377018 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 533/1084] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:52:25 2022] PUT /identity/v3/projects/5919823a514f4cd18755fddacf33eab4/users/82c3c651a0044bc5a9885e8879a76f77/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:52:27.329924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2c815-71e5-4eed-88df-0451e7fd7b41 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:27.330427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2c815-71e5-4eed-88df-0451e7fd7b41 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:27.330427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2c815-71e5-4eed-88df-0451e7fd7b41 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:27.332900 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 552/1085] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:27.338261 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48331acc-c6a0-4983-a8b9-f5ad52cf1d41 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:27.338691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48331acc-c6a0-4983-a8b9-f5ad52cf1d41 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:27.338817 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48331acc-c6a0-4983-a8b9-f5ad52cf1d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:27.355378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-48331acc-c6a0-4983-a8b9-f5ad52cf1d41 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:27.356563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-48331acc-c6a0-4983-a8b9-f5ad52cf1d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:27.422992 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 534/1086] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:27.448275 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2c815-71e5-4eed-88df-0451e7fd7b41 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:27.552031 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2c815-71e5-4eed-88df-0451e7fd7b41 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:27.581175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:27.586698 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be713d41-ffbd-4a4d-a733-36327e1c667e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:27.587506 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be713d41-ffbd-4a4d-a733-36327e1c667e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:27.587787 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be713d41-ffbd-4a4d-a733-36327e1c667e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:27.588055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be713d41-ffbd-4a4d-a733-36327e1c667e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:27.599409 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be713d41-ffbd-4a4d-a733-36327e1c667e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:52:27.607377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-be713d41-ffbd-4a4d-a733-36327e1c667e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 16:52:27.607377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:27.607377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:27.607377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:27.607377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:27.607377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:27.607377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:27.607377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:27.607377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:27.607377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:27.607377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:27.607377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:27.607377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:52:27.607377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:52:27.607377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:52:27.607377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:52:27.608517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:52:27.608517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:52:27.608517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:52:27.608517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:52:27.608517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:27.608517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:27.608517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:27.608517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:27.608517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:27.608517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:27.608517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:27.608517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:27.608517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:27.608517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:27.608517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:27.608517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:27.609405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:27.609405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:27.609405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:27.609405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:27.609405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:52:27.609405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:52:27.609405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:52:27.609405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:52:27.609405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:52:27.609405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:52:27.609405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 18 16:52:27.609405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:27.609405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 553/1087] 10.222.0.49 () {56 vars in 1120 bytes} [Wed May 18 16:52:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:27.614604 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709e2f8-c71a-44d6-8f8d-49f81e58d06c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:27.614893 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709e2f8-c71a-44d6-8f8d-49f81e58d06c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:27.615169 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709e2f8-c71a-44d6-8f8d-49f81e58d06c None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:27.615385 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be713d41-ffbd-4a4d-a733-36327e1c667e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:27.616547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 535/1088] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:27.621522 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224afeb7-c894-408e-a6f8-57f8598c58d5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:27.621835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224afeb7-c894-408e-a6f8-57f8598c58d5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:27.622117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224afeb7-c894-408e-a6f8-57f8598c58d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:27.639390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-224afeb7-c894-408e-a6f8-57f8598c58d5 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:27.640642 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-224afeb7-c894-408e-a6f8-57f8598c58d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:27.711000 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 536/1089] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:52:27.721707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be713d41-ffbd-4a4d-a733-36327e1c667e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:27.734154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224afeb7-c894-408e-a6f8-57f8598c58d5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:27.737203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:27.756676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09b360-509b-4583-ad13-d31cadf15bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:27.757330 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09b360-509b-4583-ad13-d31cadf15bce None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:27.757609 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09b360-509b-4583-ad13-d31cadf15bce None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:27.757916 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09b360-509b-4583-ad13-d31cadf15bce None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:27.758656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09b360-509b-4583-ad13-d31cadf15bce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:27.758956 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09b360-509b-4583-ad13-d31cadf15bce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:27.760318 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09b360-509b-4583-ad13-d31cadf15bce None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:27.768513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 554/1090] 10.222.0.49 () {56 vars in 1115 bytes} [Wed May 18 16:52:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:52:27.774478 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09b360-509b-4583-ad13-d31cadf15bce None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:27.829252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:27.840199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224afeb7-c894-408e-a6f8-57f8598c58d5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:27.875793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b804713-0e57-41f5-9d23-8ec98b995f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:27.876033 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09b360-509b-4583-ad13-d31cadf15bce None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:27.876580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b804713-0e57-41f5-9d23-8ec98b995f2d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:27.876856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b804713-0e57-41f5-9d23-8ec98b995f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:27.877125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b804713-0e57-41f5-9d23-8ec98b995f2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:27.888468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b804713-0e57-41f5-9d23-8ec98b995f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:52:27.896121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-6b804713-0e57-41f5-9d23-8ec98b995f2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:52:27.896121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:27.896121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:27.896121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:27.896121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:27.896121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:27.896121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:27.896121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:27.896121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:27.896121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:27.896121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:27.896121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:27.896121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:52:27.896121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:52:27.896121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:52:27.896121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:52:27.897213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:52:27.897213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:52:27.897213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:52:27.897213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:52:27.897213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:27.897213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:27.897213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:27.897213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:27.897213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:27.897213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:27.897213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:27.897213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:27.897213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:27.897213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:27.897213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:27.897213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:27.898426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:27.898426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:27.898426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:27.898426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:27.898426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:52:27.898426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:52:27.898426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:52:27.898426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:52:27.898426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:52:27.898426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:52:27.898426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:52:27.898426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:27.898426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 537/1091] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:52:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:52:27.903209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b804713-0e57-41f5-9d23-8ec98b995f2d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:27.914579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcdb0e-9c38-4eed-a2f7-f6de58cf8b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:27.915376 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcdb0e-9c38-4eed-a2f7-f6de58cf8b1f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:27.915658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcdb0e-9c38-4eed-a2f7-f6de58cf8b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:27.915938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcdb0e-9c38-4eed-a2f7-f6de58cf8b1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:27.927581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcdb0e-9c38-4eed-a2f7-f6de58cf8b1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:27.929198 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcdb0e-9c38-4eed-a2f7-f6de58cf8b1f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:27.947064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-1bfcdb0e-9c38-4eed-a2f7-f6de58cf8b1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:27.947064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:27.947064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:27.947064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:27.947064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:27.947064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:27.947064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:27.947064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:27.947064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:27.947064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:27.947064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:27.947064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:27.947064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:52:27.947064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:52:27.947064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:52:27.948025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:52:27.948025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:27.948025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:27.948025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:27.948025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:27.948025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:27.948025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:27.948025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:27.948025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:27.948025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:27.948025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:27.948025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:27.948025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:27.948025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:27.948025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:27.948025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:27.948025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:27.948947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:52:27.948947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:52:27.948947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:27.948947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:27.948947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 555/1092] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:52:27.953857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcdb0e-9c38-4eed-a2f7-f6de58cf8b1f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:27.972141 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:28.011468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b804713-0e57-41f5-9d23-8ec98b995f2d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:28.045114 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac746a-3815-407f-a76b-f3eb9e0bde58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:28.045821 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac746a-3815-407f-a76b-f3eb9e0bde58 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:28.046110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac746a-3815-407f-a76b-f3eb9e0bde58 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:28.046390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac746a-3815-407f-a76b-f3eb9e0bde58 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:28.047143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac746a-3815-407f-a76b-f3eb9e0bde58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:28.047448 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac746a-3815-407f-a76b-f3eb9e0bde58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:28.048822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac746a-3815-407f-a76b-f3eb9e0bde58 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:28.055756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcdb0e-9c38-4eed-a2f7-f6de58cf8b1f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:28.058781 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 538/1093] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:52:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:52:28.064109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac746a-3815-407f-a76b-f3eb9e0bde58 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:28.065358 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:28.094044 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915f297-9d31-4dd0-b45d-2a245d3e01b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:28.094636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915f297-9d31-4dd0-b45d-2a245d3e01b9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:28.094942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915f297-9d31-4dd0-b45d-2a245d3e01b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:28.095207 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915f297-9d31-4dd0-b45d-2a245d3e01b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:28.095938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915f297-9d31-4dd0-b45d-2a245d3e01b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:28.096248 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915f297-9d31-4dd0-b45d-2a245d3e01b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:28.098167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915f297-9d31-4dd0-b45d-2a245d3e01b9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:28.110288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 556/1094] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:52:28.116427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915f297-9d31-4dd0-b45d-2a245d3e01b9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:28.165874 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac746a-3815-407f-a76b-f3eb9e0bde58 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:28.192598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:28.201762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b1b14-c77a-43b0-8c01-907824aea3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:28.202627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b1b14-c77a-43b0-8c01-907824aea3eb None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:28.202907 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b1b14-c77a-43b0-8c01-907824aea3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:28.203186 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b1b14-c77a-43b0-8c01-907824aea3eb None admin] PATH_INFO: `/v3/users/82c3c651a0044bc5a9885e8879a76f77` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:28.204454 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b1b14-c77a-43b0-8c01-907824aea3eb None admin] RBAC: Authorizing `identity:get_user(user_id=82c3c651a0044bc5a9885e8879a76f77)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:28.206202 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b1b14-c77a-43b0-8c01-907824aea3eb None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:28.213244 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 539/1095] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:52:28 2022] GET /identity/v3/users/82c3c651a0044bc5a9885e8879a76f77 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:52:28.214287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b1b14-c77a-43b0-8c01-907824aea3eb None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:28.225591 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915f297-9d31-4dd0-b45d-2a245d3e01b9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:28.263359 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410788d-0e68-43e4-b7d5-5df5b6a16f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:28.264159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410788d-0e68-43e4-b7d5-5df5b6a16f70 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:28.264453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410788d-0e68-43e4-b7d5-5df5b6a16f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:28.264734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410788d-0e68-43e4-b7d5-5df5b6a16f70 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:28.272868 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410788d-0e68-43e4-b7d5-5df5b6a16f70 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:28.274391 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410788d-0e68-43e4-b7d5-5df5b6a16f70 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:28.289493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-a410788d-0e68-43e4-b7d5-5df5b6a16f70 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 18 16:52:28.289493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:28.289493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:28.289493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:28.289493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:28.289493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:28.289493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:28.289493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:28.289493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:28.289493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:28.289493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:28.289493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:28.289493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:52:28.289493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:52:28.289493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:52:28.289493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:52:28.290702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:28.290702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:28.290702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:52:28.290702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:52:28.290702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:52:28.290702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:52:28.290702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:28.290702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:28.290702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:28.290702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:28.290702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:28.290702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:28.290702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:28.290702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:28.290702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:28.290702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:28.290702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:28.290702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:28.291671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:28.291671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:28.291671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:52:28.291671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:52:28.291671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:52:28.291671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:52:28.291671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:52:28.291671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:52:28.291671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 18 16:52:28.291671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:28.291671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 557/1096] 10.222.0.49 () {56 vars in 1093 bytes} [Wed May 18 16:52:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:52:28.296331 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410788d-0e68-43e4-b7d5-5df5b6a16f70 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:28.319062 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b1b14-c77a-43b0-8c01-907824aea3eb None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:28.324959 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:28.352089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8c950-71ec-4292-a5ed-302e1c1d0158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:28.352651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8c950-71ec-4292-a5ed-302e1c1d0158 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:28.352941 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8c950-71ec-4292-a5ed-302e1c1d0158 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:28.353213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8c950-71ec-4292-a5ed-302e1c1d0158 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:28.404268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410788d-0e68-43e4-b7d5-5df5b6a16f70 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:28.416666 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:28.424710 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8c950-71ec-4292-a5ed-302e1c1d0158 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:28.426785 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8c950-71ec-4292-a5ed-302e1c1d0158 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:28.439446 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386841a-c38c-4953-ae90-c7733e319178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:28.440154 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386841a-c38c-4953-ae90-c7733e319178 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:28.440443 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386841a-c38c-4953-ae90-c7733e319178 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:28.440721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386841a-c38c-4953-ae90-c7733e319178 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:28.442218 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386841a-c38c-4953-ae90-c7733e319178 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:28.442520 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386841a-c38c-4953-ae90-c7733e319178 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:28.443951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386841a-c38c-4953-ae90-c7733e319178 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:28.466408 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 558/1097] 10.222.0.49 () {56 vars in 1133 bytes} [Wed May 18 16:52:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:52:28.467459 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386841a-c38c-4953-ae90-c7733e319178 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:28.534585 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 540/1098] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:52:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 18 16:52:28.537474 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8c950-71ec-4292-a5ed-302e1c1d0158 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:28.553540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:28.569997 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386841a-c38c-4953-ae90-c7733e319178 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:28.606312 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9033411-b791-4c94-bc2e-aad072494e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:28.606881 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9033411-b791-4c94-bc2e-aad072494e32 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:28.607168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9033411-b791-4c94-bc2e-aad072494e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:28.607448 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9033411-b791-4c94-bc2e-aad072494e32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:28.631820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:28.639104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8c950-71ec-4292-a5ed-302e1c1d0158 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:28.674025 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a04e58-6584-4c89-8151-5d68825d8b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:28.674879 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a04e58-6584-4c89-8151-5d68825d8b8f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:28.675161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a04e58-6584-4c89-8151-5d68825d8b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:28.675439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a04e58-6584-4c89-8151-5d68825d8b8f None admin] PATH_INFO: `/v3/projects/5919823a514f4cd18755fddacf33eab4` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:28.676617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a04e58-6584-4c89-8151-5d68825d8b8f None admin] RBAC: Authorizing `identity:get_project(project_id=5919823a514f4cd18755fddacf33eab4)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:28.678069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9033411-b791-4c94-bc2e-aad072494e32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:28.678185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a04e58-6584-4c89-8151-5d68825d8b8f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:28.679519 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9033411-b791-4c94-bc2e-aad072494e32 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:28.679781 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 541/1099] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:52:28 2022] GET /identity/v3/projects/5919823a514f4cd18755fddacf33eab4 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:28.685709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a04e58-6584-4c89-8151-5d68825d8b8f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:28.764930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:28.783224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 559/1100] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:52:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 18 16:52:28.788404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a04e58-6584-4c89-8151-5d68825d8b8f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:28.788767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9033411-b791-4c94-bc2e-aad072494e32 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:28.823362 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831964e1-cb92-4e38-8757-759ee152d70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:28.824018 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831964e1-cb92-4e38-8757-759ee152d70d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:28.824302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831964e1-cb92-4e38-8757-759ee152d70d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:28.824579 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831964e1-cb92-4e38-8757-759ee152d70d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:28.825413 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831964e1-cb92-4e38-8757-759ee152d70d None admin] RBAC: Adding query filter params (role.id=b3f3f4910bf646699f30b749edeef422, scope.project.id=5919823a514f4cd18755fddacf33eab4, user.id=82c3c651a0044bc5a9885e8879a76f77) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:28.825754 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831964e1-cb92-4e38-8757-759ee152d70d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:28.827194 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831964e1-cb92-4e38-8757-759ee152d70d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:28.834259 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 542/1101] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:52:28 2022] GET /identity/v3/role_assignments?user.id=82c3c651a0044bc5a9885e8879a76f77&scope.project.id=5919823a514f4cd18755fddacf33eab4&role.id=b3f3f4910bf646699f30b749edeef422 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:52:28.892817 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9033411-b791-4c94-bc2e-aad072494e32 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:28.931437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139535f-1b46-456f-bd3a-7293ce3842a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:28.932251 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139535f-1b46-456f-bd3a-7293ce3842a4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:28.932531 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139535f-1b46-456f-bd3a-7293ce3842a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:28.932801 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139535f-1b46-456f-bd3a-7293ce3842a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:28.944472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139535f-1b46-456f-bd3a-7293ce3842a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:28.945994 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139535f-1b46-456f-bd3a-7293ce3842a4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:28.964982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-c139535f-1b46-456f-bd3a-7293ce3842a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:28.964982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:28.964982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:28.964982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:28.964982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:28.964982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:28.964982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:28.964982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:28.964982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:28.964982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:28.964982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:28.964982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:28.964982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:52:28.964982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:52:28.964982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:52:28.966252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:52:28.966252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:28.966252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:28.966252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:28.966252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:28.966252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:28.966252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:28.966252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:28.966252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:28.966252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:28.966252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:28.966252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:28.966252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:28.966252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:28.966252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:28.966252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:28.966252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:28.967178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:52:28.967178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:52:28.967178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:52:28.967178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:28.967178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 560/1102] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:52:28.972145 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831964e1-cb92-4e38-8757-759ee152d70d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:29.000401 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:29.077111 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831964e1-cb92-4e38-8757-759ee152d70d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:29.110537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bc968-df6c-4b72-9d31-0d154c54b291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:29.111211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bc968-df6c-4b72-9d31-0d154c54b291 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:29.111494 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bc968-df6c-4b72-9d31-0d154c54b291 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:29.111771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bc968-df6c-4b72-9d31-0d154c54b291 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:29.112506 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bc968-df6c-4b72-9d31-0d154c54b291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:29.112812 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bc968-df6c-4b72-9d31-0d154c54b291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:29.115317 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bc968-df6c-4b72-9d31-0d154c54b291 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:29.126571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 543/1103] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:29.132821 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139535f-1b46-456f-bd3a-7293ce3842a4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:29.167500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:29.236895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139535f-1b46-456f-bd3a-7293ce3842a4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:29.272653 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f5522-953b-4729-8be0-241a56523528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:29.273445 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f5522-953b-4729-8be0-241a56523528 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:29.273752 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f5522-953b-4729-8be0-241a56523528 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:29.274024 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f5522-953b-4729-8be0-241a56523528 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:29.280767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f5522-953b-4729-8be0-241a56523528 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:29.282261 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f5522-953b-4729-8be0-241a56523528 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:29.295650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-983f5522-953b-4729-8be0-241a56523528 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:52:29.295650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:29.295650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:29.295650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:29.295650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:29.295650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:29.295650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:29.295650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:29.295650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:29.295650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:29.295650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:29.295650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:29.295650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:52:29.295650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:52:29.295650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:52:29.296532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:52:29.296532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:29.296532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:29.296532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:29.296532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:29.296532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:29.296532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:29.296532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:29.296532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:29.296532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:29.296532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:29.296532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:29.296532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:29.296532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:29.296532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:29.296532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:29.296532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:29.297437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:52:29.297437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:52:29.297437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:52:29.297437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:52:29.297437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:52:29.297437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:52:29.297437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:52:29.297437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:29.297437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 561/1104] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:52:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:52:29.303275 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bc968-df6c-4b72-9d31-0d154c54b291 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:29.388509 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:29.404090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bc968-df6c-4b72-9d31-0d154c54b291 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:29.438053 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093644a-c139-4e8f-a186-738cae1f222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:29.438630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093644a-c139-4e8f-a186-738cae1f222d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:29.438909 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093644a-c139-4e8f-a186-738cae1f222d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:29.439182 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093644a-c139-4e8f-a186-738cae1f222d None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:29.439968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093644a-c139-4e8f-a186-738cae1f222d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:29.440276 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093644a-c139-4e8f-a186-738cae1f222d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:29.442344 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093644a-c139-4e8f-a186-738cae1f222d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:29.454838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 544/1105] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:52:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:29.461947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f5522-953b-4729-8be0-241a56523528 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:29.554182 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:29.560869 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f5522-953b-4729-8be0-241a56523528 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:29.596635 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9806b33-1e48-477b-b491-02f3a38f4f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:29.597329 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9806b33-1e48-477b-b491-02f3a38f4f0c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:29.598103 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9806b33-1e48-477b-b491-02f3a38f4f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:29.598103 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9806b33-1e48-477b-b491-02f3a38f4f0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:29.598824 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9806b33-1e48-477b-b491-02f3a38f4f0c None admin] RBAC: Adding query filter params (role.id=dd4f2c1c23cf4468a005cb46a039f660, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=c9e3c0ef5ed943d183b064f383fc01f3) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:29.599137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9806b33-1e48-477b-b491-02f3a38f4f0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:29.600561 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9806b33-1e48-477b-b491-02f3a38f4f0c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:29.606756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 562/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:52:29 2022] GET /identity/v3/role_assignments?user.id=c9e3c0ef5ed943d183b064f383fc01f3&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=dd4f2c1c23cf4468a005cb46a039f660 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:31.098281 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf1c09-3c15-41b8-98dc-21ef4dd89e50 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:31.098773 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf1c09-3c15-41b8-98dc-21ef4dd89e50 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:31.098879 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf1c09-3c15-41b8-98dc-21ef4dd89e50 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:31.100227 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 545/1107] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:31.105451 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e391d0-674e-4568-9638-070e753c5b36 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:31.105893 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e391d0-674e-4568-9638-070e753c5b36 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:31.106043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e391d0-674e-4568-9638-070e753c5b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:31.122527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e2e391d0-674e-4568-9638-070e753c5b36 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:31.123734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e2e391d0-674e-4568-9638-070e753c5b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:31.190675 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 563/1108] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:31.216584 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf1c09-3c15-41b8-98dc-21ef4dd89e50 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:31.317694 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf1c09-3c15-41b8-98dc-21ef4dd89e50 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:31.351027 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d8391-ea3c-4f78-8a11-0a91d536b76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:31.351800 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d8391-ea3c-4f78-8a11-0a91d536b76b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:31.352081 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d8391-ea3c-4f78-8a11-0a91d536b76b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:31.352355 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d8391-ea3c-4f78-8a11-0a91d536b76b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:31.353512 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d8391-ea3c-4f78-8a11-0a91d536b76b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:31.354970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d8391-ea3c-4f78-8a11-0a91d536b76b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:31.356584 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 546/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:31.362323 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e391d0-674e-4568-9638-070e753c5b36 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:31.449890 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:31.460980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e391d0-674e-4568-9638-070e753c5b36 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:31.495206 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ee639-befa-4751-bbcd-9a54c98508b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:31.495867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ee639-befa-4751-bbcd-9a54c98508b6 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:31.496153 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ee639-befa-4751-bbcd-9a54c98508b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:31.496431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ee639-befa-4751-bbcd-9a54c98508b6 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:31.497137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ee639-befa-4751-bbcd-9a54c98508b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:31.498797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ee639-befa-4751-bbcd-9a54c98508b6 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:31.518209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 564/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 18 16:52:31 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:52:33.813010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbb579-9a55-4baf-bc97-9693adec08c9 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:33.813573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbb579-9a55-4baf-bc97-9693adec08c9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:33.813573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbb579-9a55-4baf-bc97-9693adec08c9 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:33.814970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 547/1111] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:33.820984 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64904aee-fd61-458a-89e9-a943e78d6fd9 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:33.821393 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64904aee-fd61-458a-89e9-a943e78d6fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:33.821535 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64904aee-fd61-458a-89e9-a943e78d6fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:33.838157 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-64904aee-fd61-458a-89e9-a943e78d6fd9 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:33.839330 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-64904aee-fd61-458a-89e9-a943e78d6fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:33.905633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 565/1112] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:33.930689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbb579-9a55-4baf-bc97-9693adec08c9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:33.946363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:34.031557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbb579-9a55-4baf-bc97-9693adec08c9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:34.066805 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e7e70-db7d-4b7a-a41c-6a199ed3be0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:34.067742 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e7e70-db7d-4b7a-a41c-6a199ed3be0f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:34.067837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e7e70-db7d-4b7a-a41c-6a199ed3be0f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:34.068109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e7e70-db7d-4b7a-a41c-6a199ed3be0f None admin] PATH_INFO: `/v3/roles/7a9281e8b95a43c58cf4d0c272dd1469` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:34.069588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e7e70-db7d-4b7a-a41c-6a199ed3be0f None admin] RBAC: Authorizing `identity:get_role(role_id=7a9281e8b95a43c58cf4d0c272dd1469)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:34.070991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e7e70-db7d-4b7a-a41c-6a199ed3be0f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:34.072370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 548/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:52:33 2022] GET /identity/v3/roles/7a9281e8b95a43c58cf4d0c272dd1469 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:34.078120 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64904aee-fd61-458a-89e9-a943e78d6fd9 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:34.152764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:34.180162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64904aee-fd61-458a-89e9-a943e78d6fd9 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:34.213141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed62c4-ca8b-4339-9022-11a7c98becaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:34.214033 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed62c4-ca8b-4339-9022-11a7c98becaf None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:34.214320 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed62c4-ca8b-4339-9022-11a7c98becaf None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:34.214592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed62c4-ca8b-4339-9022-11a7c98becaf None admin] PATH_INFO: `/v3/users/e3296fdee17a4038839a75b6bcaea95c` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:34.228193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed62c4-ca8b-4339-9022-11a7c98becaf None admin] RBAC: Authorizing `identity:get_user(user_id=e3296fdee17a4038839a75b6bcaea95c)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:34.229646 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed62c4-ca8b-4339-9022-11a7c98becaf None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:34.231367 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 566/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:52:34 2022] GET /identity/v3/users/e3296fdee17a4038839a75b6bcaea95c => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:34.237080 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e7e70-db7d-4b7a-a41c-6a199ed3be0f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:34.317425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:34.337550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e7e70-db7d-4b7a-a41c-6a199ed3be0f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:34.375851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c5c89-d20b-4a6b-970f-d0417c52898b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:34.376784 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c5c89-d20b-4a6b-970f-d0417c52898b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:34.377185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c5c89-d20b-4a6b-970f-d0417c52898b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:34.377452 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c5c89-d20b-4a6b-970f-d0417c52898b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:34.445296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c5c89-d20b-4a6b-970f-d0417c52898b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:34.446755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c5c89-d20b-4a6b-970f-d0417c52898b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:34.523920 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:34.542293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 549/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:52:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 16:52:34.548645 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed62c4-ca8b-4339-9022-11a7c98becaf None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:34.650127 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed62c4-ca8b-4339-9022-11a7c98becaf None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:34.685535 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba904ef2-8e65-4d0e-8d96-46a413e62a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:34.686426 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba904ef2-8e65-4d0e-8d96-46a413e62a95 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:34.686711 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba904ef2-8e65-4d0e-8d96-46a413e62a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:34.686988 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba904ef2-8e65-4d0e-8d96-46a413e62a95 None admin] PATH_INFO: `/v3/projects/5919823a514f4cd18755fddacf33eab4` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:34.688176 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba904ef2-8e65-4d0e-8d96-46a413e62a95 None admin] RBAC: Authorizing `identity:get_project(project_id=5919823a514f4cd18755fddacf33eab4)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:34.689630 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba904ef2-8e65-4d0e-8d96-46a413e62a95 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:34.691734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 567/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:52:34 2022] GET /identity/v3/projects/5919823a514f4cd18755fddacf33eab4 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:34.697865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c5c89-d20b-4a6b-970f-d0417c52898b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:34.795899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c5c89-d20b-4a6b-970f-d0417c52898b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:34.829900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db78004-8ad1-42b6-9762-284aad90ef14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:34.830797 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db78004-8ad1-42b6-9762-284aad90ef14 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:34.831092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db78004-8ad1-42b6-9762-284aad90ef14 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:34.831370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db78004-8ad1-42b6-9762-284aad90ef14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:34.832763 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db78004-8ad1-42b6-9762-284aad90ef14 None admin] RBAC: Adding query filter params (role.id=7a9281e8b95a43c58cf4d0c272dd1469, scope.project.id=5919823a514f4cd18755fddacf33eab4, user.id=e3296fdee17a4038839a75b6bcaea95c) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:34.833075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db78004-8ad1-42b6-9762-284aad90ef14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:34.834526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db78004-8ad1-42b6-9762-284aad90ef14 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:34.839930 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 550/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:52:34 2022] GET /identity/v3/role_assignments?user.id=e3296fdee17a4038839a75b6bcaea95c&scope.project.id=5919823a514f4cd18755fddacf33eab4&role.id=7a9281e8b95a43c58cf4d0c272dd1469 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:37.099429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f8906-75db-4b2a-8f9d-70a0e9b3f5b6 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:37.099927 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f8906-75db-4b2a-8f9d-70a0e9b3f5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:37.100020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f8906-75db-4b2a-8f9d-70a0e9b3f5b6 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:37.101333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 568/1118] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:37.106698 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3306b-b6dd-4976-85ee-5559713facc5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:37.107097 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3306b-b6dd-4976-85ee-5559713facc5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:37.107264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3306b-b6dd-4976-85ee-5559713facc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:37.123636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4cd3306b-b6dd-4976-85ee-5559713facc5 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:37.124820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4cd3306b-b6dd-4976-85ee-5559713facc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:37.166594 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:37.191648 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 551/1119] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:37.214890 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f8906-75db-4b2a-8f9d-70a0e9b3f5b6 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:37.217795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:37.325063 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f8906-75db-4b2a-8f9d-70a0e9b3f5b6 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:37.360430 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be24354-5288-4caf-8028-5369b790ed0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:37.361291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be24354-5288-4caf-8028-5369b790ed0c None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:37.361572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be24354-5288-4caf-8028-5369b790ed0c None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:37.361880 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be24354-5288-4caf-8028-5369b790ed0c None admin] PATH_INFO: `/v3/roles/7a9281e8b95a43c58cf4d0c272dd1469` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:37.363812 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be24354-5288-4caf-8028-5369b790ed0c None admin] RBAC: Authorizing `identity:get_role(role_id=7a9281e8b95a43c58cf4d0c272dd1469)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:37.365226 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be24354-5288-4caf-8028-5369b790ed0c None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:37.366703 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 569/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:52:37 2022] GET /identity/v3/roles/7a9281e8b95a43c58cf4d0c272dd1469 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:37.372861 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3306b-b6dd-4976-85ee-5559713facc5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:37.470321 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3306b-b6dd-4976-85ee-5559713facc5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:37.503804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6c7b0-343b-4642-8bf0-2bc8a9183a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:37.504798 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6c7b0-343b-4642-8bf0-2bc8a9183a8c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:37.505076 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6c7b0-343b-4642-8bf0-2bc8a9183a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:37.505342 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6c7b0-343b-4642-8bf0-2bc8a9183a8c None admin] PATH_INFO: `/v3/users/e3296fdee17a4038839a75b6bcaea95c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:37.506543 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6c7b0-343b-4642-8bf0-2bc8a9183a8c None admin] RBAC: Authorizing `identity:get_user(user_id=e3296fdee17a4038839a75b6bcaea95c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:37.507965 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6c7b0-343b-4642-8bf0-2bc8a9183a8c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:37.509596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 552/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:52:37 2022] GET /identity/v3/users/e3296fdee17a4038839a75b6bcaea95c => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:37.515540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be24354-5288-4caf-8028-5369b790ed0c None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:37.584760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:37.616290 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be24354-5288-4caf-8028-5369b790ed0c None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:37.652384 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc5df0-d93e-4be6-857f-b28b4b7e99c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:37.653254 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc5df0-d93e-4be6-857f-b28b4b7e99c3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:37.653533 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc5df0-d93e-4be6-857f-b28b4b7e99c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:37.653832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc5df0-d93e-4be6-857f-b28b4b7e99c3 None admin] PATH_INFO: `/v3/projects/5919823a514f4cd18755fddacf33eab4` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:37.655016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc5df0-d93e-4be6-857f-b28b4b7e99c3 None admin] RBAC: Authorizing `identity:get_project(project_id=5919823a514f4cd18755fddacf33eab4)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:37.656730 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc5df0-d93e-4be6-857f-b28b4b7e99c3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:37.658460 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 570/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:52:37 2022] GET /identity/v3/projects/5919823a514f4cd18755fddacf33eab4 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:37.665129 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6c7b0-343b-4642-8bf0-2bc8a9183a8c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:37.712716 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:37.765878 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6c7b0-343b-4642-8bf0-2bc8a9183a8c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:37.800826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8d74e-9dba-4f7d-a782-407889964fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:37.801763 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8d74e-9dba-4f7d-a782-407889964fd0 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:37.802050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8d74e-9dba-4f7d-a782-407889964fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:37.802326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8d74e-9dba-4f7d-a782-407889964fd0 None admin] PATH_INFO: `/v3/projects/5919823a514f4cd18755fddacf33eab4/users/e3296fdee17a4038839a75b6bcaea95c/roles/7a9281e8b95a43c58cf4d0c272dd1469` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:37.804686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8d74e-9dba-4f7d-a782-407889964fd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5919823a514f4cd18755fddacf33eab4, user_id=e3296fdee17a4038839a75b6bcaea95c, role_id=7a9281e8b95a43c58cf4d0c272dd1469)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:37.806162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8d74e-9dba-4f7d-a782-407889964fd0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:37.822154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 553/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:52:37 2022] PUT /identity/v3/projects/5919823a514f4cd18755fddacf33eab4/users/e3296fdee17a4038839a75b6bcaea95c/roles/7a9281e8b95a43c58cf4d0c272dd1469 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 16:52:40.046275 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680a1d8-f6c5-4c9e-8b77-6e4c9a683ff1 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:40.046840 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680a1d8-f6c5-4c9e-8b77-6e4c9a683ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:40.046840 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680a1d8-f6c5-4c9e-8b77-6e4c9a683ff1 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:40.048465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 571/1124] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:40.054052 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd68ce2-a49d-402f-ba78-857ff4304dd4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:40.054498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd68ce2-a49d-402f-ba78-857ff4304dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:40.054602 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd68ce2-a49d-402f-ba78-857ff4304dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:40.071843 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-cdd68ce2-a49d-402f-ba78-857ff4304dd4 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:40.073017 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cdd68ce2-a49d-402f-ba78-857ff4304dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:40.137594 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 554/1125] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:40.161331 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680a1d8-f6c5-4c9e-8b77-6e4c9a683ff1 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:40.260883 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680a1d8-f6c5-4c9e-8b77-6e4c9a683ff1 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:40.293449 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c65f6-ece6-495e-a754-82b925cb6f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:40.294319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c65f6-ece6-495e-a754-82b925cb6f0e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:40.294602 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c65f6-ece6-495e-a754-82b925cb6f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:40.294873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c65f6-ece6-495e-a754-82b925cb6f0e None admin] PATH_INFO: `/v3/roles/7a9281e8b95a43c58cf4d0c272dd1469` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:40.296366 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c65f6-ece6-495e-a754-82b925cb6f0e None admin] RBAC: Authorizing `identity:get_role(role_id=7a9281e8b95a43c58cf4d0c272dd1469)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:40.297702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c65f6-ece6-495e-a754-82b925cb6f0e None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:40.299056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 572/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:52:40 2022] GET /identity/v3/roles/7a9281e8b95a43c58cf4d0c272dd1469 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:40.305816 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd68ce2-a49d-402f-ba78-857ff4304dd4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:40.338798 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:40.406080 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd68ce2-a49d-402f-ba78-857ff4304dd4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:40.439606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d73b7-522f-4ecf-957a-1d44893c66e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:40.440469 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d73b7-522f-4ecf-957a-1d44893c66e5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:40.440780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d73b7-522f-4ecf-957a-1d44893c66e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:40.441622 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d73b7-522f-4ecf-957a-1d44893c66e5 None admin] PATH_INFO: `/v3/users/e3296fdee17a4038839a75b6bcaea95c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:40.442914 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d73b7-522f-4ecf-957a-1d44893c66e5 None admin] RBAC: Authorizing `identity:get_user(user_id=e3296fdee17a4038839a75b6bcaea95c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:40.444346 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d73b7-522f-4ecf-957a-1d44893c66e5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:40.446024 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 555/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:52:40 2022] GET /identity/v3/users/e3296fdee17a4038839a75b6bcaea95c => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:40.451865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c65f6-ece6-495e-a754-82b925cb6f0e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:40.460823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:40.555269 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c65f6-ece6-495e-a754-82b925cb6f0e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:40.588790 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728705ff-f915-4ad2-bed6-8d3237c9a5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:40.589427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728705ff-f915-4ad2-bed6-8d3237c9a5af None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:40.589734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728705ff-f915-4ad2-bed6-8d3237c9a5af None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:40.590012 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728705ff-f915-4ad2-bed6-8d3237c9a5af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:40.654821 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728705ff-f915-4ad2-bed6-8d3237c9a5af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:40.656271 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728705ff-f915-4ad2-bed6-8d3237c9a5af None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:40.664243 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:40.752944 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 573/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:52:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 16:52:40.759573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d73b7-522f-4ecf-957a-1d44893c66e5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:40.857228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d73b7-522f-4ecf-957a-1d44893c66e5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:40.858693 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:40.891799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f184f3-fad1-4f58-93f9-c1f37010c744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:40.892648 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f184f3-fad1-4f58-93f9-c1f37010c744 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:40.892935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f184f3-fad1-4f58-93f9-c1f37010c744 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:40.893213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f184f3-fad1-4f58-93f9-c1f37010c744 None admin] PATH_INFO: `/v3/projects/5919823a514f4cd18755fddacf33eab4` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:40.895091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f184f3-fad1-4f58-93f9-c1f37010c744 None admin] RBAC: Authorizing `identity:get_project(project_id=5919823a514f4cd18755fddacf33eab4)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:40.896523 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f184f3-fad1-4f58-93f9-c1f37010c744 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:40.898271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 556/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:52:40 2022] GET /identity/v3/projects/5919823a514f4cd18755fddacf33eab4 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:40.904379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728705ff-f915-4ad2-bed6-8d3237c9a5af None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:41.002204 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728705ff-f915-4ad2-bed6-8d3237c9a5af None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:41.011463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:41.045149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5cb37-94ea-488f-bea5-d44d6f628934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:41.045882 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5cb37-94ea-488f-bea5-d44d6f628934 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:41.046131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5cb37-94ea-488f-bea5-d44d6f628934 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:41.046440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5cb37-94ea-488f-bea5-d44d6f628934 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:41.047314 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5cb37-94ea-488f-bea5-d44d6f628934 None admin] RBAC: Adding query filter params (role.id=7a9281e8b95a43c58cf4d0c272dd1469, scope.project.id=5919823a514f4cd18755fddacf33eab4, user.id=e3296fdee17a4038839a75b6bcaea95c) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:41.047692 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5cb37-94ea-488f-bea5-d44d6f628934 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:41.049123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5cb37-94ea-488f-bea5-d44d6f628934 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:41.056901 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 574/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:52:40 2022] GET /identity/v3/role_assignments?user.id=e3296fdee17a4038839a75b6bcaea95c&scope.project.id=5919823a514f4cd18755fddacf33eab4&role.id=7a9281e8b95a43c58cf4d0c272dd1469 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:43.328433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa0dcf-07bb-4c50-9a77-3bf1fa5df2b3 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:43.328934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa0dcf-07bb-4c50-9a77-3bf1fa5df2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:43.328934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa0dcf-07bb-4c50-9a77-3bf1fa5df2b3 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:43.330311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 557/1131] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:43.336670 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df409c70-8586-4451-a226-34c983646f33 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:43.337131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df409c70-8586-4451-a226-34c983646f33 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:43.337222 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df409c70-8586-4451-a226-34c983646f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:43.355407 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-df409c70-8586-4451-a226-34c983646f33 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:43.356603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-df409c70-8586-4451-a226-34c983646f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:43.426466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 575/1132] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:43.450122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa0dcf-07bb-4c50-9a77-3bf1fa5df2b3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:43.557487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa0dcf-07bb-4c50-9a77-3bf1fa5df2b3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:43.593038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfee62e-5b1e-47f0-8b5e-6eabf2e23608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:43.593770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfee62e-5b1e-47f0-8b5e-6eabf2e23608 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:43.594058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfee62e-5b1e-47f0-8b5e-6eabf2e23608 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:43.594339 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfee62e-5b1e-47f0-8b5e-6eabf2e23608 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:43.595515 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfee62e-5b1e-47f0-8b5e-6eabf2e23608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:43.597039 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfee62e-5b1e-47f0-8b5e-6eabf2e23608 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:43.599271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 558/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:43.605219 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df409c70-8586-4451-a226-34c983646f33 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:43.698931 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:43.702008 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df409c70-8586-4451-a226-34c983646f33 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:43.737116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820394a9-73cc-41cc-83b6-dc6ebb458672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:43.738100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820394a9-73cc-41cc-83b6-dc6ebb458672 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:43.738100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820394a9-73cc-41cc-83b6-dc6ebb458672 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:43.738360 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820394a9-73cc-41cc-83b6-dc6ebb458672 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:43.739079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820394a9-73cc-41cc-83b6-dc6ebb458672 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:43.740502 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820394a9-73cc-41cc-83b6-dc6ebb458672 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:43.765306 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 576/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 18 16:52:43 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:52:46.035567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920c2d0-3a69-4db2-9298-a18924d38a2b None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:46.036100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920c2d0-3a69-4db2-9298-a18924d38a2b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:46.036100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920c2d0-3a69-4db2-9298-a18924d38a2b None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:46.037506 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 559/1135] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:46.042706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8285a-e370-45f8-9a64-74681fc4f9ce None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:46.043078 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8285a-e370-45f8-9a64-74681fc4f9ce None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:46.043270 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8285a-e370-45f8-9a64-74681fc4f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:46.059899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-add8285a-e370-45f8-9a64-74681fc4f9ce None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:46.061095 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-add8285a-e370-45f8-9a64-74681fc4f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:46.126619 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 577/1136] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:46.152585 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920c2d0-3a69-4db2-9298-a18924d38a2b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:46.194107 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:46.256535 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920c2d0-3a69-4db2-9298-a18924d38a2b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:46.291363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ba07c-3060-40ca-9130-236d5f0e8157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:46.292076 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ba07c-3060-40ca-9130-236d5f0e8157 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:46.292359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ba07c-3060-40ca-9130-236d5f0e8157 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:46.292640 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ba07c-3060-40ca-9130-236d5f0e8157 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:46.293844 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ba07c-3060-40ca-9130-236d5f0e8157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:46.295282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ba07c-3060-40ca-9130-236d5f0e8157 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:46.296913 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 560/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:52:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:46.303487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8285a-e370-45f8-9a64-74681fc4f9ce None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:46.382581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:46.401525 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8285a-e370-45f8-9a64-74681fc4f9ce None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:46.434702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db3cd9-3d70-448e-819b-875c77837067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:46.435369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db3cd9-3d70-448e-819b-875c77837067 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:46.435650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db3cd9-3d70-448e-819b-875c77837067 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:46.435922 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db3cd9-3d70-448e-819b-875c77837067 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:46.436631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db3cd9-3d70-448e-819b-875c77837067 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:46.438095 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db3cd9-3d70-448e-819b-875c77837067 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:46.458930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 578/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 18 16:52:46 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:52:48.716109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3452ec-eadf-4f0e-b995-39b669a6d4a5 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:48.716671 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3452ec-eadf-4f0e-b995-39b669a6d4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:48.716671 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3452ec-eadf-4f0e-b995-39b669a6d4a5 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:48.718046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 561/1139] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:48.724229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d2242-446e-430b-b688-73a09cac7cb6 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:48.724616 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d2242-446e-430b-b688-73a09cac7cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:48.724790 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d2242-446e-430b-b688-73a09cac7cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:48.741765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-624d2242-446e-430b-b688-73a09cac7cb6 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:48.742957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-624d2242-446e-430b-b688-73a09cac7cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:48.807889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 579/1140] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:48.831143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3452ec-eadf-4f0e-b995-39b669a6d4a5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:48.933001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3452ec-eadf-4f0e-b995-39b669a6d4a5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:48.940179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:48.968577 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb8d0c-8313-43c1-8768-880d3c3277a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:48.969300 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb8d0c-8313-43c1-8768-880d3c3277a4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:48.969583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb8d0c-8313-43c1-8768-880d3c3277a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:48.969900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb8d0c-8313-43c1-8768-880d3c3277a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:48.979964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb8d0c-8313-43c1-8768-880d3c3277a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:52:48.987546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-9ffb8d0c-8313-43c1-8768-880d3c3277a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:52:48.987546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:48.987546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:48.987546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:48.987546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:48.987546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:48.987546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:48.987546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:48.987546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:48.987546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:48.987546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:48.987546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:48.987546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:52:48.987546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:52:48.987546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:52:48.987546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:52:48.988721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:52:48.988721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:52:48.988721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:52:48.988721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:52:48.988721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:48.988721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:48.988721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:48.988721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:48.988721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:48.988721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:48.988721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:48.988721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:48.988721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:48.988721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:48.988721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:48.988721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:48.989791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:48.989791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:48.989791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:48.989791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:48.989791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:52:48.989791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:52:48.989791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:52:48.989791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:52:48.989791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:52:48.989791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:52:48.989791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:52:48.989791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:48.989791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 562/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:52:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:48.994840 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d2242-446e-430b-b688-73a09cac7cb6 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:49.061382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:49.099208 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d2242-446e-430b-b688-73a09cac7cb6 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:49.133993 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ca52c-12f6-4b8f-816b-f3a7988dab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:49.134661 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ca52c-12f6-4b8f-816b-f3a7988dab14 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:49.134946 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ca52c-12f6-4b8f-816b-f3a7988dab14 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:49.135222 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ca52c-12f6-4b8f-816b-f3a7988dab14 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:49.135972 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ca52c-12f6-4b8f-816b-f3a7988dab14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:49.136281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ca52c-12f6-4b8f-816b-f3a7988dab14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:49.137688 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ca52c-12f6-4b8f-816b-f3a7988dab14 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:49.146891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 580/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:52:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:49.152655 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb8d0c-8313-43c1-8768-880d3c3277a4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:49.252455 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb8d0c-8313-43c1-8768-880d3c3277a4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:49.288010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48496ea9-3961-427c-a257-2b551d7817f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:49.288877 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48496ea9-3961-427c-a257-2b551d7817f1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:49.289162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48496ea9-3961-427c-a257-2b551d7817f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:49.289439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48496ea9-3961-427c-a257-2b551d7817f1 None admin] PATH_INFO: `/v3/users/71e57457211745ebb0289c8ace63bd03` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:49.303200 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48496ea9-3961-427c-a257-2b551d7817f1 None admin] RBAC: Authorizing `identity:get_user(user_id=71e57457211745ebb0289c8ace63bd03)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:49.304648 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48496ea9-3961-427c-a257-2b551d7817f1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:49.306353 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 563/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:52:49 2022] GET /identity/v3/users/71e57457211745ebb0289c8ace63bd03 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:49.312100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ca52c-12f6-4b8f-816b-f3a7988dab14 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:49.415830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ca52c-12f6-4b8f-816b-f3a7988dab14 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:49.445040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:49.451080 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4b75e-86e1-4a3b-9b29-03c23369f3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:49.451728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4b75e-86e1-4a3b-9b29-03c23369f3db None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:49.452013 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4b75e-86e1-4a3b-9b29-03c23369f3db None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:49.452289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4b75e-86e1-4a3b-9b29-03c23369f3db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:49.519538 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4b75e-86e1-4a3b-9b29-03c23369f3db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:49.520913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4b75e-86e1-4a3b-9b29-03c23369f3db None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:49.618491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 581/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:52:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 16:52:49.624571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48496ea9-3961-427c-a257-2b551d7817f1 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:49.650236 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:49.726465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48496ea9-3961-427c-a257-2b551d7817f1 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:49.760842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c4728-51f0-49f5-b8a5-f3c9586530bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:49.761739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c4728-51f0-49f5-b8a5-f3c9586530bd None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:49.762021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c4728-51f0-49f5-b8a5-f3c9586530bd None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:49.762299 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c4728-51f0-49f5-b8a5-f3c9586530bd None admin] PATH_INFO: `/v3/projects/d2bce336f25e4b01afa2b34202422095` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:49.763501 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c4728-51f0-49f5-b8a5-f3c9586530bd None admin] RBAC: Authorizing `identity:get_project(project_id=d2bce336f25e4b01afa2b34202422095)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:49.764939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c4728-51f0-49f5-b8a5-f3c9586530bd None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:49.766745 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 564/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:52:49 2022] GET /identity/v3/projects/d2bce336f25e4b01afa2b34202422095 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:49.773191 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4b75e-86e1-4a3b-9b29-03c23369f3db None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:49.805801 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:49.895650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4b75e-86e1-4a3b-9b29-03c23369f3db None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:49.932961 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b276f-fdc1-4ad3-bc59-a1044840cb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:49.933608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b276f-fdc1-4ad3-bc59-a1044840cb37 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:49.933921 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b276f-fdc1-4ad3-bc59-a1044840cb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:49.934195 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b276f-fdc1-4ad3-bc59-a1044840cb37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:49.935019 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b276f-fdc1-4ad3-bc59-a1044840cb37 None admin] RBAC: Adding query filter params (role.id=b3f3f4910bf646699f30b749edeef422, scope.project.id=d2bce336f25e4b01afa2b34202422095, user.id=71e57457211745ebb0289c8ace63bd03) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:49.935326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b276f-fdc1-4ad3-bc59-a1044840cb37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:49.936745 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b276f-fdc1-4ad3-bc59-a1044840cb37 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:49.942138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 582/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:52:49 2022] GET /identity/v3/role_assignments?user.id=71e57457211745ebb0289c8ace63bd03&scope.project.id=d2bce336f25e4b01afa2b34202422095&role.id=b3f3f4910bf646699f30b749edeef422 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:52.161296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafed17f-353f-4083-a0c9-b3e2b3db9cd5 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:52.161910 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafed17f-353f-4083-a0c9-b3e2b3db9cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:52.161910 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafed17f-353f-4083-a0c9-b3e2b3db9cd5 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:52.163270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 565/1147] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:52.168895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799cd73-6a64-4f2b-a397-bbf6033e5193 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:52.169356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799cd73-6a64-4f2b-a397-bbf6033e5193 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:52.169453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799cd73-6a64-4f2b-a397-bbf6033e5193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:52.186561 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9799cd73-6a64-4f2b-a397-bbf6033e5193 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:52.187753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9799cd73-6a64-4f2b-a397-bbf6033e5193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:52.253418 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 583/1148] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:52.276832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafed17f-353f-4083-a0c9-b3e2b3db9cd5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:52.369974 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:52.379931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafed17f-353f-4083-a0c9-b3e2b3db9cd5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:52.413982 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97c264-06d1-4210-a755-7b3091cd7c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:52.414762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97c264-06d1-4210-a755-7b3091cd7c82 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:52.415044 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97c264-06d1-4210-a755-7b3091cd7c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:52.415318 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97c264-06d1-4210-a755-7b3091cd7c82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:52.425265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97c264-06d1-4210-a755-7b3091cd7c82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:52:52.432865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-dd97c264-06d1-4210-a755-7b3091cd7c82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:52:52.432865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:52.432865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:52.432865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:52.432865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:52.432865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:52.432865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:52.432865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:52.432865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:52.432865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:52.432865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:52.432865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:52.432865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:52:52.432865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:52:52.432865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:52:52.432865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:52:52.434106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:52:52.434106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:52:52.434106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:52:52.434106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:52:52.434106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:52.434106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:52.434106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:52.434106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:52.434106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:52.434106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:52.434106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:52.434106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:52.434106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:52.434106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:52.434106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:52.434106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:52.435412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:52.435412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:52.435412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:52.435412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:52.435412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:52:52.435412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:52:52.435412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:52:52.435412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:52:52.435412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:52:52.435412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:52:52.435412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:52:52.435412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:52.435412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 566/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:52:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:52.440154 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799cd73-6a64-4f2b-a397-bbf6033e5193 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:52.465257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:52.540522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799cd73-6a64-4f2b-a397-bbf6033e5193 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:52.573675 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641467c-857f-4590-83b0-d85f5e70cb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:52.574356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641467c-857f-4590-83b0-d85f5e70cb29 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:52.574640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641467c-857f-4590-83b0-d85f5e70cb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:52.574917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641467c-857f-4590-83b0-d85f5e70cb29 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:52.575660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641467c-857f-4590-83b0-d85f5e70cb29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:52.575966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641467c-857f-4590-83b0-d85f5e70cb29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:52.577340 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641467c-857f-4590-83b0-d85f5e70cb29 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:52.586032 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 584/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:52:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:52.591934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97c264-06d1-4210-a755-7b3091cd7c82 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:52.688488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97c264-06d1-4210-a755-7b3091cd7c82 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:52.721957 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4006d50-3831-434b-b960-4a98a4e487c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:52.722814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4006d50-3831-434b-b960-4a98a4e487c6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:52.723096 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4006d50-3831-434b-b960-4a98a4e487c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:52.723369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4006d50-3831-434b-b960-4a98a4e487c6 None admin] PATH_INFO: `/v3/users/71e57457211745ebb0289c8ace63bd03` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:52.724551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4006d50-3831-434b-b960-4a98a4e487c6 None admin] RBAC: Authorizing `identity:get_user(user_id=71e57457211745ebb0289c8ace63bd03)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:52.725996 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4006d50-3831-434b-b960-4a98a4e487c6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:52.727603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 567/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:52:52 2022] GET /identity/v3/users/71e57457211745ebb0289c8ace63bd03 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:52.733373 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641467c-857f-4590-83b0-d85f5e70cb29 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:52.817342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:52.833292 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641467c-857f-4590-83b0-d85f5e70cb29 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:52.866563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71250e6d-9735-4488-93f8-29178a1db20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:52.867424 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71250e6d-9735-4488-93f8-29178a1db20a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:52.867712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71250e6d-9735-4488-93f8-29178a1db20a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:52.867995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71250e6d-9735-4488-93f8-29178a1db20a None admin] PATH_INFO: `/v3/projects/d2bce336f25e4b01afa2b34202422095` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:52.869175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71250e6d-9735-4488-93f8-29178a1db20a None admin] RBAC: Authorizing `identity:get_project(project_id=d2bce336f25e4b01afa2b34202422095)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:52.870651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71250e6d-9735-4488-93f8-29178a1db20a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:52.872383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 585/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:52:52 2022] GET /identity/v3/projects/d2bce336f25e4b01afa2b34202422095 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:52.878947 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4006d50-3831-434b-b960-4a98a4e487c6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:52.905789 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:52.982734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4006d50-3831-434b-b960-4a98a4e487c6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:53.015460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b5e7f-ffe9-4966-adaa-e2cd027faddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:53.016335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b5e7f-ffe9-4966-adaa-e2cd027faddf None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:53.016617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b5e7f-ffe9-4966-adaa-e2cd027faddf None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:53.016890 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b5e7f-ffe9-4966-adaa-e2cd027faddf None admin] PATH_INFO: `/v3/projects/d2bce336f25e4b01afa2b34202422095/users/71e57457211745ebb0289c8ace63bd03/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:53.019465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b5e7f-ffe9-4966-adaa-e2cd027faddf None admin] RBAC: Authorizing `identity:create_grant(project_id=d2bce336f25e4b01afa2b34202422095, user_id=71e57457211745ebb0289c8ace63bd03, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:53.020940 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b5e7f-ffe9-4966-adaa-e2cd027faddf None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:53.033237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 568/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:52:52 2022] PUT /identity/v3/projects/d2bce336f25e4b01afa2b34202422095/users/71e57457211745ebb0289c8ace63bd03/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:52:55.289425 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d628e77-ea6d-4e25-9707-e54397492646 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:55.290121 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d628e77-ea6d-4e25-9707-e54397492646 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:55.290121 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d628e77-ea6d-4e25-9707-e54397492646 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:55.291382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 586/1154] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:55.296966 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c6ebf-eae0-4acf-8e32-05fed8c518cf None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:55.297376 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c6ebf-eae0-4acf-8e32-05fed8c518cf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:55.297529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c6ebf-eae0-4acf-8e32-05fed8c518cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:55.314866 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7a1c6ebf-eae0-4acf-8e32-05fed8c518cf None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:55.316120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7a1c6ebf-eae0-4acf-8e32-05fed8c518cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:55.384124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 569/1155] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:55.408045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d628e77-ea6d-4e25-9707-e54397492646 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:55.519779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d628e77-ea6d-4e25-9707-e54397492646 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:55.556041 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edb618-3b82-45d6-a6d5-29da24a42439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:55.556831 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edb618-3b82-45d6-a6d5-29da24a42439 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:55.557118 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edb618-3b82-45d6-a6d5-29da24a42439 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:55.557398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edb618-3b82-45d6-a6d5-29da24a42439 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:55.569832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edb618-3b82-45d6-a6d5-29da24a42439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:52:55.577626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-89edb618-3b82-45d6-a6d5-29da24a42439 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:52:55.577626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:55.577626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:55.577626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:55.577626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:55.577626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:55.577626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:55.577626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:55.577626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:55.577626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:55.577626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:55.577626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:55.577626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:52:55.577626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:52:55.577626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:52:55.577626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:52:55.578813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:52:55.578813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:52:55.578813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:52:55.578813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:52:55.578813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:55.578813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:55.578813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:55.578813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:55.578813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:55.578813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:55.578813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:55.578813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:52:55.578813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:55.578813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:55.578813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:55.578813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:55.579876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:55.579876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:55.579876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:55.579876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:55.579876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:52:55.579876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:52:55.579876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:52:55.579876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:52:55.579876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:52:55.579876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:52:55.579876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:52:55.579876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:52:55.579876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 587/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:52:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:55.585504 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c6ebf-eae0-4acf-8e32-05fed8c518cf None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:55.597203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:55.685274 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c6ebf-eae0-4acf-8e32-05fed8c518cf None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:55.719090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb715c-99ce-452a-86ec-b55d165f76bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:55.719749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb715c-99ce-452a-86ec-b55d165f76bc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:55.720028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb715c-99ce-452a-86ec-b55d165f76bc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:55.720303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb715c-99ce-452a-86ec-b55d165f76bc None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:55.721046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb715c-99ce-452a-86ec-b55d165f76bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:55.721348 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb715c-99ce-452a-86ec-b55d165f76bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:55.723262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb715c-99ce-452a-86ec-b55d165f76bc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:55.731199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 570/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:52:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:55.736981 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edb618-3b82-45d6-a6d5-29da24a42439 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:55.753028 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:55.836333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edb618-3b82-45d6-a6d5-29da24a42439 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:55.870994 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e3de2-adfb-4761-b2c2-e7effbaef7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:55.871866 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e3de2-adfb-4761-b2c2-e7effbaef7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:55.872147 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e3de2-adfb-4761-b2c2-e7effbaef7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:55.872421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e3de2-adfb-4761-b2c2-e7effbaef7c9 None admin] PATH_INFO: `/v3/users/71e57457211745ebb0289c8ace63bd03` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:55.873613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e3de2-adfb-4761-b2c2-e7effbaef7c9 None admin] RBAC: Authorizing `identity:get_user(user_id=71e57457211745ebb0289c8ace63bd03)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:55.875092 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e3de2-adfb-4761-b2c2-e7effbaef7c9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:55.876748 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 588/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:52:55 2022] GET /identity/v3/users/71e57457211745ebb0289c8ace63bd03 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:55.883040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb715c-99ce-452a-86ec-b55d165f76bc None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:55.954686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:55.985635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb715c-99ce-452a-86ec-b55d165f76bc None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:56.019162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96afab6-163b-49a4-850d-1dd53c009d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:56.019813 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96afab6-163b-49a4-850d-1dd53c009d12 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:56.020094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96afab6-163b-49a4-850d-1dd53c009d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:56.020370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96afab6-163b-49a4-850d-1dd53c009d12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:56.087331 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96afab6-163b-49a4-850d-1dd53c009d12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:56.088788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96afab6-163b-49a4-850d-1dd53c009d12 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:56.155673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:56.186431 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 571/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:52:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 16:52:56.192993 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e3de2-adfb-4761-b2c2-e7effbaef7c9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:56.274544 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:56.292869 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e3de2-adfb-4761-b2c2-e7effbaef7c9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:56.325350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f631c-7c51-47aa-b43a-3418761496ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:56.326225 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f631c-7c51-47aa-b43a-3418761496ad None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:56.326511 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f631c-7c51-47aa-b43a-3418761496ad None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:56.326780 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f631c-7c51-47aa-b43a-3418761496ad None admin] PATH_INFO: `/v3/projects/d2bce336f25e4b01afa2b34202422095` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:56.327935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f631c-7c51-47aa-b43a-3418761496ad None admin] RBAC: Authorizing `identity:get_project(project_id=d2bce336f25e4b01afa2b34202422095)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:56.329377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f631c-7c51-47aa-b43a-3418761496ad None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:56.331898 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 589/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:52:56 2022] GET /identity/v3/projects/d2bce336f25e4b01afa2b34202422095 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:56.338182 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96afab6-163b-49a4-850d-1dd53c009d12 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:56.437773 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96afab6-163b-49a4-850d-1dd53c009d12 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:56.474273 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c4ead-7c25-4b81-85c1-4f58ebde65ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:56.474926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c4ead-7c25-4b81-85c1-4f58ebde65ac None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:56.475209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c4ead-7c25-4b81-85c1-4f58ebde65ac None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:56.475485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c4ead-7c25-4b81-85c1-4f58ebde65ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:56.476324 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c4ead-7c25-4b81-85c1-4f58ebde65ac None admin] RBAC: Adding query filter params (role.id=b3f3f4910bf646699f30b749edeef422, scope.project.id=d2bce336f25e4b01afa2b34202422095, user.id=71e57457211745ebb0289c8ace63bd03) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:56.476641 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c4ead-7c25-4b81-85c1-4f58ebde65ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:56.478213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c4ead-7c25-4b81-85c1-4f58ebde65ac None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:56.484176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 572/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:52:56 2022] GET /identity/v3/role_assignments?user.id=71e57457211745ebb0289c8ace63bd03&scope.project.id=d2bce336f25e4b01afa2b34202422095&role.id=b3f3f4910bf646699f30b749edeef422 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:52:58.812707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f73ee-7f2a-4eae-997a-e2e328aeb2d6 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:58.813267 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f73ee-7f2a-4eae-997a-e2e328aeb2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:58.813267 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f73ee-7f2a-4eae-997a-e2e328aeb2d6 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:58.814947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 590/1162] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:52:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:52:58.821211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27953d4d-2fe9-4e06-ac91-d0aff2a218e4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:58.821688 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27953d4d-2fe9-4e06-ac91-d0aff2a218e4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:58.821789 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27953d4d-2fe9-4e06-ac91-d0aff2a218e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:58.840175 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-27953d4d-2fe9-4e06-ac91-d0aff2a218e4 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:52:58.841366 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-27953d4d-2fe9-4e06-ac91-d0aff2a218e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:52:58.871253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:58.914975 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 573/1163] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:52:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:52:58.937760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f73ee-7f2a-4eae-997a-e2e328aeb2d6 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:59.040217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f73ee-7f2a-4eae-997a-e2e328aeb2d6 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:59.074741 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19790ed0-316e-444c-8926-75e61456a2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:59.075383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19790ed0-316e-444c-8926-75e61456a2fc None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:59.075662 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19790ed0-316e-444c-8926-75e61456a2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:59.075935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19790ed0-316e-444c-8926-75e61456a2fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:59.093955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:59.141372 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19790ed0-316e-444c-8926-75e61456a2fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:59.142859 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19790ed0-316e-444c-8926-75e61456a2fc None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:59.239654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 591/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:52:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 16:52:59.245686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27953d4d-2fe9-4e06-ac91-d0aff2a218e4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:59.340908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27953d4d-2fe9-4e06-ac91-d0aff2a218e4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:59.373572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60c612-281b-4202-858d-a2e3da994f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:59.374384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60c612-281b-4202-858d-a2e3da994f27 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:59.374661 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60c612-281b-4202-858d-a2e3da994f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:59.374928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60c612-281b-4202-858d-a2e3da994f27 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:59.382095 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60c612-281b-4202-858d-a2e3da994f27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:59.383521 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60c612-281b-4202-858d-a2e3da994f27 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:59.397823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-5d60c612-281b-4202-858d-a2e3da994f27 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 18 16:52:59.397823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:59.397823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 18 16:52:59.397823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 18 16:52:59.397823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:52:59.397823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:52:59.397823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:52:59.397823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:52:59.397823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 18 16:52:59.397823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:59.397823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:52:59.397823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:59.397823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:52:59.397823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:52:59.397823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:52:59.397823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:52:59.397823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:52:59.399082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:52:59.399082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:52:59.399082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:52:59.399082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:52:59.399082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:52:59.399082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:52:59.399082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:52:59.399082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:52:59.399082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:52:59.399082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:52:59.399082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:52:59.399082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:52:59.399082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:52:59.399082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:52:59.399082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:52:59.399082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:52:59.400126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:52:59.400126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:52:59.400126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:52:59.400126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:52:59.400126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:52:59.400126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:52:59.400126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:52:59.400126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:52:59.400126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:52:59.400126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:52:59.400126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 18 16:52:59.400126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:52:59.400126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 18 16:52:59.400126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:52:59.400126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 574/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 18 16:52:59 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:52:59.405054 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19790ed0-316e-444c-8926-75e61456a2fc None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:52:59.454396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:52:59.503747 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19790ed0-316e-444c-8926-75e61456a2fc None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:52:59.538178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83ffc8-0919-40f5-8d01-37e8e36682a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:52:59.538838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83ffc8-0919-40f5-8d01-37e8e36682a9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:52:59.539117 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83ffc8-0919-40f5-8d01-37e8e36682a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:52:59.539393 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83ffc8-0919-40f5-8d01-37e8e36682a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:52:59.540115 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83ffc8-0919-40f5-8d01-37e8e36682a9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:52:59.540423 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83ffc8-0919-40f5-8d01-37e8e36682a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:52:59.541836 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83ffc8-0919-40f5-8d01-37e8e36682a9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:52:59.549049 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 592/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Wed May 18 16:52:59 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:53:01.779423 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4d925-3d76-4982-8410-7b28fd757e8d None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:01.779991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4d925-3d76-4982-8410-7b28fd757e8d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:01.779991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4d925-3d76-4982-8410-7b28fd757e8d None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:01.781352 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 575/1167] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:53:01.786888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c35abf-b7fd-4b5c-8114-42c7ecca824b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:01.787342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c35abf-b7fd-4b5c-8114-42c7ecca824b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:01.787442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c35abf-b7fd-4b5c-8114-42c7ecca824b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:01.804111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-03c35abf-b7fd-4b5c-8114-42c7ecca824b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:53:01.805388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-03c35abf-b7fd-4b5c-8114-42c7ecca824b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:53:01.871852 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 593/1168] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:53:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:53:01.896818 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4d925-3d76-4982-8410-7b28fd757e8d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:01.925359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:02.003288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4d925-3d76-4982-8410-7b28fd757e8d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:02.037201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d19ce7-bade-4709-9a70-a74806422706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:02.037824 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d19ce7-bade-4709-9a70-a74806422706 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:02.038113 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d19ce7-bade-4709-9a70-a74806422706 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:02.038391 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d19ce7-bade-4709-9a70-a74806422706 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:02.039150 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d19ce7-bade-4709-9a70-a74806422706 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:02.040518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d19ce7-bade-4709-9a70-a74806422706 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:02.056395 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 576/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Wed May 18 16:53:01 2022] POST /identity/v3/domains => generated 267 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:53:04.403983 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b133464-d46a-450a-81ba-55eb1064c040 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:04.404509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b133464-d46a-450a-81ba-55eb1064c040 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:04.404509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b133464-d46a-450a-81ba-55eb1064c040 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:04.405870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 594/1170] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:53:04.412140 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98b6a3-d990-4679-8b94-c7ec411dcad4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:04.412573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98b6a3-d990-4679-8b94-c7ec411dcad4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:04.412705 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98b6a3-d990-4679-8b94-c7ec411dcad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:04.430211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7c98b6a3-d990-4679-8b94-c7ec411dcad4 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:53:04.431412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7c98b6a3-d990-4679-8b94-c7ec411dcad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:53:04.498107 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 577/1171] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:53:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:53:04.521983 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b133464-d46a-450a-81ba-55eb1064c040 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:04.568753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:04.622892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b133464-d46a-450a-81ba-55eb1064c040 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:04.656108 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1757a-3f01-43fb-8e81-788a8e76c526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:04.656890 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1757a-3f01-43fb-8e81-788a8e76c526 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:04.657165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1757a-3f01-43fb-8e81-788a8e76c526 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:04.657432 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1757a-3f01-43fb-8e81-788a8e76c526 None admin] PATH_INFO: `/v3/domains/6e06b3854f994ac299c205f7c68ca795` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:04.668648 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1757a-3f01-43fb-8e81-788a8e76c526 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6e06b3854f994ac299c205f7c68ca795)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:04.670120 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1757a-3f01-43fb-8e81-788a8e76c526 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:04.671768 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 595/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Wed May 18 16:53:04 2022] GET /identity/v3/domains/6e06b3854f994ac299c205f7c68ca795 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:53:04.678284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98b6a3-d990-4679-8b94-c7ec411dcad4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:04.695231 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:04.776447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98b6a3-d990-4679-8b94-c7ec411dcad4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:04.812764 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ae1b0-2842-4341-b538-14a6b1db3918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:04.813417 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ae1b0-2842-4341-b538-14a6b1db3918 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:04.813720 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ae1b0-2842-4341-b538-14a6b1db3918 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:04.813996 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ae1b0-2842-4341-b538-14a6b1db3918 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:04.814695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ae1b0-2842-4341-b538-14a6b1db3918 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:04.816150 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ae1b0-2842-4341-b538-14a6b1db3918 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:04.841525 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 578/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 18 16:53:04 2022] POST /identity/v3/projects => generated 361 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:53:07.103493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982935e-07d8-4b03-9ae1-bc174c04e151 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:07.103968 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982935e-07d8-4b03-9ae1-bc174c04e151 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:07.104060 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982935e-07d8-4b03-9ae1-bc174c04e151 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:07.105446 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 596/1174] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:53:07.110851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95c0e0-bacf-4ba2-ba96-ee57eba28edb None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:07.111281 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95c0e0-bacf-4ba2-ba96-ee57eba28edb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:07.111412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95c0e0-bacf-4ba2-ba96-ee57eba28edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:07.128712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9d95c0e0-bacf-4ba2-ba96-ee57eba28edb None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:53:07.129941 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9d95c0e0-bacf-4ba2-ba96-ee57eba28edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:53:07.190382 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:07.196806 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 579/1175] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:53:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:53:07.222382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982935e-07d8-4b03-9ae1-bc174c04e151 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:07.326662 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982935e-07d8-4b03-9ae1-bc174c04e151 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:07.328900 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:07.362115 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68fcb4-4c55-4e0b-873c-ce4a739d2773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:07.363142 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68fcb4-4c55-4e0b-873c-ce4a739d2773 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:07.363428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68fcb4-4c55-4e0b-873c-ce4a739d2773 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:07.363705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68fcb4-4c55-4e0b-873c-ce4a739d2773 None admin] PATH_INFO: `/v3/domains/6e06b3854f994ac299c205f7c68ca795` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:07.364893 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68fcb4-4c55-4e0b-873c-ce4a739d2773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6e06b3854f994ac299c205f7c68ca795)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:07.366398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68fcb4-4c55-4e0b-873c-ce4a739d2773 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:07.368031 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 597/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Wed May 18 16:53:07 2022] GET /identity/v3/domains/6e06b3854f994ac299c205f7c68ca795 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:53:07.373899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95c0e0-bacf-4ba2-ba96-ee57eba28edb None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:07.470581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95c0e0-bacf-4ba2-ba96-ee57eba28edb None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:07.503610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5528f-830a-4714-a62b-69900689303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:07.504269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5528f-830a-4714-a62b-69900689303c None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:07.504551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5528f-830a-4714-a62b-69900689303c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:07.504822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5528f-830a-4714-a62b-69900689303c None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:07.505531 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5528f-830a-4714-a62b-69900689303c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:07.506988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5528f-830a-4714-a62b-69900689303c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:07.526254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 580/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 18 16:53:07 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:53:09.856836 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee3a3f-27bc-4b3e-8699-bce0f92981fa None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:09.857370 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee3a3f-27bc-4b3e-8699-bce0f92981fa None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:09.857370 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee3a3f-27bc-4b3e-8699-bce0f92981fa None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:09.858916 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 598/1178] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:53:09.864775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f328a9f-4c38-4327-ab5f-dd9a9764b19d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:09.865199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f328a9f-4c38-4327-ab5f-dd9a9764b19d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:09.865333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f328a9f-4c38-4327-ab5f-dd9a9764b19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:09.882563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3f328a9f-4c38-4327-ab5f-dd9a9764b19d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:53:09.883750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3f328a9f-4c38-4327-ab5f-dd9a9764b19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:53:09.932816 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:09.951091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 581/1179] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:53:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:53:09.975340 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee3a3f-27bc-4b3e-8699-bce0f92981fa None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:10.076946 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee3a3f-27bc-4b3e-8699-bce0f92981fa None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:10.110080 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270c385-9d66-4ac6-8e58-044158241b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:10.110797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270c385-9d66-4ac6-8e58-044158241b17 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:10.111075 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270c385-9d66-4ac6-8e58-044158241b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:10.111346 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270c385-9d66-4ac6-8e58-044158241b17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:10.122392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270c385-9d66-4ac6-8e58-044158241b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:53:10.130146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-e270c385-9d66-4ac6-8e58-044158241b17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:53:10.130146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:53:10.130146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:53:10.130146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:53:10.130146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:53:10.130146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:53:10.130146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:53:10.130146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:53:10.130146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:53:10.130146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:53:10.130146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:53:10.130146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:53:10.130146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:53:10.130146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:53:10.130146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:53:10.130146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:53:10.131257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:53:10.131257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:53:10.131257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:53:10.131257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:53:10.131257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:53:10.131257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:53:10.131257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:53:10.131257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:53:10.131257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:53:10.131257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:53:10.131257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:53:10.131257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:53:10.131257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:53:10.131257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:53:10.131257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:53:10.131257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:53:10.132165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:53:10.132165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:53:10.132165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:53:10.132165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:53:10.132165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:53:10.132165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:53:10.132165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:53:10.132165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:53:10.132165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:53:10.132165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:53:10.132165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:53:10.132165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:53:10.132165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 599/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:53:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:53:10.137370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f328a9f-4c38-4327-ab5f-dd9a9764b19d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:10.238192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f328a9f-4c38-4327-ab5f-dd9a9764b19d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:10.271335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf21c60-b256-4f69-8865-555abdbc9853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:10.272000 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf21c60-b256-4f69-8865-555abdbc9853 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:10.272287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf21c60-b256-4f69-8865-555abdbc9853 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:10.272563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf21c60-b256-4f69-8865-555abdbc9853 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:10.273310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf21c60-b256-4f69-8865-555abdbc9853 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:53:10.273617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf21c60-b256-4f69-8865-555abdbc9853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:10.275010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf21c60-b256-4f69-8865-555abdbc9853 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:10.282887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 582/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:53:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:53:10.289267 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270c385-9d66-4ac6-8e58-044158241b17 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:10.320269 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:10.387753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270c385-9d66-4ac6-8e58-044158241b17 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:10.422274 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2882a9c-2cd8-4a61-a40c-34e5bdf3bb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:10.423135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2882a9c-2cd8-4a61-a40c-34e5bdf3bb14 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:10.423417 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2882a9c-2cd8-4a61-a40c-34e5bdf3bb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:10.423750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2882a9c-2cd8-4a61-a40c-34e5bdf3bb14 None admin] PATH_INFO: `/v3/users/0fbee4629a0f411e9667a20643c81049` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:10.436712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2882a9c-2cd8-4a61-a40c-34e5bdf3bb14 None admin] RBAC: Authorizing `identity:get_user(user_id=0fbee4629a0f411e9667a20643c81049)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:10.438210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2882a9c-2cd8-4a61-a40c-34e5bdf3bb14 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:10.439866 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 600/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:53:10 2022] GET /identity/v3/users/0fbee4629a0f411e9667a20643c81049 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:53:10.445669 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf21c60-b256-4f69-8865-555abdbc9853 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:10.492166 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:10.546872 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf21c60-b256-4f69-8865-555abdbc9853 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:10.579607 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e45ca1-8979-49ca-bd36-8c77cf774542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:10.580251 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e45ca1-8979-49ca-bd36-8c77cf774542 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:10.580536 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e45ca1-8979-49ca-bd36-8c77cf774542 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:10.581339 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e45ca1-8979-49ca-bd36-8c77cf774542 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:10.647970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e45ca1-8979-49ca-bd36-8c77cf774542 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:10.649371 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e45ca1-8979-49ca-bd36-8c77cf774542 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:10.694851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:10.749981 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 583/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:53:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 16:53:10.756567 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2882a9c-2cd8-4a61-a40c-34e5bdf3bb14 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:10.845073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:10.855021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2882a9c-2cd8-4a61-a40c-34e5bdf3bb14 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:10.887699 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292cf61-a73f-4470-b6e6-0ec834fcd9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:10.888547 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292cf61-a73f-4470-b6e6-0ec834fcd9bb None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:10.888825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292cf61-a73f-4470-b6e6-0ec834fcd9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:10.889096 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292cf61-a73f-4470-b6e6-0ec834fcd9bb None admin] PATH_INFO: `/v3/projects/c73fcfb68f674064856f2c0008965a62` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:10.890308 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292cf61-a73f-4470-b6e6-0ec834fcd9bb None admin] RBAC: Authorizing `identity:get_project(project_id=c73fcfb68f674064856f2c0008965a62)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:10.891732 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292cf61-a73f-4470-b6e6-0ec834fcd9bb None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:10.894097 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 601/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:53:10 2022] GET /identity/v3/projects/c73fcfb68f674064856f2c0008965a62 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:53:10.900331 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e45ca1-8979-49ca-bd36-8c77cf774542 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:10.995762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e45ca1-8979-49ca-bd36-8c77cf774542 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:11.032566 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343e114-f05c-4c35-b76e-733c618f57ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:11.033215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343e114-f05c-4c35-b76e-733c618f57ac None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:11.033496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343e114-f05c-4c35-b76e-733c618f57ac None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:11.033844 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343e114-f05c-4c35-b76e-733c618f57ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:11.034787 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343e114-f05c-4c35-b76e-733c618f57ac None admin] RBAC: Adding query filter params (role.id=b3f3f4910bf646699f30b749edeef422, scope.project.id=c73fcfb68f674064856f2c0008965a62, user.id=0fbee4629a0f411e9667a20643c81049) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:53:11.035095 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343e114-f05c-4c35-b76e-733c618f57ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:11.036514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343e114-f05c-4c35-b76e-733c618f57ac None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:11.041965 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 584/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:53:10 2022] GET /identity/v3/role_assignments?user.id=0fbee4629a0f411e9667a20643c81049&scope.project.id=c73fcfb68f674064856f2c0008965a62&role.id=b3f3f4910bf646699f30b749edeef422 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:53:13.311209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc940280-d689-43b6-a32d-f198cde2d8c5 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:13.311724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc940280-d689-43b6-a32d-f198cde2d8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:13.311828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc940280-d689-43b6-a32d-f198cde2d8c5 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:13.313136 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 602/1186] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:53:13.319626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3afc5e-724f-4dd8-9aa2-f4b2c1ad195d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:13.320067 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3afc5e-724f-4dd8-9aa2-f4b2c1ad195d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:13.320161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3afc5e-724f-4dd8-9aa2-f4b2c1ad195d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:13.344626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1a3afc5e-724f-4dd8-9aa2-f4b2c1ad195d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:53:13.346011 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1a3afc5e-724f-4dd8-9aa2-f4b2c1ad195d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:53:13.348840 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:13.412584 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 585/1187] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:53:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:53:13.436305 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc940280-d689-43b6-a32d-f198cde2d8c5 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:13.535569 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc940280-d689-43b6-a32d-f198cde2d8c5 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:13.569265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52e260-456a-41bb-bb17-97558fc3534e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:13.570124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52e260-456a-41bb-bb17-97558fc3534e None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:13.570353 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52e260-456a-41bb-bb17-97558fc3534e None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:13.570630 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52e260-456a-41bb-bb17-97558fc3534e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:13.580569 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52e260-456a-41bb-bb17-97558fc3534e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:53:13.588503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-4f52e260-456a-41bb-bb17-97558fc3534e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:53:13.588503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:53:13.588503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:53:13.588503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:53:13.588503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:53:13.588503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:53:13.588503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:53:13.588503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:53:13.588503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:53:13.588503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:53:13.588503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:53:13.588503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:53:13.588503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:53:13.588503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:53:13.588503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:53:13.588503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:53:13.589782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:53:13.589782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:53:13.589782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:53:13.589782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:53:13.589782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:53:13.589782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:53:13.589782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:53:13.589782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:53:13.589782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:53:13.589782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:53:13.589782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:53:13.589782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:53:13.589782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:53:13.589782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:53:13.589782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:53:13.589782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:53:13.590851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:53:13.590851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:53:13.590851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:53:13.590851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:53:13.590851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:53:13.590851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:53:13.590851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:53:13.590851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:53:13.590851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:53:13.590851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:53:13.590851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:53:13.590851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:53:13.590851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 603/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:53:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:53:13.595897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3afc5e-724f-4dd8-9aa2-f4b2c1ad195d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:13.694066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3afc5e-724f-4dd8-9aa2-f4b2c1ad195d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:13.727852 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5dc21-b757-4ab2-9012-191b01291c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:13.728516 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5dc21-b757-4ab2-9012-191b01291c92 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:13.728801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5dc21-b757-4ab2-9012-191b01291c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:13.729076 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5dc21-b757-4ab2-9012-191b01291c92 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:13.729850 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5dc21-b757-4ab2-9012-191b01291c92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:53:13.730183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5dc21-b757-4ab2-9012-191b01291c92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:13.731550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5dc21-b757-4ab2-9012-191b01291c92 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:13.740120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 586/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:53:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:53:13.746164 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52e260-456a-41bb-bb17-97558fc3534e None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:13.765877 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:13.847916 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52e260-456a-41bb-bb17-97558fc3534e None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:13.881447 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8494b32-45bc-42bf-87fd-ede0a75f66de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:13.882347 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8494b32-45bc-42bf-87fd-ede0a75f66de None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:13.882632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8494b32-45bc-42bf-87fd-ede0a75f66de None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:13.882905 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8494b32-45bc-42bf-87fd-ede0a75f66de None admin] PATH_INFO: `/v3/users/0fbee4629a0f411e9667a20643c81049` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:13.884070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8494b32-45bc-42bf-87fd-ede0a75f66de None admin] RBAC: Authorizing `identity:get_user(user_id=0fbee4629a0f411e9667a20643c81049)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:13.885503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8494b32-45bc-42bf-87fd-ede0a75f66de None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:13.887153 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 604/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:53:13 2022] GET /identity/v3/users/0fbee4629a0f411e9667a20643c81049 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:53:13.892838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5dc21-b757-4ab2-9012-191b01291c92 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:13.895881 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:13.998437 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5dc21-b757-4ab2-9012-191b01291c92 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:14.030991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758c03a-51e5-417b-b380-c78de13dc79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:14.031861 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758c03a-51e5-417b-b380-c78de13dc79d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:14.032148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758c03a-51e5-417b-b380-c78de13dc79d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:14.032427 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758c03a-51e5-417b-b380-c78de13dc79d None admin] PATH_INFO: `/v3/projects/c73fcfb68f674064856f2c0008965a62` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:14.033615 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758c03a-51e5-417b-b380-c78de13dc79d None admin] RBAC: Authorizing `identity:get_project(project_id=c73fcfb68f674064856f2c0008965a62)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:14.035673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758c03a-51e5-417b-b380-c78de13dc79d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:14.037420 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 587/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:53:13 2022] GET /identity/v3/projects/c73fcfb68f674064856f2c0008965a62 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:53:14.043276 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8494b32-45bc-42bf-87fd-ede0a75f66de None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:14.129880 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:14.145178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8494b32-45bc-42bf-87fd-ede0a75f66de None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:14.178548 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af18d1f-ab5b-4f26-b666-e5a2911395e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:14.179435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af18d1f-ab5b-4f26-b666-e5a2911395e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:14.179718 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af18d1f-ab5b-4f26-b666-e5a2911395e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:14.179994 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af18d1f-ab5b-4f26-b666-e5a2911395e7 None admin] PATH_INFO: `/v3/projects/c73fcfb68f674064856f2c0008965a62/users/0fbee4629a0f411e9667a20643c81049/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:14.181975 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af18d1f-ab5b-4f26-b666-e5a2911395e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c73fcfb68f674064856f2c0008965a62, user_id=0fbee4629a0f411e9667a20643c81049, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:14.183416 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af18d1f-ab5b-4f26-b666-e5a2911395e7 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:14.196021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 605/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:53:14 2022] PUT /identity/v3/projects/c73fcfb68f674064856f2c0008965a62/users/0fbee4629a0f411e9667a20643c81049/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:53:16.383496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a39652-dfa3-4845-89a3-3ffa725744e9 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:16.384016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a39652-dfa3-4845-89a3-3ffa725744e9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:16.384016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a39652-dfa3-4845-89a3-3ffa725744e9 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:16.385327 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 588/1193] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:53:16.390594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a2599-5421-459b-93e0-ba15d442fd49 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:16.390992 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a2599-5421-459b-93e0-ba15d442fd49 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:16.391157 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a2599-5421-459b-93e0-ba15d442fd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:16.408413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4a5a2599-5421-459b-93e0-ba15d442fd49 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:53:16.410255 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4a5a2599-5421-459b-93e0-ba15d442fd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:53:16.477635 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 606/1194] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:53:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:53:16.501540 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a39652-dfa3-4845-89a3-3ffa725744e9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:16.573753 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:16.606501 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a39652-dfa3-4845-89a3-3ffa725744e9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:16.640392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebb9a4-1a5f-4c35-b1ad-fa5cd15e14aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:16.641109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebb9a4-1a5f-4c35-b1ad-fa5cd15e14aa None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:16.641394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebb9a4-1a5f-4c35-b1ad-fa5cd15e14aa None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:16.641693 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebb9a4-1a5f-4c35-b1ad-fa5cd15e14aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:16.652522 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebb9a4-1a5f-4c35-b1ad-fa5cd15e14aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:53:16.660847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-32ebb9a4-1a5f-4c35-b1ad-fa5cd15e14aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:53:16.660847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:53:16.660847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:53:16.660847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:53:16.660847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:53:16.660847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:53:16.660847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:53:16.660847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:53:16.660847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:53:16.660847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:53:16.660847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:53:16.660847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:53:16.660847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:53:16.660847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:53:16.660847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:53:16.660847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:53:16.661988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:53:16.661988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:53:16.661988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:53:16.661988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:53:16.661988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:53:16.661988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:53:16.661988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:53:16.661988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:53:16.661988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:53:16.661988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:53:16.661988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:53:16.661988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:53:16.661988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:53:16.661988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:53:16.661988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:53:16.661988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:53:16.663060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:53:16.663060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:53:16.663060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:53:16.663060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:53:16.663060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:53:16.663060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:53:16.663060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:53:16.663060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:53:16.663060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:53:16.663060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:53:16.663060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:53:16.663060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:53:16.665811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 589/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:53:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:53:16.668010 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a2599-5421-459b-93e0-ba15d442fd49 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:16.745070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:16.768341 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a2599-5421-459b-93e0-ba15d442fd49 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:16.802176 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827a109-219b-42c1-b305-dc639919bea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:16.802839 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827a109-219b-42c1-b305-dc639919bea4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:16.803123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827a109-219b-42c1-b305-dc639919bea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:16.803403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827a109-219b-42c1-b305-dc639919bea4 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:16.804145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827a109-219b-42c1-b305-dc639919bea4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:53:16.804454 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827a109-219b-42c1-b305-dc639919bea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:16.805847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827a109-219b-42c1-b305-dc639919bea4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:16.813724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 607/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:53:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:53:16.819685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebb9a4-1a5f-4c35-b1ad-fa5cd15e14aa None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:16.920912 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebb9a4-1a5f-4c35-b1ad-fa5cd15e14aa None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:16.948799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:16.955030 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb20ff3-f368-41b9-9760-fe259923ff0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:16.956246 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb20ff3-f368-41b9-9760-fe259923ff0e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:16.956694 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb20ff3-f368-41b9-9760-fe259923ff0e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:16.956968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb20ff3-f368-41b9-9760-fe259923ff0e None admin] PATH_INFO: `/v3/users/0fbee4629a0f411e9667a20643c81049` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:16.958167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb20ff3-f368-41b9-9760-fe259923ff0e None admin] RBAC: Authorizing `identity:get_user(user_id=0fbee4629a0f411e9667a20643c81049)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:16.959610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb20ff3-f368-41b9-9760-fe259923ff0e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:16.961228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 590/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Wed May 18 16:53:16 2022] GET /identity/v3/users/0fbee4629a0f411e9667a20643c81049 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:53:16.967098 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827a109-219b-42c1-b305-dc639919bea4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:17.066823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827a109-219b-42c1-b305-dc639919bea4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:17.102481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a7d4c-6b3c-467d-bab8-25fa88d76f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:17.103125 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a7d4c-6b3c-467d-bab8-25fa88d76f69 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:17.103411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a7d4c-6b3c-467d-bab8-25fa88d76f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:17.103692 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a7d4c-6b3c-467d-bab8-25fa88d76f69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:17.112183 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:17.172031 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a7d4c-6b3c-467d-bab8-25fa88d76f69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:17.173397 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a7d4c-6b3c-467d-bab8-25fa88d76f69 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:17.270722 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 608/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:53:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 16:53:17.276670 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb20ff3-f368-41b9-9760-fe259923ff0e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:17.380860 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb20ff3-f368-41b9-9760-fe259923ff0e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:17.416246 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f08089-1454-4055-9aa6-b216b4a6576e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:17.417120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f08089-1454-4055-9aa6-b216b4a6576e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:17.417401 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f08089-1454-4055-9aa6-b216b4a6576e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:17.417696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f08089-1454-4055-9aa6-b216b4a6576e None admin] PATH_INFO: `/v3/projects/c73fcfb68f674064856f2c0008965a62` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:17.418894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f08089-1454-4055-9aa6-b216b4a6576e None admin] RBAC: Authorizing `identity:get_project(project_id=c73fcfb68f674064856f2c0008965a62)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:17.420359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f08089-1454-4055-9aa6-b216b4a6576e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:17.422235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 591/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Wed May 18 16:53:17 2022] GET /identity/v3/projects/c73fcfb68f674064856f2c0008965a62 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:53:17.428649 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a7d4c-6b3c-467d-bab8-25fa88d76f69 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:53:17.468652 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:17.530282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a7d4c-6b3c-467d-bab8-25fa88d76f69 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:53:17.563430 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33651a7-a1bb-4bf4-9d91-f35e4eaa1bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:53:17.564078 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33651a7-a1bb-4bf4-9d91-f35e4eaa1bad None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:53:17.564353 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33651a7-a1bb-4bf4-9d91-f35e4eaa1bad None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:53:17.564628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33651a7-a1bb-4bf4-9d91-f35e4eaa1bad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:53:17.566240 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33651a7-a1bb-4bf4-9d91-f35e4eaa1bad None admin] RBAC: Adding query filter params (role.id=b3f3f4910bf646699f30b749edeef422, scope.project.id=c73fcfb68f674064856f2c0008965a62, user.id=0fbee4629a0f411e9667a20643c81049) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:53:17.566550 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33651a7-a1bb-4bf4-9d91-f35e4eaa1bad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:53:17.568001 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33651a7-a1bb-4bf4-9d91-f35e4eaa1bad None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:53:17.573937 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 609/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:53:17 2022] GET /identity/v3/role_assignments?user.id=0fbee4629a0f411e9667a20643c81049&scope.project.id=c73fcfb68f674064856f2c0008965a62&role.id=b3f3f4910bf646699f30b749edeef422 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:53:27.411983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=67 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:53:27.571176 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=49 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:19.894285 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9e775-ac0e-4cab-809d-25b445d8d040 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:19.894940 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9e775-ac0e-4cab-809d-25b445d8d040 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:19.894940 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9e775-ac0e-4cab-809d-25b445d8d040 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:19.896233 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 592/1201] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:54:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:54:19.902323 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3378b-1995-4745-a098-843dbcd22996 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:19.903126 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3378b-1995-4745-a098-843dbcd22996 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:19.903126 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3378b-1995-4745-a098-843dbcd22996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:19.925722 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-42a3378b-1995-4745-a098-843dbcd22996 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:54:19.926116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-42a3378b-1995-4745-a098-843dbcd22996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:54:20.025050 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 610/1202] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:54:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:54:20.054641 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9e775-ac0e-4cab-809d-25b445d8d040 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:20.193829 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9e775-ac0e-4cab-809d-25b445d8d040 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:20.239661 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e9b48-07d4-4305-b114-ed50403cb3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:20.240700 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e9b48-07d4-4305-b114-ed50403cb3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:20.241026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e9b48-07d4-4305-b114-ed50403cb3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:20.241317 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e9b48-07d4-4305-b114-ed50403cb3c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:20.255513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e9b48-07d4-4305-b114-ed50403cb3c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:20.257082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e9b48-07d4-4305-b114-ed50403cb3c0 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:20.277393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-a00e9b48-07d4-4305-b114-ed50403cb3c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:20.277393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:20.277393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:20.277393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:20.277393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:20.277393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:20.277393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:20.277393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:20.277393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:20.277393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:20.277393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:20.277393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:20.277393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:54:20.277393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:54:20.277393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:54:20.278827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:54:20.278827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:20.278827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:20.278827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:20.278827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:20.278827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:20.278827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:20.278827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:20.278827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:54:20.278827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:20.278827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:20.278827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:20.278827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:20.278827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:20.278827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:20.278827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:20.278827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:20.279985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:54:20.279985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:54:20.279985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:20.279985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:54:20.279985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 593/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:20.286375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3378b-1995-4745-a098-843dbcd22996 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:20.446857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3378b-1995-4745-a098-843dbcd22996 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:20.484131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:20.494744 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a90ab-09da-47c9-9de2-189e9f0589d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:20.495576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a90ab-09da-47c9-9de2-189e9f0589d5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:20.495968 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a90ab-09da-47c9-9de2-189e9f0589d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:20.496331 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a90ab-09da-47c9-9de2-189e9f0589d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:20.497256 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a90ab-09da-47c9-9de2-189e9f0589d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:20.497591 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a90ab-09da-47c9-9de2-189e9f0589d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:20.499133 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a90ab-09da-47c9-9de2-189e9f0589d5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:20.515660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 611/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:20.522032 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e9b48-07d4-4305-b114-ed50403cb3c0 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:20.599160 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:20.669048 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e9b48-07d4-4305-b114-ed50403cb3c0 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:20.717837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362136af-730c-41fc-a31f-5d6d955da12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:20.718802 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362136af-730c-41fc-a31f-5d6d955da12c None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:20.719347 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362136af-730c-41fc-a31f-5d6d955da12c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:20.719829 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362136af-730c-41fc-a31f-5d6d955da12c None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:20.720928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362136af-730c-41fc-a31f-5d6d955da12c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:20.722935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362136af-730c-41fc-a31f-5d6d955da12c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:20.749702 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 594/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Wed May 18 16:54:20 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:54:23.371794 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113420f-1de6-4a28-8150-44f655cbba57 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:23.372359 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113420f-1de6-4a28-8150-44f655cbba57 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:23.372359 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113420f-1de6-4a28-8150-44f655cbba57 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:23.374064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 612/1206] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:54:23.382401 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8e491-0b2c-4ea6-b05d-1c72bbf429a8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:23.383999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8e491-0b2c-4ea6-b05d-1c72bbf429a8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:23.383999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8e491-0b2c-4ea6-b05d-1c72bbf429a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:23.401285 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-34b8e491-0b2c-4ea6-b05d-1c72bbf429a8 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:54:23.402568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-34b8e491-0b2c-4ea6-b05d-1c72bbf429a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:54:23.484958 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 595/1207] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:54:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:54:23.510424 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113420f-1de6-4a28-8150-44f655cbba57 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:23.636767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113420f-1de6-4a28-8150-44f655cbba57 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:23.679378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7e7b3-3e31-4772-8ff7-df639eaaf307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:23.680173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e7b3-3e31-4772-8ff7-df639eaaf307 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:23.680497 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e7b3-3e31-4772-8ff7-df639eaaf307 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:23.680829 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e7b3-3e31-4772-8ff7-df639eaaf307 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:23.694017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7e7b3-3e31-4772-8ff7-df639eaaf307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:54:23.702614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-97e7e7b3-3e31-4772-8ff7-df639eaaf307 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:54:23.702614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:23.702614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:23.702614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:23.702614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:23.702614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:23.702614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:23.702614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:23.702614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:23.702614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:23.702614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:23.702614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:23.702614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:54:23.702614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:54:23.702614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:54:23.702614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:54:23.703658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:54:23.703658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:54:23.703658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:54:23.703658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:54:23.703658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:23.703658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:23.703658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:23.703658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:23.703658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:23.703658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:23.703658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:23.703658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:54:23.703658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:23.703658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:23.703658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:23.703658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:23.704725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:23.704725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:23.704725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:23.704725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:23.704725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:54:23.704725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:54:23.704725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:54:23.704725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:54:23.704725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:54:23.704725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:54:23.704725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:54:23.704725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:54:23.704725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 613/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:54:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:54:23.711643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8e491-0b2c-4ea6-b05d-1c72bbf429a8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:23.760293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:23.831544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8e491-0b2c-4ea6-b05d-1c72bbf429a8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:23.872028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad890203-6903-4b07-8d7d-5e362bd45ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:23.872712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad890203-6903-4b07-8d7d-5e362bd45ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:23.872993 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad890203-6903-4b07-8d7d-5e362bd45ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:23.873270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad890203-6903-4b07-8d7d-5e362bd45ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:23.874072 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad890203-6903-4b07-8d7d-5e362bd45ba2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:23.874377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad890203-6903-4b07-8d7d-5e362bd45ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:23.875772 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad890203-6903-4b07-8d7d-5e362bd45ba2 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:23.886236 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 596/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:54:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:23.893930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7e7b3-3e31-4772-8ff7-df639eaaf307 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:23.959003 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:24.020845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7e7b3-3e31-4772-8ff7-df639eaaf307 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:24.071303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e91a01-8aca-4d8f-a023-b917b5e8c811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:24.072123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e91a01-8aca-4d8f-a023-b917b5e8c811 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:24.072438 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e91a01-8aca-4d8f-a023-b917b5e8c811 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:24.072687 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e91a01-8aca-4d8f-a023-b917b5e8c811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:24.085571 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e91a01-8aca-4d8f-a023-b917b5e8c811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:24.087126 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e91a01-8aca-4d8f-a023-b917b5e8c811 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:24.107083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-58e91a01-8aca-4d8f-a023-b917b5e8c811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:24.107083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:24.107083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:24.107083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:24.107083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:24.107083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:24.107083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:24.107083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:24.107083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:24.107083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:24.107083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:24.107083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:24.107083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:54:24.107083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:54:24.107083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:54:24.108086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:54:24.108086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:24.108086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:24.108086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:24.108086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:24.108086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:24.108086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:24.108086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:24.108086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:54:24.108086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:24.108086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:24.108086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:24.108086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:24.108086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:24.108086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:24.108086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:24.108086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:24.109001 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:54:24.109001 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:54:24.109001 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:24.109001 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:54:24.109001 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 614/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:54:24.115262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad890203-6903-4b07-8d7d-5e362bd45ba2 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:24.233883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:24.237413 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad890203-6903-4b07-8d7d-5e362bd45ba2 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:24.279094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cfa0e-aa7c-42bf-afbb-8b4d78d16604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:24.279785 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cfa0e-aa7c-42bf-afbb-8b4d78d16604 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:24.280077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cfa0e-aa7c-42bf-afbb-8b4d78d16604 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:24.280335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cfa0e-aa7c-42bf-afbb-8b4d78d16604 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:24.281080 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cfa0e-aa7c-42bf-afbb-8b4d78d16604 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:24.281382 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cfa0e-aa7c-42bf-afbb-8b4d78d16604 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:24.283083 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48cfa0e-aa7c-42bf-afbb-8b4d78d16604 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:24.298718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 597/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:24.304743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e91a01-8aca-4d8f-a023-b917b5e8c811 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:24.433020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e91a01-8aca-4d8f-a023-b917b5e8c811 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:24.436072 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:24.484393 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52eeaf1-3cf7-4ca7-a8be-d7d00c59835f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:24.485256 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52eeaf1-3cf7-4ca7-a8be-d7d00c59835f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:24.485641 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52eeaf1-3cf7-4ca7-a8be-d7d00c59835f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:24.486017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52eeaf1-3cf7-4ca7-a8be-d7d00c59835f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:24.495106 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52eeaf1-3cf7-4ca7-a8be-d7d00c59835f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:24.497291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52eeaf1-3cf7-4ca7-a8be-d7d00c59835f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:24.515689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-b52eeaf1-3cf7-4ca7-a8be-d7d00c59835f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 16:54:24.515689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:24.515689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:24.515689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:24.515689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:24.515689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:24.515689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:24.515689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:24.515689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:24.515689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:24.515689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:24.515689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:24.515689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:54:24.515689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:54:24.515689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:54:24.515689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:54:24.517606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:24.517606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:24.517606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:54:24.517606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:54:24.517606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:54:24.517606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:54:24.517606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:24.517606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:24.517606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:24.517606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:24.517606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:24.517606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:54:24.517606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:24.517606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:24.517606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:24.517606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:24.517606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:24.517606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:24.518621 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:24.518621 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:24.518621 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:54:24.518621 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:54:24.518621 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:54:24.518621 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:54:24.518621 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:54:24.518621 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:54:24.518621 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 16:54:24.518621 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:54:24.518621 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 615/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:24.523682 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cfa0e-aa7c-42bf-afbb-8b4d78d16604 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:24.650781 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cfa0e-aa7c-42bf-afbb-8b4d78d16604 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:24.702094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c2d57-c07b-4931-b529-fa29ad363ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:24.702869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c2d57-c07b-4931-b529-fa29ad363ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:24.703569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c2d57-c07b-4931-b529-fa29ad363ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:24.703569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c2d57-c07b-4931-b529-fa29ad363ec6 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:24.704546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c2d57-c07b-4931-b529-fa29ad363ec6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:24.704968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c2d57-c07b-4931-b529-fa29ad363ec6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:24.706849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c2d57-c07b-4931-b529-fa29ad363ec6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:24.733970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 598/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Wed May 18 16:54:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:24.737346 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52eeaf1-3cf7-4ca7-a8be-d7d00c59835f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:24.873548 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52eeaf1-3cf7-4ca7-a8be-d7d00c59835f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:24.920022 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c62b7-5a5f-4caa-9e18-c12122bc92a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:24.920586 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c62b7-5a5f-4caa-9e18-c12122bc92a3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:24.920870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c62b7-5a5f-4caa-9e18-c12122bc92a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:24.921141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c62b7-5a5f-4caa-9e18-c12122bc92a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:24.965676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:25.016909 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c62b7-5a5f-4caa-9e18-c12122bc92a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:25.018414 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c62b7-5a5f-4caa-9e18-c12122bc92a3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:25.141456 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 616/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:54:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 16:54:25.148393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c2d57-c07b-4931-b529-fa29ad363ec6 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:25.174906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:25.278248 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c2d57-c07b-4931-b529-fa29ad363ec6 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:25.318544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a65d5-db02-41ed-b9f5-7f984c95d1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:25.319351 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a65d5-db02-41ed-b9f5-7f984c95d1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:25.319634 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a65d5-db02-41ed-b9f5-7f984c95d1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:25.319915 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a65d5-db02-41ed-b9f5-7f984c95d1b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:25.331676 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a65d5-db02-41ed-b9f5-7f984c95d1b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:25.333140 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a65d5-db02-41ed-b9f5-7f984c95d1b5 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:25.352462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-387a65d5-db02-41ed-b9f5-7f984c95d1b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:25.352462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:25.352462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:25.352462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:25.352462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:25.352462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:25.352462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:25.352462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:25.352462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:25.352462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:25.352462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:25.352462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:25.352462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:54:25.352462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:54:25.352462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:54:25.353667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:54:25.353667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:25.353667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:25.353667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:25.353667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:25.353667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:25.353667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:25.353667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:25.353667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:54:25.353667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:25.353667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:25.353667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:25.353667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:25.353667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:25.353667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:25.353667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:25.353667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:25.354959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:54:25.354959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:54:25.354959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:25.354959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:54:25.361706 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 599/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:25.361927 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c62b7-5a5f-4caa-9e18-c12122bc92a3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:25.434835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:25.482096 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c62b7-5a5f-4caa-9e18-c12122bc92a3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:25.522868 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4127c-7702-49ca-b8e0-c7b521ac8752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:25.523592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4127c-7702-49ca-b8e0-c7b521ac8752 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:25.524029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4127c-7702-49ca-b8e0-c7b521ac8752 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:25.524227 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4127c-7702-49ca-b8e0-c7b521ac8752 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:25.525003 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4127c-7702-49ca-b8e0-c7b521ac8752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:25.525333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4127c-7702-49ca-b8e0-c7b521ac8752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:25.526848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4127c-7702-49ca-b8e0-c7b521ac8752 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:25.540648 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 617/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:25.546368 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a65d5-db02-41ed-b9f5-7f984c95d1b5 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:25.625440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:25.662573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a65d5-db02-41ed-b9f5-7f984c95d1b5 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:25.714370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f34026-7579-47f7-bd7e-089c6257aeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:25.715543 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f34026-7579-47f7-bd7e-089c6257aeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:25.715891 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f34026-7579-47f7-bd7e-089c6257aeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:25.716272 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f34026-7579-47f7-bd7e-089c6257aeb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:25.728016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f34026-7579-47f7-bd7e-089c6257aeb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:25.730067 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f34026-7579-47f7-bd7e-089c6257aeb8 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:25.749359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-b9f34026-7579-47f7-bd7e-089c6257aeb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:54:25.749359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:25.749359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:25.749359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:25.749359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:25.749359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:25.749359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:25.749359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:25.749359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:25.749359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:25.749359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:25.749359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:25.749359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:54:25.749359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:54:25.749359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:54:25.750926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:54:25.750926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:25.750926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:25.750926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:25.750926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:25.750926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:25.750926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:25.750926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:25.750926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:54:25.750926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:25.750926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:25.750926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:25.750926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:25.750926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:25.750926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:25.750926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:25.750926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:25.758122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:54:25.758122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:54:25.758122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:54:25.758122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:54:25.758122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:54:25.758122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:54:25.758122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:54:25.758122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:54:25.758122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 600/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:54:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:25.759006 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4127c-7702-49ca-b8e0-c7b521ac8752 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:25.893808 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4127c-7702-49ca-b8e0-c7b521ac8752 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:25.924954 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:25.938518 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9d1bb-aa04-4638-83e9-437555e4cde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:25.939628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9d1bb-aa04-4638-83e9-437555e4cde0 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:25.939926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9d1bb-aa04-4638-83e9-437555e4cde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:25.940303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9d1bb-aa04-4638-83e9-437555e4cde0 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:25.941262 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9d1bb-aa04-4638-83e9-437555e4cde0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:25.941632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9d1bb-aa04-4638-83e9-437555e4cde0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:25.943295 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9d1bb-aa04-4638-83e9-437555e4cde0 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:25.957699 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 618/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:54:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:25.963699 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f34026-7579-47f7-bd7e-089c6257aeb8 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:26.100186 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f34026-7579-47f7-bd7e-089c6257aeb8 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:26.140006 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:26.148290 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984265e-6a54-4945-bfa9-6fddfe99da68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:26.148857 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984265e-6a54-4945-bfa9-6fddfe99da68 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:26.149134 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984265e-6a54-4945-bfa9-6fddfe99da68 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:26.149431 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984265e-6a54-4945-bfa9-6fddfe99da68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:26.150403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984265e-6a54-4945-bfa9-6fddfe99da68 None admin] RBAC: Adding query filter params (role.id=c6328736ee34470cb87aa31dea4530bf, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=bebc8414d01a40c8ab34afa9b1312a59) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:26.150614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984265e-6a54-4945-bfa9-6fddfe99da68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:26.152172 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984265e-6a54-4945-bfa9-6fddfe99da68 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:26.159127 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 601/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:54:25 2022] GET /identity/v3/role_assignments?user.id=bebc8414d01a40c8ab34afa9b1312a59&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=c6328736ee34470cb87aa31dea4530bf => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:28.538122 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e60faf-658e-443d-b4eb-a580f0ae7056 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:28.538957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e60faf-658e-443d-b4eb-a580f0ae7056 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:28.539718 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e60faf-658e-443d-b4eb-a580f0ae7056 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:28.543726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 619/1220] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:54:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:54:28.549514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010edb1-ad07-4911-8fa6-3a096e45efb1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:28.550075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010edb1-ad07-4911-8fa6-3a096e45efb1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:28.550075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010edb1-ad07-4911-8fa6-3a096e45efb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:28.569136 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8010edb1-ad07-4911-8fa6-3a096e45efb1 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:54:28.570386 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8010edb1-ad07-4911-8fa6-3a096e45efb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:54:28.650954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 602/1221] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:54:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:54:28.675306 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e60faf-658e-443d-b4eb-a580f0ae7056 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:28.829391 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e60faf-658e-443d-b4eb-a580f0ae7056 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:28.887703 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e11a06-6c18-4516-9c39-c66d03d7867d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:28.888614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e11a06-6c18-4516-9c39-c66d03d7867d None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:28.889500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e11a06-6c18-4516-9c39-c66d03d7867d None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:28.889500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e11a06-6c18-4516-9c39-c66d03d7867d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:28.908715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e11a06-6c18-4516-9c39-c66d03d7867d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:54:28.920021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-46e11a06-6c18-4516-9c39-c66d03d7867d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:54:28.920021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:28.920021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:28.920021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:28.920021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:28.920021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:28.920021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:28.920021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:28.920021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:28.920021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:28.920021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:28.920021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:28.920021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:54:28.920021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:54:28.920021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:54:28.920021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:54:28.923289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:54:28.923289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:54:28.923289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:54:28.923289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:54:28.923289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:28.923289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:28.923289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:28.923289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:28.923289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:28.923289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:28.923289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:28.923289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:54:28.923289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:28.923289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:28.923289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:28.923289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:28.925056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:28.925056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:28.925056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:28.925056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:28.925056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:54:28.925056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:54:28.925056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:54:28.925056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:54:28.925056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:54:28.925056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:54:28.925056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:54:28.925056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:54:28.926477 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 620/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:54:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:28.930861 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010edb1-ad07-4911-8fa6-3a096e45efb1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:29.050971 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010edb1-ad07-4911-8fa6-3a096e45efb1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:29.085714 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:29.102823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6763e2c-18be-40cb-9e8f-eddf5baab4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:29.103622 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6763e2c-18be-40cb-9e8f-eddf5baab4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:29.103906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6763e2c-18be-40cb-9e8f-eddf5baab4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:29.104226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6763e2c-18be-40cb-9e8f-eddf5baab4a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:29.105135 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6763e2c-18be-40cb-9e8f-eddf5baab4a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:29.105483 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6763e2c-18be-40cb-9e8f-eddf5baab4a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:29.107195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6763e2c-18be-40cb-9e8f-eddf5baab4a7 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:29.117460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 603/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:54:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:54:29.126741 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e11a06-6c18-4516-9c39-c66d03d7867d None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:29.192054 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:29.275627 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e11a06-6c18-4516-9c39-c66d03d7867d None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:29.327168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631eecf-e530-49bc-a97e-a8f144700fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:29.328109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631eecf-e530-49bc-a97e-a8f144700fee None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:29.328497 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631eecf-e530-49bc-a97e-a8f144700fee None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:29.329419 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631eecf-e530-49bc-a97e-a8f144700fee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:29.343649 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631eecf-e530-49bc-a97e-a8f144700fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:29.345917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631eecf-e530-49bc-a97e-a8f144700fee None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:29.365233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-a631eecf-e530-49bc-a97e-a8f144700fee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:29.365233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:29.365233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:29.365233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:29.365233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:29.365233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:29.365233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:29.365233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:29.365233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:29.365233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:29.365233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:29.365233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:29.365233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:54:29.365233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:54:29.365233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:54:29.367146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:54:29.367146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:29.367146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:29.367146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:29.367146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:29.367146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:29.367146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:29.367146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:29.367146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:54:29.367146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:29.367146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:29.367146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:29.367146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:29.367146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:29.367146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:29.367146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:29.367146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:29.368892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:54:29.368892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:54:29.368892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:29.368892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:54:29.368892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 621/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:54:29.373511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6763e2c-18be-40cb-9e8f-eddf5baab4a7 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:29.494043 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6763e2c-18be-40cb-9e8f-eddf5baab4a7 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:29.540460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc680b3f-e7de-4160-8064-daa0ee0a33c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:29.541367 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc680b3f-e7de-4160-8064-daa0ee0a33c1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:29.541884 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc680b3f-e7de-4160-8064-daa0ee0a33c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:29.542321 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc680b3f-e7de-4160-8064-daa0ee0a33c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:29.543162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc680b3f-e7de-4160-8064-daa0ee0a33c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:29.543547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc680b3f-e7de-4160-8064-daa0ee0a33c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:29.545356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc680b3f-e7de-4160-8064-daa0ee0a33c1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:29.564628 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 604/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:29.573412 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631eecf-e530-49bc-a97e-a8f144700fee None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:29.705584 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:29.717503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631eecf-e530-49bc-a97e-a8f144700fee None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:29.767980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d9bc2-daff-489d-b132-78204501c625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:29.768825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d9bc2-daff-489d-b132-78204501c625 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:29.769120 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d9bc2-daff-489d-b132-78204501c625 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:29.769395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d9bc2-daff-489d-b132-78204501c625 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:29.778215 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d9bc2-daff-489d-b132-78204501c625 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:29.779724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d9bc2-daff-489d-b132-78204501c625 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:29.797472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-a81d9bc2-daff-489d-b132-78204501c625 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 16:54:29.797472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:29.797472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:29.797472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:29.797472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:29.797472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:29.797472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:29.797472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:29.797472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:29.797472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:29.797472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:29.797472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:29.797472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:54:29.797472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:54:29.797472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:54:29.797472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:54:29.800140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:29.800140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:29.800140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:54:29.800140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:54:29.800140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:54:29.800140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:54:29.800140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:29.800140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:29.800140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:29.800140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:29.800140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:29.800140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:54:29.800140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:29.800140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:29.800140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:29.800140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:29.800140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:29.800140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:29.802439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:29.802439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:29.802439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:54:29.802439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:54:29.802439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:54:29.802439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:54:29.802439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:54:29.802439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:54:29.802439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 16:54:29.802439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:54:29.802439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 622/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:54:29.807800 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc680b3f-e7de-4160-8064-daa0ee0a33c1 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:29.875496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:29.957582 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc680b3f-e7de-4160-8064-daa0ee0a33c1 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:30.003347 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d2655-f880-4e65-b4e7-56e3c666790d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:30.004203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d2655-f880-4e65-b4e7-56e3c666790d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:30.004614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d2655-f880-4e65-b4e7-56e3c666790d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:30.005072 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d2655-f880-4e65-b4e7-56e3c666790d None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:30.006276 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d2655-f880-4e65-b4e7-56e3c666790d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:30.006823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d2655-f880-4e65-b4e7-56e3c666790d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:30.008846 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d2655-f880-4e65-b4e7-56e3c666790d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:30.033950 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 605/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Wed May 18 16:54:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:54:30.042005 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d9bc2-daff-489d-b132-78204501c625 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:30.206592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d9bc2-daff-489d-b132-78204501c625 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:30.258616 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e3b8f-0c37-4c54-8873-2d70ee5081f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:30.259866 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e3b8f-0c37-4c54-8873-2d70ee5081f5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:30.260276 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e3b8f-0c37-4c54-8873-2d70ee5081f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:30.260697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e3b8f-0c37-4c54-8873-2d70ee5081f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:30.280338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e3b8f-0c37-4c54-8873-2d70ee5081f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:30.282636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e3b8f-0c37-4c54-8873-2d70ee5081f5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:30.315246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-2a7e3b8f-0c37-4c54-8873-2d70ee5081f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:30.315246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:30.315246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:30.315246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:30.315246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:30.315246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:30.315246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:30.315246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:30.315246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:30.315246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:30.315246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:30.315246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:30.315246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:54:30.315246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:54:30.315246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:54:30.316470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:54:30.316470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:30.316470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:30.316470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:30.316470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:30.316470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:30.316470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:30.316470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:30.316470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:54:30.316470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:30.316470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:30.316470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:30.316470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:30.316470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:30.316470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:30.316470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:30.316470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:30.317750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:54:30.317750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:54:30.317750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:30.317750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:54:30.317750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 623/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:30.323430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d2655-f880-4e65-b4e7-56e3c666790d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:30.460173 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d2655-f880-4e65-b4e7-56e3c666790d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:30.463549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:30.509509 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9d433-a297-48d6-808c-a1e1214adf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:30.510558 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9d433-a297-48d6-808c-a1e1214adf0b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:30.510956 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9d433-a297-48d6-808c-a1e1214adf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:30.511450 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9d433-a297-48d6-808c-a1e1214adf0b None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:30.512438 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9d433-a297-48d6-808c-a1e1214adf0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:30.512745 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9d433-a297-48d6-808c-a1e1214adf0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:30.514783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9d433-a297-48d6-808c-a1e1214adf0b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:30.543667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 606/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:54:30.545112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e3b8f-0c37-4c54-8873-2d70ee5081f5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:30.560615 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:30.711696 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e3b8f-0c37-4c54-8873-2d70ee5081f5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:30.770929 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3328570-ec50-4aa8-8190-efa7682b2b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:30.771764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3328570-ec50-4aa8-8190-efa7682b2b88 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:30.772055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3328570-ec50-4aa8-8190-efa7682b2b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:30.772332 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3328570-ec50-4aa8-8190-efa7682b2b88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:30.787764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3328570-ec50-4aa8-8190-efa7682b2b88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:30.791965 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3328570-ec50-4aa8-8190-efa7682b2b88 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:30.828777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-b3328570-ec50-4aa8-8190-efa7682b2b88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:54:30.828777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:30.828777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:30.828777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:30.828777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:30.828777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:30.828777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:30.828777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:30.828777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:30.828777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:30.828777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:30.828777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:30.828777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:54:30.828777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:54:30.828777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:54:30.831174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:54:30.831174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:30.831174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:30.831174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:30.831174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:30.831174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:30.831174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:30.831174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:30.831174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:54:30.831174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:30.831174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:30.831174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:30.831174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:30.831174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:30.831174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:30.831174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:30.831174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:30.833428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:54:30.833428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:54:30.833428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:54:30.833428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:54:30.833428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:54:30.833428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:54:30.833428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:54:30.833428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:54:30.833428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 624/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:54:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:30.840381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9d433-a297-48d6-808c-a1e1214adf0b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:30.992640 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9d433-a297-48d6-808c-a1e1214adf0b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:31.035503 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23125f33-cb3e-4627-8e34-b71b4e56f0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:31.036091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23125f33-cb3e-4627-8e34-b71b4e56f0ac None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:31.036351 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23125f33-cb3e-4627-8e34-b71b4e56f0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:31.036613 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23125f33-cb3e-4627-8e34-b71b4e56f0ac None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:31.037408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23125f33-cb3e-4627-8e34-b71b4e56f0ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:31.037753 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23125f33-cb3e-4627-8e34-b71b4e56f0ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:31.039205 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23125f33-cb3e-4627-8e34-b71b4e56f0ac None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:31.054121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 607/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:54:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:54:31.060637 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3328570-ec50-4aa8-8190-efa7682b2b88 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:31.141279 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:31.190184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3328570-ec50-4aa8-8190-efa7682b2b88 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:31.237562 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff800e1-d009-46f3-9d4b-055b4b96e177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:31.238674 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff800e1-d009-46f3-9d4b-055b4b96e177 None admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:31.239092 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff800e1-d009-46f3-9d4b-055b4b96e177 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:31.239470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff800e1-d009-46f3-9d4b-055b4b96e177 None admin] PATH_INFO: `/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/bebc8414d01a40c8ab34afa9b1312a59/roles/c6328736ee34470cb87aa31dea4530bf` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:31.277614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff800e1-d009-46f3-9d4b-055b4b96e177 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcd3afbb3e384cb2939647002c60bbba, user_id=bebc8414d01a40c8ab34afa9b1312a59, role_id=c6328736ee34470cb87aa31dea4530bf)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:31.280683 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff800e1-d009-46f3-9d4b-055b4b96e177 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:31.306380 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 625/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:54:31 2022] PUT /identity/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/bebc8414d01a40c8ab34afa9b1312a59/roles/c6328736ee34470cb87aa31dea4530bf => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:54:34.177114 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced1321-5940-4346-a135-3b950d432c62 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:34.177845 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced1321-5940-4346-a135-3b950d432c62 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:34.177845 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced1321-5940-4346-a135-3b950d432c62 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:34.179056 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 608/1233] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:54:34.185017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c005f6d-5b26-4a1d-bbce-bde783efe612 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:34.185839 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c005f6d-5b26-4a1d-bbce-bde783efe612 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:34.185839 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c005f6d-5b26-4a1d-bbce-bde783efe612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:34.205278 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5c005f6d-5b26-4a1d-bbce-bde783efe612 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:54:34.206806 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5c005f6d-5b26-4a1d-bbce-bde783efe612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:54:34.290428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 626/1234] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:54:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:54:34.314874 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced1321-5940-4346-a135-3b950d432c62 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:34.345304 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:34.458235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced1321-5940-4346-a135-3b950d432c62 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:34.502564 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5bbfd-7b31-4a8a-b06e-ae20f93b1b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:34.503459 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5bbfd-7b31-4a8a-b06e-ae20f93b1b10 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:34.503767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5bbfd-7b31-4a8a-b06e-ae20f93b1b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:34.504098 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5bbfd-7b31-4a8a-b06e-ae20f93b1b10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:34.517065 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5bbfd-7b31-4a8a-b06e-ae20f93b1b10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:54:34.525183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-90b5bbfd-7b31-4a8a-b06e-ae20f93b1b10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 18 16:54:34.525183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:34.525183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:34.525183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:34.525183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:34.525183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:34.525183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:34.525183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:34.525183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:34.525183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:34.525183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:34.525183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:34.525183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:54:34.525183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:54:34.525183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:54:34.525183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:54:34.526464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:54:34.526464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:54:34.526464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:54:34.526464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:54:34.526464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:34.526464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:34.526464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:34.526464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:34.526464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:34.526464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:34.526464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:34.526464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:54:34.526464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:34.526464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:34.526464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:34.526464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:34.528306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:34.528306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:34.528306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:34.528306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:34.528306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:54:34.528306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:54:34.528306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:54:34.528306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:54:34.528306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:54:34.528306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:54:34.528306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 18 16:54:34.528306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:54:34.528306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 609/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Wed May 18 16:54:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:54:34.533889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c005f6d-5b26-4a1d-bbce-bde783efe612 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:34.587664 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:34.658858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c005f6d-5b26-4a1d-bbce-bde783efe612 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:34.713984 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971897cd-b9bd-4314-b19a-0510a2435ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:34.714756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971897cd-b9bd-4314-b19a-0510a2435ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:34.715063 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971897cd-b9bd-4314-b19a-0510a2435ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:34.715371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971897cd-b9bd-4314-b19a-0510a2435ae2 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:34.716225 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971897cd-b9bd-4314-b19a-0510a2435ae2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:34.716572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971897cd-b9bd-4314-b19a-0510a2435ae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:34.718398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971897cd-b9bd-4314-b19a-0510a2435ae2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:34.732642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 627/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Wed May 18 16:54:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:54:34.740287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5bbfd-7b31-4a8a-b06e-ae20f93b1b10 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:34.853830 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:34.876712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5bbfd-7b31-4a8a-b06e-ae20f93b1b10 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:34.921952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614abc0-a52c-4625-9908-cbdb9fdc4f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:34.922842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614abc0-a52c-4625-9908-cbdb9fdc4f00 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:34.923108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614abc0-a52c-4625-9908-cbdb9fdc4f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:34.923349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614abc0-a52c-4625-9908-cbdb9fdc4f00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:34.945115 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614abc0-a52c-4625-9908-cbdb9fdc4f00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:34.948088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614abc0-a52c-4625-9908-cbdb9fdc4f00 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:34.976780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-b614abc0-a52c-4625-9908-cbdb9fdc4f00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:34.976780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:34.976780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:34.976780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:34.976780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:34.976780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:34.976780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:34.976780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:34.976780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:34.976780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:34.976780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:34.976780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:34.976780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:54:34.976780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:54:34.976780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:54:34.978739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:54:34.978739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:34.978739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:34.978739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:34.978739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:34.978739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:34.978739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:34.978739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:34.978739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:54:34.978739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:34.978739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:34.978739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:34.978739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:34.978739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:34.978739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:34.978739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:34.978739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:34.980897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:54:34.980897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:54:34.980897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:34.980897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:54:34.980897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 610/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:34.984817 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971897cd-b9bd-4314-b19a-0510a2435ae2 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:35.122577 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971897cd-b9bd-4314-b19a-0510a2435ae2 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:35.138048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:35.176528 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df3e71-3b71-4673-9b84-4d5361cd8c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:35.177728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df3e71-3b71-4673-9b84-4d5361cd8c8b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:35.178266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df3e71-3b71-4673-9b84-4d5361cd8c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:35.178812 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df3e71-3b71-4673-9b84-4d5361cd8c8b None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:35.180479 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df3e71-3b71-4673-9b84-4d5361cd8c8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:35.181137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df3e71-3b71-4673-9b84-4d5361cd8c8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:35.183980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df3e71-3b71-4673-9b84-4d5361cd8c8b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:35.205402 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 628/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:35.214179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614abc0-a52c-4625-9908-cbdb9fdc4f00 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:35.339018 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614abc0-a52c-4625-9908-cbdb9fdc4f00 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:35.404011 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c7e0a-33a8-41b0-b7f9-58cd6c197140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:35.404811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c7e0a-33a8-41b0-b7f9-58cd6c197140 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:35.405081 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c7e0a-33a8-41b0-b7f9-58cd6c197140 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:35.405348 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c7e0a-33a8-41b0-b7f9-58cd6c197140 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:35.409930 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:35.418569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c7e0a-33a8-41b0-b7f9-58cd6c197140 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:35.420381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c7e0a-33a8-41b0-b7f9-58cd6c197140 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:35.439424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-594c7e0a-33a8-41b0-b7f9-58cd6c197140 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 16:54:35.439424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:35.439424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:35.439424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:35.439424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:35.439424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:35.439424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:35.439424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:35.439424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:35.439424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:35.439424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:35.439424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:35.439424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:54:35.439424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:54:35.439424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:54:35.439424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:54:35.441532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:35.441532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:35.441532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:54:35.441532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:54:35.441532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:54:35.441532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:54:35.441532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:35.441532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:35.441532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:35.441532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:35.441532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:35.441532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:54:35.441532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:35.441532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:35.441532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:35.441532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:35.441532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:35.441532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:35.443826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:35.443826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:35.443826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:54:35.443826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:54:35.443826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:54:35.443826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:54:35.443826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:54:35.443826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:54:35.443826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 16:54:35.443826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:54:35.445944 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 611/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:35.447468 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df3e71-3b71-4673-9b84-4d5361cd8c8b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:35.615675 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df3e71-3b71-4673-9b84-4d5361cd8c8b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:35.666285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76c4fb-3728-4b81-8d10-d9256dff26c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:35.666968 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76c4fb-3728-4b81-8d10-d9256dff26c3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:35.667240 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76c4fb-3728-4b81-8d10-d9256dff26c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:35.667512 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76c4fb-3728-4b81-8d10-d9256dff26c3 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:35.668374 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76c4fb-3728-4b81-8d10-d9256dff26c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:35.668683 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76c4fb-3728-4b81-8d10-d9256dff26c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:35.670216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76c4fb-3728-4b81-8d10-d9256dff26c3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:35.695150 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 629/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Wed May 18 16:54:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:35.701352 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c7e0a-33a8-41b0-b7f9-58cd6c197140 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:35.884256 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c7e0a-33a8-41b0-b7f9-58cd6c197140 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:35.926911 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868909ff-3a2d-4c3f-aaa1-fc03881af89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:35.926911 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868909ff-3a2d-4c3f-aaa1-fc03881af89c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:35.927416 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868909ff-3a2d-4c3f-aaa1-fc03881af89c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:35.927704 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868909ff-3a2d-4c3f-aaa1-fc03881af89c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:36.002796 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:36.012105 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868909ff-3a2d-4c3f-aaa1-fc03881af89c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:36.013650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868909ff-3a2d-4c3f-aaa1-fc03881af89c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:36.143021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 612/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:54:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 16:54:36.149208 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76c4fb-3728-4b81-8d10-d9256dff26c3 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:36.182988 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:36.285785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76c4fb-3728-4b81-8d10-d9256dff26c3 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:36.332632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d395c-2c63-46b6-a065-11644ceff85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:36.333556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d395c-2c63-46b6-a065-11644ceff85b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:36.333895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d395c-2c63-46b6-a065-11644ceff85b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:36.334174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d395c-2c63-46b6-a065-11644ceff85b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:36.349051 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d395c-2c63-46b6-a065-11644ceff85b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:36.351417 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d395c-2c63-46b6-a065-11644ceff85b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:36.375996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-434d395c-2c63-46b6-a065-11644ceff85b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:36.375996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:36.375996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:36.375996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:36.375996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:36.375996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:36.375996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:36.375996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:36.375996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:36.375996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:36.375996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:36.375996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:36.375996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:54:36.375996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:54:36.375996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:54:36.378023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:54:36.378023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:36.378023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:36.378023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:36.378023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:36.378023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:36.378023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:36.378023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:36.378023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:54:36.378023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:36.378023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:36.378023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:36.378023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:36.378023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:36.378023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:36.378023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:36.378023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:36.379579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:54:36.379579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:54:36.379579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:36.379579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:54:36.379579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 630/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:36.384126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868909ff-3a2d-4c3f-aaa1-fc03881af89c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:36.506778 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:36.514794 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868909ff-3a2d-4c3f-aaa1-fc03881af89c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:36.559999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f7e6a-ee78-4706-ab53-841ec6a8ca2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:36.561034 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f7e6a-ee78-4706-ab53-841ec6a8ca2e None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:36.561463 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f7e6a-ee78-4706-ab53-841ec6a8ca2e None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:36.561996 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f7e6a-ee78-4706-ab53-841ec6a8ca2e None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:36.564100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f7e6a-ee78-4706-ab53-841ec6a8ca2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:36.564631 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f7e6a-ee78-4706-ab53-841ec6a8ca2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:36.567219 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f7e6a-ee78-4706-ab53-841ec6a8ca2e None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:36.589078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 613/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:54:36.595686 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d395c-2c63-46b6-a065-11644ceff85b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:36.696971 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:36.732549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d395c-2c63-46b6-a065-11644ceff85b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:36.781190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f839b42-d2ed-476a-8e93-07773f3779c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:36.783150 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f839b42-d2ed-476a-8e93-07773f3779c9 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:36.783652 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f839b42-d2ed-476a-8e93-07773f3779c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:36.784134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f839b42-d2ed-476a-8e93-07773f3779c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:36.797648 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f839b42-d2ed-476a-8e93-07773f3779c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:36.800466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f839b42-d2ed-476a-8e93-07773f3779c9 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:36.830643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-9f839b42-d2ed-476a-8e93-07773f3779c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:54:36.830643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:36.830643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:36.830643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:36.830643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:36.830643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:36.830643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:36.830643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:36.830643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:36.830643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:36.830643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:36.830643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:36.830643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:54:36.830643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:54:36.830643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:54:36.832654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:54:36.832654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:36.832654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:36.832654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:36.832654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:36.832654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:36.832654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:36.832654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:36.832654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:54:36.832654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:36.832654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:36.832654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:36.832654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:36.832654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:36.832654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:36.832654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:36.832654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:36.835089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:54:36.835089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:54:36.835089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:54:36.835089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:54:36.835089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:54:36.835089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:54:36.835089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:54:36.835089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:54:36.835089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 631/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:54:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:36.839999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f7e6a-ee78-4706-ab53-841ec6a8ca2e None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:36.988434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f7e6a-ee78-4706-ab53-841ec6a8ca2e None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:37.038726 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654feab-d04c-4949-972e-4adf31191c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:37.039445 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654feab-d04c-4949-972e-4adf31191c35 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:37.039752 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654feab-d04c-4949-972e-4adf31191c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:37.040148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654feab-d04c-4949-972e-4adf31191c35 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:37.041043 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654feab-d04c-4949-972e-4adf31191c35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:37.041338 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654feab-d04c-4949-972e-4adf31191c35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:37.043140 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654feab-d04c-4949-972e-4adf31191c35 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:37.059335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 614/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:54:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:37.067082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f839b42-d2ed-476a-8e93-07773f3779c9 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:37.216755 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f839b42-d2ed-476a-8e93-07773f3779c9 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:37.274205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abbd2a-86cc-4b25-b918-7881e395e2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:37.274896 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abbd2a-86cc-4b25-b918-7881e395e2ed None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:37.275185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abbd2a-86cc-4b25-b918-7881e395e2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:37.275461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abbd2a-86cc-4b25-b918-7881e395e2ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:37.276341 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abbd2a-86cc-4b25-b918-7881e395e2ed None admin] RBAC: Adding query filter params (role.id=c6328736ee34470cb87aa31dea4530bf, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=bebc8414d01a40c8ab34afa9b1312a59) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:37.276704 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abbd2a-86cc-4b25-b918-7881e395e2ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:37.278338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abbd2a-86cc-4b25-b918-7881e395e2ed None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:37.287556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 632/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:54:37 2022] GET /identity/v3/role_assignments?user.id=bebc8414d01a40c8ab34afa9b1312a59&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=c6328736ee34470cb87aa31dea4530bf => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:40.099525 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ab9e0-81a3-448d-b85e-6f326c6686f2 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:40.100325 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ab9e0-81a3-448d-b85e-6f326c6686f2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:40.100325 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ab9e0-81a3-448d-b85e-6f326c6686f2 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:40.101501 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 615/1247] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:54:40.107686 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245d2eb-0258-48c1-baff-90b2286b1ef1 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:40.108446 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245d2eb-0258-48c1-baff-90b2286b1ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:40.108678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245d2eb-0258-48c1-baff-90b2286b1ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:40.118310 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:40.138786 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2245d2eb-0258-48c1-baff-90b2286b1ef1 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:54:40.140302 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2245d2eb-0258-48c1-baff-90b2286b1ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:54:40.250114 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 633/1248] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:54:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:54:40.299794 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ab9e0-81a3-448d-b85e-6f326c6686f2 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:40.327587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:40.477781 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ab9e0-81a3-448d-b85e-6f326c6686f2 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:40.546118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289a4a1-4972-457a-82dd-82e2d4cca883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:40.547982 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289a4a1-4972-457a-82dd-82e2d4cca883 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:40.548518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289a4a1-4972-457a-82dd-82e2d4cca883 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:40.549128 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289a4a1-4972-457a-82dd-82e2d4cca883 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:40.571788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289a4a1-4972-457a-82dd-82e2d4cca883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:54:40.591311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-f289a4a1-4972-457a-82dd-82e2d4cca883 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:54:40.591311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:40.591311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:40.591311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:40.591311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:40.591311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:40.591311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:40.591311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:40.591311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:40.591311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:40.591311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:40.591311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:40.591311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:54:40.591311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:54:40.591311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:54:40.591311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:54:40.592953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:54:40.592953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:54:40.592953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:54:40.592953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:54:40.592953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:40.592953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:40.592953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:40.592953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:40.592953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:40.592953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:40.592953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:40.592953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:54:40.592953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:40.592953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:40.592953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:40.592953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:40.595040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:40.595040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:40.595040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:40.595040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:40.595040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:54:40.595040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:54:40.595040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:54:40.595040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:54:40.595040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:54:40.595040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:54:40.595040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:54:40.595040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:54:40.595040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 616/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:54:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:54:40.606367 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245d2eb-0258-48c1-baff-90b2286b1ef1 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:40.797857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245d2eb-0258-48c1-baff-90b2286b1ef1 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:40.847491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:40.860565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a33eb3-e288-488b-a44e-41d283479b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:40.860565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a33eb3-e288-488b-a44e-41d283479b73 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:40.860565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a33eb3-e288-488b-a44e-41d283479b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:40.860565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a33eb3-e288-488b-a44e-41d283479b73 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:40.861918 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a33eb3-e288-488b-a44e-41d283479b73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:40.861918 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a33eb3-e288-488b-a44e-41d283479b73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:40.862583 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a33eb3-e288-488b-a44e-41d283479b73 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:40.873901 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 634/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:54:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:40.882262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289a4a1-4972-457a-82dd-82e2d4cca883 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:41.003879 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:41.035188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289a4a1-4972-457a-82dd-82e2d4cca883 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:41.092409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010af68c-624d-4ca7-80fd-b0d469b69324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:41.093247 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010af68c-624d-4ca7-80fd-b0d469b69324 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:41.094056 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010af68c-624d-4ca7-80fd-b0d469b69324 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:41.095357 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010af68c-624d-4ca7-80fd-b0d469b69324 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:41.115263 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010af68c-624d-4ca7-80fd-b0d469b69324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:41.117323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010af68c-624d-4ca7-80fd-b0d469b69324 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:41.145144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-010af68c-624d-4ca7-80fd-b0d469b69324 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:41.145144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:41.145144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:41.145144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:41.145144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:41.145144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:41.145144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:41.145144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:41.145144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:41.145144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:41.145144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:41.145144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:41.145144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:54:41.145144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:54:41.145144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:54:41.146949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:54:41.146949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:41.146949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:41.146949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:41.146949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:41.146949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:41.146949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:41.146949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:41.146949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:54:41.146949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:41.146949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:41.146949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:41.146949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:41.146949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:41.146949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:41.146949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:41.146949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:41.148723 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:54:41.148723 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:54:41.148723 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:41.148723 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:54:41.148723 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 617/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:41.154492 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a33eb3-e288-488b-a44e-41d283479b73 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:41.345316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a33eb3-e288-488b-a44e-41d283479b73 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:41.424123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e3b44-f731-4535-accf-d7e1120f2853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:41.425320 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e3b44-f731-4535-accf-d7e1120f2853 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:41.425706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e3b44-f731-4535-accf-d7e1120f2853 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:41.426063 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e3b44-f731-4535-accf-d7e1120f2853 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:41.426932 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e3b44-f731-4535-accf-d7e1120f2853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:41.427325 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e3b44-f731-4535-accf-d7e1120f2853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:41.429025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e3b44-f731-4535-accf-d7e1120f2853 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:41.453735 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 635/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:41.460044 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010af68c-624d-4ca7-80fd-b0d469b69324 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:41.632473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010af68c-624d-4ca7-80fd-b0d469b69324 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:41.677896 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:41.692588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd282759-75b6-4495-b4ca-d87f7365562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:41.693980 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd282759-75b6-4495-b4ca-d87f7365562c None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:41.694432 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd282759-75b6-4495-b4ca-d87f7365562c None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:41.695022 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd282759-75b6-4495-b4ca-d87f7365562c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:41.711617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd282759-75b6-4495-b4ca-d87f7365562c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:41.714384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd282759-75b6-4495-b4ca-d87f7365562c None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:41.739939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-bd282759-75b6-4495-b4ca-d87f7365562c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 16:54:41.739939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:41.739939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:41.739939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:41.739939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:41.739939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:41.739939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:41.739939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:41.739939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:41.739939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:41.739939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:41.739939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:41.739939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:54:41.739939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:54:41.739939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:54:41.739939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:54:41.742199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:41.742199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:41.742199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:54:41.742199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:54:41.742199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:54:41.742199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:54:41.742199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:41.742199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:41.742199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:41.742199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:41.742199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:41.742199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:54:41.742199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:41.742199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:41.742199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:41.742199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:41.742199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:41.742199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:41.743937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:41.743937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:41.743937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:54:41.743937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:54:41.743937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:54:41.743937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:54:41.743937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:54:41.743937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:54:41.743937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 16:54:41.743937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:54:41.743937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 618/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:41.750473 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e3b44-f731-4535-accf-d7e1120f2853 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:41.854812 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:41.921567 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e3b44-f731-4535-accf-d7e1120f2853 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:41.965619 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188c349-f9e0-4f8a-8d25-51f1265866b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:41.966253 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188c349-f9e0-4f8a-8d25-51f1265866b5 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:41.966538 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188c349-f9e0-4f8a-8d25-51f1265866b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:41.966813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188c349-f9e0-4f8a-8d25-51f1265866b5 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:41.967666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188c349-f9e0-4f8a-8d25-51f1265866b5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:41.967977 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188c349-f9e0-4f8a-8d25-51f1265866b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:41.970048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188c349-f9e0-4f8a-8d25-51f1265866b5 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:41.999321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 636/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Wed May 18 16:54:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:42.002009 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd282759-75b6-4495-b4ca-d87f7365562c None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:42.170447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd282759-75b6-4495-b4ca-d87f7365562c None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:42.231654 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba301f28-7eed-4cfc-8ec6-1fd15da9c659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:42.232232 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba301f28-7eed-4cfc-8ec6-1fd15da9c659 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:42.232488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba301f28-7eed-4cfc-8ec6-1fd15da9c659 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:42.232761 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba301f28-7eed-4cfc-8ec6-1fd15da9c659 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:42.313959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:42.337449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba301f28-7eed-4cfc-8ec6-1fd15da9c659 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:42.339102 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba301f28-7eed-4cfc-8ec6-1fd15da9c659 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:42.481492 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 619/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:54:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 16:54:42.489439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188c349-f9e0-4f8a-8d25-51f1265866b5 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:42.667740 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188c349-f9e0-4f8a-8d25-51f1265866b5 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:42.686953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:42.718819 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8a1f1-68ab-429c-a8ca-f3644f6e2ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:42.719698 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8a1f1-68ab-429c-a8ca-f3644f6e2ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:42.719977 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8a1f1-68ab-429c-a8ca-f3644f6e2ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:42.720366 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8a1f1-68ab-429c-a8ca-f3644f6e2ca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:42.733872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8a1f1-68ab-429c-a8ca-f3644f6e2ca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:42.735462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8a1f1-68ab-429c-a8ca-f3644f6e2ca6 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:42.767726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-c8f8a1f1-68ab-429c-a8ca-f3644f6e2ca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:42.767726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:42.767726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:42.767726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:42.767726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:42.767726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:42.767726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:42.767726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:42.767726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:42.767726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:42.767726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:42.767726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:42.767726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:54:42.767726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:54:42.767726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:54:42.769712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:54:42.769712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:42.769712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:42.769712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:42.769712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:42.769712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:42.769712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:42.769712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:42.769712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:54:42.769712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:42.769712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:42.769712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:42.769712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:42.769712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:42.769712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:42.769712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:42.769712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:42.771776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:54:42.771776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:54:42.771776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:42.771776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:54:42.771776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 637/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:54:42.778181 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba301f28-7eed-4cfc-8ec6-1fd15da9c659 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:42.929618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:42.945441 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba301f28-7eed-4cfc-8ec6-1fd15da9c659 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:42.988583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcebd8-d29c-4b7f-8742-08049496cd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:42.989255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcebd8-d29c-4b7f-8742-08049496cd7f None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:42.989536 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcebd8-d29c-4b7f-8742-08049496cd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:42.989857 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcebd8-d29c-4b7f-8742-08049496cd7f None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:42.990593 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcebd8-d29c-4b7f-8742-08049496cd7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:42.990896 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcebd8-d29c-4b7f-8742-08049496cd7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:42.992295 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcebd8-d29c-4b7f-8742-08049496cd7f None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:43.007303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 620/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:43.013191 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8a1f1-68ab-429c-a8ca-f3644f6e2ca6 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:43.144715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8a1f1-68ab-429c-a8ca-f3644f6e2ca6 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:43.192383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b283ca6-b892-40fc-9335-282634d72d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:43.193858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b283ca6-b892-40fc-9335-282634d72d58 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:43.194311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b283ca6-b892-40fc-9335-282634d72d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:43.194792 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b283ca6-b892-40fc-9335-282634d72d58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:43.208807 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b283ca6-b892-40fc-9335-282634d72d58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:43.211154 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b283ca6-b892-40fc-9335-282634d72d58 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:43.233867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-0b283ca6-b892-40fc-9335-282634d72d58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:54:43.233867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:43.233867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:43.233867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:43.233867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:43.233867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:43.233867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:43.233867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:43.233867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:43.233867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:43.233867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:43.233867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:43.233867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:54:43.233867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:54:43.233867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:54:43.235484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:54:43.235484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:43.235484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:43.235484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:43.235484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:43.235484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:43.235484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:43.235484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:43.235484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:54:43.235484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:43.235484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:43.235484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:43.235484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:43.235484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:43.235484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:43.235484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:43.235484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:43.236848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:54:43.236848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:54:43.236848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:54:43.236848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:54:43.236848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:54:43.236848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:54:43.236848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:54:43.236848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:54:43.236848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 638/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:54:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:43.243576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcebd8-d29c-4b7f-8742-08049496cd7f None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:43.394006 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcebd8-d29c-4b7f-8742-08049496cd7f None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:43.462876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef8f83-efc5-462b-a5c6-05868723e0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:43.463546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef8f83-efc5-462b-a5c6-05868723e0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:43.463827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef8f83-efc5-462b-a5c6-05868723e0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:43.464103 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef8f83-efc5-462b-a5c6-05868723e0d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:43.464948 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef8f83-efc5-462b-a5c6-05868723e0d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:43.465280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef8f83-efc5-462b-a5c6-05868723e0d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:43.466832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef8f83-efc5-462b-a5c6-05868723e0d1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:43.481940 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 621/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:54:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:43.493009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b283ca6-b892-40fc-9335-282634d72d58 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:43.530319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:43.644492 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b283ca6-b892-40fc-9335-282634d72d58 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:43.690947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a72c12-2974-4019-a249-329c7003c579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:43.691947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a72c12-2974-4019-a249-329c7003c579 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:43.692334 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a72c12-2974-4019-a249-329c7003c579 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:43.692750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a72c12-2974-4019-a249-329c7003c579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:43.693913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a72c12-2974-4019-a249-329c7003c579 None admin] RBAC: Adding query filter params (role.id=b3f3f4910bf646699f30b749edeef422, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=bebc8414d01a40c8ab34afa9b1312a59) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:43.694309 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a72c12-2974-4019-a249-329c7003c579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:43.696140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a72c12-2974-4019-a249-329c7003c579 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:43.707684 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 639/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:54:43 2022] GET /identity/v3/role_assignments?user.id=bebc8414d01a40c8ab34afa9b1312a59&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=b3f3f4910bf646699f30b749edeef422 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:46.075242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e276ea-9763-40e8-ba53-17f5bef8791b None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:46.075814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e276ea-9763-40e8-ba53-17f5bef8791b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:46.075814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e276ea-9763-40e8-ba53-17f5bef8791b None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:46.077208 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 622/1261] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:54:46.084100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedcb67-e383-4b2f-b555-4034217ba5f3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:46.084672 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedcb67-e383-4b2f-b555-4034217ba5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:46.084672 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedcb67-e383-4b2f-b555-4034217ba5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:46.103638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-eaedcb67-e383-4b2f-b555-4034217ba5f3 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:54:46.104925 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-eaedcb67-e383-4b2f-b555-4034217ba5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:54:46.183660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 640/1262] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:54:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:54:46.209084 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e276ea-9763-40e8-ba53-17f5bef8791b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:46.223266 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:46.344609 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e276ea-9763-40e8-ba53-17f5bef8791b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:46.385716 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cfe11-75c9-4a40-8048-c71af4da8063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:46.386520 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cfe11-75c9-4a40-8048-c71af4da8063 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:46.386801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cfe11-75c9-4a40-8048-c71af4da8063 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:46.387071 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cfe11-75c9-4a40-8048-c71af4da8063 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:46.399669 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cfe11-75c9-4a40-8048-c71af4da8063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:54:46.408245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-ef6cfe11-75c9-4a40-8048-c71af4da8063 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:54:46.408245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:46.408245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:46.408245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:46.408245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:46.408245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:46.408245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:46.408245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:46.408245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:46.408245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:46.408245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:46.408245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:46.408245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:54:46.408245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:54:46.408245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:54:46.408245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:54:46.410224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:54:46.410224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:54:46.410224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:54:46.410224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:54:46.410224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:46.410224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:46.410224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:46.410224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:46.410224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:46.410224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:46.410224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:46.410224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:54:46.410224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:46.410224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:46.410224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:46.410224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:46.411906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:46.411906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:46.411906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:46.411906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:46.411906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:54:46.411906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:54:46.411906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:54:46.411906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:54:46.411906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:54:46.411906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:54:46.411906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:54:46.411906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:54:46.411906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 623/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:54:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:46.415822 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedcb67-e383-4b2f-b555-4034217ba5f3 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:46.436941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:46.535862 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedcb67-e383-4b2f-b555-4034217ba5f3 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:46.574425 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e2183-e5da-4512-9237-ebe993227976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:46.575112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e2183-e5da-4512-9237-ebe993227976 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:46.575400 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e2183-e5da-4512-9237-ebe993227976 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:46.575679 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e2183-e5da-4512-9237-ebe993227976 None admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:46.576444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e2183-e5da-4512-9237-ebe993227976 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:46.576758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e2183-e5da-4512-9237-ebe993227976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:46.578202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e2183-e5da-4512-9237-ebe993227976 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:46.588247 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 641/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:54:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:46.598557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cfe11-75c9-4a40-8048-c71af4da8063 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:46.723336 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:46.775272 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cfe11-75c9-4a40-8048-c71af4da8063 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:46.814734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ccf52-37ab-4cbe-bb7d-569a293b0bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:46.815538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ccf52-37ab-4cbe-bb7d-569a293b0bdc None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:46.815819 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ccf52-37ab-4cbe-bb7d-569a293b0bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:46.816093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ccf52-37ab-4cbe-bb7d-569a293b0bdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:46.828159 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ccf52-37ab-4cbe-bb7d-569a293b0bdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:46.830323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ccf52-37ab-4cbe-bb7d-569a293b0bdc None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:46.849887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-818ccf52-37ab-4cbe-bb7d-569a293b0bdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:46.849887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:46.849887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:46.849887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:46.849887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:46.849887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:46.849887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:46.849887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:46.849887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:46.849887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:46.849887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:46.849887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:46.849887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:54:46.849887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:54:46.849887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:54:46.851656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:54:46.851656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:46.851656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:46.851656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:46.851656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:46.851656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:46.851656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:46.851656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:46.851656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:54:46.851656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:46.851656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:46.851656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:46.851656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:46.851656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:46.851656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:46.851656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:46.851656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:46.853429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:54:46.853429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:54:46.853429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:46.853429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:54:46.853429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 624/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:46.857116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e2183-e5da-4512-9237-ebe993227976 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:46.956009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:46.979514 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e2183-e5da-4512-9237-ebe993227976 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:47.019590 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb57d97-213b-4626-9127-1cb00b3c9687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:47.020351 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb57d97-213b-4626-9127-1cb00b3c9687 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:47.020677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb57d97-213b-4626-9127-1cb00b3c9687 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:47.020999 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb57d97-213b-4626-9127-1cb00b3c9687 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:47.021848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb57d97-213b-4626-9127-1cb00b3c9687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:47.022207 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb57d97-213b-4626-9127-1cb00b3c9687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:47.023677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb57d97-213b-4626-9127-1cb00b3c9687 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:47.038560 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 642/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:47.044605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ccf52-37ab-4cbe-bb7d-569a293b0bdc None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:47.169042 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ccf52-37ab-4cbe-bb7d-569a293b0bdc None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:47.193076 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:47.211050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981e029-3aa0-4767-b090-33d17d07730b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:47.211919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981e029-3aa0-4767-b090-33d17d07730b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:47.212249 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981e029-3aa0-4767-b090-33d17d07730b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:47.212568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981e029-3aa0-4767-b090-33d17d07730b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:47.222122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981e029-3aa0-4767-b090-33d17d07730b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:47.223689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981e029-3aa0-4767-b090-33d17d07730b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:47.240230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-7981e029-3aa0-4767-b090-33d17d07730b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 16:54:47.240230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:47.240230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:47.240230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:47.240230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:47.240230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:47.240230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:47.240230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:47.240230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:47.240230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:47.240230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:47.240230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:47.240230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:54:47.240230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:54:47.240230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:54:47.240230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:54:47.242152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:47.242152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:47.242152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:54:47.242152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:54:47.242152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:54:47.242152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:54:47.242152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:47.242152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:47.242152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:47.242152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:47.242152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:47.242152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:54:47.242152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:47.242152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:47.242152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:47.242152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:47.242152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:47.242152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:47.244010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:47.244010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:47.244010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:54:47.244010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:54:47.244010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:54:47.244010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:54:47.244010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:54:47.244010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:54:47.244010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 16:54:47.244010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:54:47.244010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 625/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:47.248967 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb57d97-213b-4626-9127-1cb00b3c9687 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:47.366413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb57d97-213b-4626-9127-1cb00b3c9687 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:47.409436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf14040-21e4-4527-a7fa-efdf55304cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:47.410164 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf14040-21e4-4527-a7fa-efdf55304cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:47.410451 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf14040-21e4-4527-a7fa-efdf55304cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:47.410732 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf14040-21e4-4527-a7fa-efdf55304cd4 None admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:47.411605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf14040-21e4-4527-a7fa-efdf55304cd4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:47.411922 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf14040-21e4-4527-a7fa-efdf55304cd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:47.413407 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf14040-21e4-4527-a7fa-efdf55304cd4 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:47.424414 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:47.435132 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 643/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Wed May 18 16:54:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:47.441764 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981e029-3aa0-4767-b090-33d17d07730b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:47.564733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981e029-3aa0-4767-b090-33d17d07730b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:47.604783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53e493-1b82-4249-b9de-a9084f75699b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:47.605578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53e493-1b82-4249-b9de-a9084f75699b None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:47.605885 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53e493-1b82-4249-b9de-a9084f75699b None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:47.606163 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53e493-1b82-4249-b9de-a9084f75699b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:47.619471 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53e493-1b82-4249-b9de-a9084f75699b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:47.620965 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53e493-1b82-4249-b9de-a9084f75699b None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:47.640783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-be53e493-1b82-4249-b9de-a9084f75699b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:47.640783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:47.640783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:47.640783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:47.640783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:47.640783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:47.640783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:47.640783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:47.640783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:47.640783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:47.640783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:47.640783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:47.640783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:54:47.640783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:54:47.640783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:54:47.642211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:54:47.642211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:47.642211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:47.642211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:47.642211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:47.642211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:47.642211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:47.642211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:47.642211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:54:47.642211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:47.642211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:47.642211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:47.642211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:47.642211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:47.642211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:47.642211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:47.642211 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:47.643434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:54:47.643434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:54:47.643434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:47.643434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:54:47.643434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 626/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:54:47.648961 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf14040-21e4-4527-a7fa-efdf55304cd4 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:47.785791 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf14040-21e4-4527-a7fa-efdf55304cd4 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:47.826979 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308176be-736c-4bab-82c7-ba371034b82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:47.827671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308176be-736c-4bab-82c7-ba371034b82f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:47.827955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308176be-736c-4bab-82c7-ba371034b82f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:47.828229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308176be-736c-4bab-82c7-ba371034b82f None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:47.829905 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308176be-736c-4bab-82c7-ba371034b82f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:47.830284 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308176be-736c-4bab-82c7-ba371034b82f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:47.831926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308176be-736c-4bab-82c7-ba371034b82f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:47.846349 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 644/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:54:47.852543 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53e493-1b82-4249-b9de-a9084f75699b None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:47.893319 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:47.977181 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53e493-1b82-4249-b9de-a9084f75699b None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:48.019203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed3fda-f809-4824-985b-be2963495d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:48.020046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed3fda-f809-4824-985b-be2963495d5d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:48.020375 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed3fda-f809-4824-985b-be2963495d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:48.020661 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed3fda-f809-4824-985b-be2963495d5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:48.028510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed3fda-f809-4824-985b-be2963495d5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:48.030028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed3fda-f809-4824-985b-be2963495d5d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:48.053370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-b7ed3fda-f809-4824-985b-be2963495d5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:54:48.053370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:48.053370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:48.053370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:48.053370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:48.053370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:48.053370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:48.053370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:48.053370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:48.053370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:48.053370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:48.053370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:48.053370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:54:48.053370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:54:48.053370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:54:48.055077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:54:48.055077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:48.055077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:48.055077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:48.055077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:48.055077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:48.055077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:48.055077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:48.055077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:54:48.055077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:48.055077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:48.055077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:48.055077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:48.055077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:48.055077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:48.055077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:48.055077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:48.056254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:54:48.056254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:54:48.056254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:54:48.056254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:54:48.056254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:54:48.056254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:54:48.056254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:54:48.056254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:54:48.056254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 627/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:54:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:54:48.062345 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308176be-736c-4bab-82c7-ba371034b82f None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:48.148047 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:48.225678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308176be-736c-4bab-82c7-ba371034b82f None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:48.267923 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5944d-89a5-417e-999a-7f2a78ed1f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:48.268605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5944d-89a5-417e-999a-7f2a78ed1f57 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:48.268879 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5944d-89a5-417e-999a-7f2a78ed1f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:48.269151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5944d-89a5-417e-999a-7f2a78ed1f57 None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:48.270001 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5944d-89a5-417e-999a-7f2a78ed1f57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:48.270313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5944d-89a5-417e-999a-7f2a78ed1f57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:48.271805 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5944d-89a5-417e-999a-7f2a78ed1f57 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:48.286180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 645/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:54:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:48.292503 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed3fda-f809-4824-985b-be2963495d5d None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:48.402564 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:48.414038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed3fda-f809-4824-985b-be2963495d5d None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:48.454922 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f74010-ce5c-4edc-8c16-62dbd285b1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:48.455821 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74010-ce5c-4edc-8c16-62dbd285b1b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:48.456096 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74010-ce5c-4edc-8c16-62dbd285b1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:48.456607 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74010-ce5c-4edc-8c16-62dbd285b1b1 None admin] PATH_INFO: `/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/bebc8414d01a40c8ab34afa9b1312a59/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:48.458750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f74010-ce5c-4edc-8c16-62dbd285b1b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcd3afbb3e384cb2939647002c60bbba, user_id=bebc8414d01a40c8ab34afa9b1312a59, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:48.460222 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f74010-ce5c-4edc-8c16-62dbd285b1b1 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:48.475830 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 628/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Wed May 18 16:54:48 2022] PUT /identity/v3/projects/fcd3afbb3e384cb2939647002c60bbba/users/bebc8414d01a40c8ab34afa9b1312a59/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 16:54:50.871404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6926da6-4b1a-4b40-b16f-1342967492f9 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:50.872021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6926da6-4b1a-4b40-b16f-1342967492f9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:50.872350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6926da6-4b1a-4b40-b16f-1342967492f9 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:50.875024 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 646/1274] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:54:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:54:50.881650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead00ad6-3a0b-4bab-bb4f-fa3f818d7b58 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:50.882224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead00ad6-3a0b-4bab-bb4f-fa3f818d7b58 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:50.882224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead00ad6-3a0b-4bab-bb4f-fa3f818d7b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:50.900768 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ead00ad6-3a0b-4bab-bb4f-fa3f818d7b58 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:54:50.902061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ead00ad6-3a0b-4bab-bb4f-fa3f818d7b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:54:50.983140 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 629/1275] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:54:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:54:51.007950 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6926da6-4b1a-4b40-b16f-1342967492f9 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:51.131860 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6926da6-4b1a-4b40-b16f-1342967492f9 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:51.153651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:51.186123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796c231-a41e-422a-9bf3-22e96b114f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:51.187520 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796c231-a41e-422a-9bf3-22e96b114f86 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:51.188695 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796c231-a41e-422a-9bf3-22e96b114f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:51.189178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796c231-a41e-422a-9bf3-22e96b114f86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:51.210936 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796c231-a41e-422a-9bf3-22e96b114f86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 18 16:54:51.227026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-8796c231-a41e-422a-9bf3-22e96b114f86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:54:51.227026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:51.227026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:51.227026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:51.227026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:51.227026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:51.227026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:51.227026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:51.227026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:51.227026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:51.227026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:51.227026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:51.227026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 18 16:54:51.227026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 18 16:54:51.227026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 18 16:54:51.227026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 18 16:54:51.228337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 18 16:54:51.228337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 18 16:54:51.228337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 18 16:54:51.228337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 18 16:54:51.228337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:51.228337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:51.228337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:51.228337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:51.228337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:51.228337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:51.228337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:51.228337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:54:51.228337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:51.228337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:51.228337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:51.228337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:51.229469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:51.229469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:51.229469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:51.229469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:51.229469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 18 16:54:51.229469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 18 16:54:51.229469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 18 16:54:51.229469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 18 16:54:51.229469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 18 16:54:51.229469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 18 16:54:51.229469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 18 16:54:51.229469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:54:51.229469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 647/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Wed May 18 16:54:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:54:51.239749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead00ad6-3a0b-4bab-bb4f-fa3f818d7b58 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:51.341271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:51.364106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead00ad6-3a0b-4bab-bb4f-fa3f818d7b58 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:51.403218 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fac25e-eee1-4650-8689-02bf6c26bb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:51.403873 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fac25e-eee1-4650-8689-02bf6c26bb36 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:51.404201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fac25e-eee1-4650-8689-02bf6c26bb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:51.404522 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fac25e-eee1-4650-8689-02bf6c26bb36 None admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:51.405346 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fac25e-eee1-4650-8689-02bf6c26bb36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:51.405725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fac25e-eee1-4650-8689-02bf6c26bb36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:51.408170 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fac25e-eee1-4650-8689-02bf6c26bb36 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:51.418242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 630/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Wed May 18 16:54:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:51.425462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796c231-a41e-422a-9bf3-22e96b114f86 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:51.545911 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796c231-a41e-422a-9bf3-22e96b114f86 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:51.587658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca09581-efcc-45c2-bcf9-2dc1c93b342b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:51.588462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca09581-efcc-45c2-bcf9-2dc1c93b342b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:51.588750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca09581-efcc-45c2-bcf9-2dc1c93b342b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:51.589028 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca09581-efcc-45c2-bcf9-2dc1c93b342b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:51.602718 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca09581-efcc-45c2-bcf9-2dc1c93b342b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:51.604309 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca09581-efcc-45c2-bcf9-2dc1c93b342b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:51.624872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-1ca09581-efcc-45c2-bcf9-2dc1c93b342b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:51.624872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:51.624872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:51.624872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:51.624872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:51.624872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:51.624872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:51.624872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:51.624872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:51.624872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:51.624872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:51.624872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:51.624872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:54:51.624872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:54:51.624872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:54:51.626565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:54:51.626565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:51.626565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:51.626565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:51.626565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:51.626565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:51.626565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:51.626565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:51.626565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:54:51.626565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:51.626565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:51.626565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:51.626565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:51.626565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:51.626565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:51.626565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:51.626565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:51.628540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:54:51.628540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:54:51.628540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:51.628540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:54:51.628540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 648/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:51.633848 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fac25e-eee1-4650-8689-02bf6c26bb36 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:51.764917 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fac25e-eee1-4650-8689-02bf6c26bb36 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:51.818302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f75a3-1712-4f03-8e97-1262b6142128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:51.819146 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f75a3-1712-4f03-8e97-1262b6142128 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:51.819516 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f75a3-1712-4f03-8e97-1262b6142128 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:51.819892 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f75a3-1712-4f03-8e97-1262b6142128 None admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:51.820827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f75a3-1712-4f03-8e97-1262b6142128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:51.821226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f75a3-1712-4f03-8e97-1262b6142128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:51.822824 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f75a3-1712-4f03-8e97-1262b6142128 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:51.838028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 631/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 16:54:51.845565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca09581-efcc-45c2-bcf9-2dc1c93b342b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:51.903830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:52.035943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca09581-efcc-45c2-bcf9-2dc1c93b342b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:52.085282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7e5ba-e3af-4d98-bd9e-2eb98198d753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:52.086188 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7e5ba-e3af-4d98-bd9e-2eb98198d753 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:52.086509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7e5ba-e3af-4d98-bd9e-2eb98198d753 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:52.086819 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7e5ba-e3af-4d98-bd9e-2eb98198d753 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:52.097496 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7e5ba-e3af-4d98-bd9e-2eb98198d753 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:52.099048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7e5ba-e3af-4d98-bd9e-2eb98198d753 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:52.115505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-8ee7e5ba-e3af-4d98-bd9e-2eb98198d753 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 18 16:54:52.115505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:52.115505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:52.115505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:52.115505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:52.115505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:52.115505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:52.115505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:52.115505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:52.115505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:52.115505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:52.115505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:52.115505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 18 16:54:52.115505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 18 16:54:52.115505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 18 16:54:52.115505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 18 16:54:52.117437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:52.117437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:52.117437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 18 16:54:52.117437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:54:52.117437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 18 16:54:52.117437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 18 16:54:52.117437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:52.117437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:52.117437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:52.117437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:52.117437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:52.117437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:54:52.117437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:52.117437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:52.117437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:52.117437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:52.117437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:52.117437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:52.119316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:52.119316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:52.119316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 18 16:54:52.119316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 18 16:54:52.119316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 18 16:54:52.119316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 18 16:54:52.119316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 18 16:54:52.119316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 18 16:54:52.119316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 18 16:54:52.119316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:54:52.119316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 649/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:52.125487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f75a3-1712-4f03-8e97-1262b6142128 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:52.130270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:52.312083 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f75a3-1712-4f03-8e97-1262b6142128 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:52.373587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ef535-b08a-4f1c-a5a1-42676e3f0857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:52.374697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ef535-b08a-4f1c-a5a1-42676e3f0857 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:52.375779 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ef535-b08a-4f1c-a5a1-42676e3f0857 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:52.376321 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ef535-b08a-4f1c-a5a1-42676e3f0857 None admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:52.377948 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ef535-b08a-4f1c-a5a1-42676e3f0857 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:52.378468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ef535-b08a-4f1c-a5a1-42676e3f0857 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:52.381168 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ef535-b08a-4f1c-a5a1-42676e3f0857 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:52.414461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 632/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Wed May 18 16:54:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:52.421064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7e5ba-e3af-4d98-bd9e-2eb98198d753 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:52.567945 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:52.580723 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7e5ba-e3af-4d98-bd9e-2eb98198d753 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:52.618398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0144d28-4fd9-4965-84f6-62352f6e2780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:52.619140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0144d28-4fd9-4965-84f6-62352f6e2780 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:52.619467 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0144d28-4fd9-4965-84f6-62352f6e2780 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:52.619785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0144d28-4fd9-4965-84f6-62352f6e2780 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:52.699636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0144d28-4fd9-4965-84f6-62352f6e2780 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:52.701142 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0144d28-4fd9-4965-84f6-62352f6e2780 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:52.810180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:52.822720 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 650/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Wed May 18 16:54:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 18 16:54:52.829934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ef535-b08a-4f1c-a5a1-42676e3f0857 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:52.909337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:52.958285 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ef535-b08a-4f1c-a5a1-42676e3f0857 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:53.002021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284c416-5dab-40d1-86ca-ff3e34911fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:53.002836 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284c416-5dab-40d1-86ca-ff3e34911fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:53.003116 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284c416-5dab-40d1-86ca-ff3e34911fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:53.003392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284c416-5dab-40d1-86ca-ff3e34911fb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:53.015076 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284c416-5dab-40d1-86ca-ff3e34911fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:53.017440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284c416-5dab-40d1-86ca-ff3e34911fb4 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:53.037617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-1284c416-5dab-40d1-86ca-ff3e34911fb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:53.037617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:53.037617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:53.037617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:53.037617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:53.037617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:53.037617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:53.037617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:53.037617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:53.037617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:53.037617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:53.037617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:53.037617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 18 16:54:53.037617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 18 16:54:53.037617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 18 16:54:53.039363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 18 16:54:53.039363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:53.039363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:53.039363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:53.039363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:53.039363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:53.039363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:53.039363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:53.039363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:54:53.039363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:53.039363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:53.039363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:53.039363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:53.039363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:53.039363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:53.039363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:53.039363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:53.041123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 18 16:54:53.041123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 18 16:54:53.041123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 18 16:54:53.041123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:54:53.041123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 633/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:54:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:53.046523 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0144d28-4fd9-4965-84f6-62352f6e2780 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:53.171498 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0144d28-4fd9-4965-84f6-62352f6e2780 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:53.212275 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98087ef2-6e47-4efa-b498-79976d927c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:53.213030 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98087ef2-6e47-4efa-b498-79976d927c39 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:53.213593 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98087ef2-6e47-4efa-b498-79976d927c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:53.213954 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98087ef2-6e47-4efa-b498-79976d927c39 None admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:53.214889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98087ef2-6e47-4efa-b498-79976d927c39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:53.215290 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98087ef2-6e47-4efa-b498-79976d927c39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:53.216880 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98087ef2-6e47-4efa-b498-79976d927c39 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:53.231080 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 651/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Wed May 18 16:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:53.238066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284c416-5dab-40d1-86ca-ff3e34911fb4 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:53.362606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284c416-5dab-40d1-86ca-ff3e34911fb4 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:53.380632 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:53.404993 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91343461-0612-48bc-b6e7-91af18042478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:53.405843 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91343461-0612-48bc-b6e7-91af18042478 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:53.406128 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91343461-0612-48bc-b6e7-91af18042478 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:53.406401 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91343461-0612-48bc-b6e7-91af18042478 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:53.414200 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91343461-0612-48bc-b6e7-91af18042478 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:53.415676 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91343461-0612-48bc-b6e7-91af18042478 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:53.431242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application [None req-91343461-0612-48bc-b6e7-91af18042478 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:54:53.431242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:53.431242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:53.431242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:53.431242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:53.431242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:53.431242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:53.431242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:53.431242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:53.431242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:53.431242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:53.431242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:53.431242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 18 16:54:53.431242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 18 16:54:53.431242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 18 16:54:53.433216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 18 16:54:53.433216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:53.433216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:53.433216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:53.433216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:53.433216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:53.433216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:53.433216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:53.433216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application with Lock( May 18 16:54:53.433216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:53.433216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:53.433216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:53.433216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:53.433216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:53.433216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:53.433216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:53.433216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:53.435176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 18 16:54:53.435176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 18 16:54:53.435176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 18 16:54:53.435176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 18 16:54:53.435176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 18 16:54:53.435176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 18 16:54:53.435176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 18 16:54:53.435176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: ERROR keystone.server.flask.application May 18 16:54:53.435176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 634/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Wed May 18 16:54:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:54:53.439223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98087ef2-6e47-4efa-b498-79976d927c39 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:53.497943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:53.564947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98087ef2-6e47-4efa-b498-79976d927c39 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:53.604981 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da449a16-c5d9-4b36-bcb8-c5decce0411f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:53.605765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da449a16-c5d9-4b36-bcb8-c5decce0411f None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:53.606100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da449a16-c5d9-4b36-bcb8-c5decce0411f None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:53.606418 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da449a16-c5d9-4b36-bcb8-c5decce0411f None admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:53.607310 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da449a16-c5d9-4b36-bcb8-c5decce0411f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:53.607677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da449a16-c5d9-4b36-bcb8-c5decce0411f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:53.609253 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da449a16-c5d9-4b36-bcb8-c5decce0411f None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:53.624567 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 652/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Wed May 18 16:54:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:53.634245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91343461-0612-48bc-b6e7-91af18042478 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:53.756928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91343461-0612-48bc-b6e7-91af18042478 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:53.797592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf422357-76d9-4aa5-bd8a-6e15d7d8ebc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:53.799084 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf422357-76d9-4aa5-bd8a-6e15d7d8ebc6 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:53.799366 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf422357-76d9-4aa5-bd8a-6e15d7d8ebc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:53.799648 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf422357-76d9-4aa5-bd8a-6e15d7d8ebc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:53.800539 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf422357-76d9-4aa5-bd8a-6e15d7d8ebc6 None admin] RBAC: Adding query filter params (role.id=b3f3f4910bf646699f30b749edeef422, scope.project.id=fcd3afbb3e384cb2939647002c60bbba, user.id=bebc8414d01a40c8ab34afa9b1312a59) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:53.800856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf422357-76d9-4aa5-bd8a-6e15d7d8ebc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:53.802453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf422357-76d9-4aa5-bd8a-6e15d7d8ebc6 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:53.809496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 635/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Wed May 18 16:54:53 2022] GET /identity/v3/role_assignments?user.id=bebc8414d01a40c8ab34afa9b1312a59&scope.project.id=fcd3afbb3e384cb2939647002c60bbba&role.id=b3f3f4910bf646699f30b749edeef422 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:56.203027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19612890-a123-4409-8e3c-20ba1d2af1aa None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:56.203648 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19612890-a123-4409-8e3c-20ba1d2af1aa None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:56.203648 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19612890-a123-4409-8e3c-20ba1d2af1aa None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:56.205122 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 653/1288] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:54:56.211858 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58410e6-ed55-49a7-ba0a-d5bd9dab703b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:56.212468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58410e6-ed55-49a7-ba0a-d5bd9dab703b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:56.212468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58410e6-ed55-49a7-ba0a-d5bd9dab703b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:56.234161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d58410e6-ed55-49a7-ba0a-d5bd9dab703b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:54:56.236008 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d58410e6-ed55-49a7-ba0a-d5bd9dab703b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:54:56.269593 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:56.315878 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 636/1289] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:54:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:54:56.339264 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19612890-a123-4409-8e3c-20ba1d2af1aa None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:56.462554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19612890-a123-4409-8e3c-20ba1d2af1aa None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:56.477014 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:56.505584 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b839bb-3405-4340-b25d-e54b102b2f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:56.506440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b839bb-3405-4340-b25d-e54b102b2f0b None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:56.506727 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b839bb-3405-4340-b25d-e54b102b2f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:56.507004 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b839bb-3405-4340-b25d-e54b102b2f0b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:56.507673 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b839bb-3405-4340-b25d-e54b102b2f0b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:56.509109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b839bb-3405-4340-b25d-e54b102b2f0b None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:56.522463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-19b839bb-3405-4340-b25d-e54b102b2f0b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 18 16:54:56.522463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:56.522463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:54:56.522463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:54:56.522463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:54:56.522463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:54:56.522463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:54:56.522463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:54:56.522463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 16:54:56.522463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:54:56.522463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:54:56.522463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:54:56.522463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:54:56.522463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:54:56.522463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:54:56.522463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:54:56.522463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:54:56.524413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:54:56.524413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:54:56.524413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:54:56.524413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:54:56.524413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:54:56.524413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:54:56.524413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:54:56.524413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:54:56.524413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:54:56.524413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:54:56.524413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:54:56.524413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:54:56.524413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:54:56.524413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:54:56.524413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:54:56.524413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:54:56.526069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:54:56.526069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:54:56.526069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:54:56.526069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:54:56.526069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:54:56.526069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:54:56.526069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:54:56.526069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:54:56.526069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:54:56.526069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:54:56.526069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:54:56.526069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:54:56.526069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 16:54:56.526069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:54:56.526069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 654/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 18 16:54:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 18 16:54:56.530333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58410e6-ed55-49a7-ba0a-d5bd9dab703b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:56.649703 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58410e6-ed55-49a7-ba0a-d5bd9dab703b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:56.688801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac8899-7bb9-40b9-b3f8-be4fd74e6ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:56.689485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac8899-7bb9-40b9-b3f8-be4fd74e6ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:56.689800 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac8899-7bb9-40b9-b3f8-be4fd74e6ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:56.690080 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac8899-7bb9-40b9-b3f8-be4fd74e6ae3 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:56.690811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac8899-7bb9-40b9-b3f8-be4fd74e6ae3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:56.691117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac8899-7bb9-40b9-b3f8-be4fd74e6ae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:56.692525 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac8899-7bb9-40b9-b3f8-be4fd74e6ae3 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:56.698173 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 637/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Wed May 18 16:54:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:56.707726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b839bb-3405-4340-b25d-e54b102b2f0b None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:56.844033 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b839bb-3405-4340-b25d-e54b102b2f0b None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:56.883053 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75d785-5014-4cae-901b-f258b5376be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:56.883789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75d785-5014-4cae-901b-f258b5376be3 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:56.884115 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75d785-5014-4cae-901b-f258b5376be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:56.884428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75d785-5014-4cae-901b-f258b5376be3 None admin] PATH_INFO: `/v3/services` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:56.885191 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75d785-5014-4cae-901b-f258b5376be3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:54:56.885541 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75d785-5014-4cae-901b-f258b5376be3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:56.887027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75d785-5014-4cae-901b-f258b5376be3 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:56.892961 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 655/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Wed May 18 16:54:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:54:59.310213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f816bd-078a-46e1-9853-a177e9b7fe45 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:59.310823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f816bd-078a-46e1-9853-a177e9b7fe45 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:59.310823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f816bd-078a-46e1-9853-a177e9b7fe45 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:59.312362 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 638/1293] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:54:59.319448 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8fcde-88d7-4e9d-89e2-dd195b88e71c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:59.320018 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8fcde-88d7-4e9d-89e2-dd195b88e71c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:59.320018 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8fcde-88d7-4e9d-89e2-dd195b88e71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:59.339823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-7be8fcde-88d7-4e9d-89e2-dd195b88e71c None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:54:59.341160 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7be8fcde-88d7-4e9d-89e2-dd195b88e71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:54:59.385520 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:59.433190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 656/1294] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:54:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:54:59.459400 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f816bd-078a-46e1-9853-a177e9b7fe45 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:54:59.507325 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:54:59.609048 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f816bd-078a-46e1-9853-a177e9b7fe45 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:54:59.660686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db924c5-74cd-4710-a1a9-86161bb03f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:54:59.661379 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db924c5-74cd-4710-a1a9-86161bb03f48 None admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:54:59.661700 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db924c5-74cd-4710-a1a9-86161bb03f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:54:59.661971 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db924c5-74cd-4710-a1a9-86161bb03f48 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:54:59.662710 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db924c5-74cd-4710-a1a9-86161bb03f48 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:54:59.664112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db924c5-74cd-4710-a1a9-86161bb03f48 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:54:59.680532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 639/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Wed May 18 16:54:59 2022] POST /identity/v3/services => generated 246 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:55:02.246421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf9533-34d0-45f4-b6ed-2afeb065b4fc None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:55:02.247063 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf9533-34d0-45f4-b6ed-2afeb065b4fc None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:55:02.247251 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf9533-34d0-45f4-b6ed-2afeb065b4fc None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:55:02.248815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 657/1296] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:55:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:55:02.258791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4556d77-57e6-48d6-a851-3aa8d02e5ef2 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:55:02.259355 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4556d77-57e6-48d6-a851-3aa8d02e5ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:55:02.259751 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4556d77-57e6-48d6-a851-3aa8d02e5ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:55:02.289828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a4556d77-57e6-48d6-a851-3aa8d02e5ef2 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:55:02.291719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a4556d77-57e6-48d6-a851-3aa8d02e5ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:55:02.424495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 640/1297] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:55:02 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 18 16:55:02.457843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf9533-34d0-45f4-b6ed-2afeb065b4fc None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:55:02.630660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf9533-34d0-45f4-b6ed-2afeb065b4fc None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:55:02.676678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ba84f-a640-42a6-80c4-99cecc970b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:55:02.677422 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ba84f-a640-42a6-80c4-99cecc970b2a None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:55:02.677740 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ba84f-a640-42a6-80c4-99cecc970b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:55:02.678021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ba84f-a640-42a6-80c4-99cecc970b2a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:55:02.678699 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ba84f-a640-42a6-80c4-99cecc970b2a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:55:02.680137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ba84f-a640-42a6-80c4-99cecc970b2a None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:55:02.700464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-a47ba84f-a640-42a6-80c4-99cecc970b2a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 18 16:55:02.700464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:55:02.700464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:55:02.700464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:55:02.700464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:55:02.700464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:55:02.700464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:55:02.700464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:55:02.700464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 16:55:02.700464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:55:02.700464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:55:02.700464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:55:02.700464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:55:02.700464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:55:02.700464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:55:02.700464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:55:02.700464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:55:02.701613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:55:02.701613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:55:02.701613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:55:02.701613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:55:02.701613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:55:02.701613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:55:02.701613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:55:02.701613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:55:02.701613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:55:02.701613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:55:02.701613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:55:02.701613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:55:02.701613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:55:02.701613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:55:02.701613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:55:02.701613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:55:02.702559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:55:02.702559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:55:02.702559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:55:02.702559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:55:02.702559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:55:02.702559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:55:02.702559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:55:02.702559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:55:02.702559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:55:02.702559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:55:02.702559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:55:02.702559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:55:02.702559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 16:55:02.702559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:55:02.703815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 658/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 18 16:55:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:55:02.711014 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4556d77-57e6-48d6-a851-3aa8d02e5ef2 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:55:02.732827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:55:02.854638 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4556d77-57e6-48d6-a851-3aa8d02e5ef2 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:55:02.893933 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a54d1-ca2d-4514-bbcf-b1dd7aab6c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:55:02.894529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a54d1-ca2d-4514-bbcf-b1dd7aab6c21 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:55:02.894815 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a54d1-ca2d-4514-bbcf-b1dd7aab6c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:55:02.895092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a54d1-ca2d-4514-bbcf-b1dd7aab6c21 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:55:02.895823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a54d1-ca2d-4514-bbcf-b1dd7aab6c21 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:55:02.896130 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a54d1-ca2d-4514-bbcf-b1dd7aab6c21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:55:02.897541 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a54d1-ca2d-4514-bbcf-b1dd7aab6c21 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:55:02.903600 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 641/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Wed May 18 16:55:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:55:02.910467 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ba84f-a640-42a6-80c4-99cecc970b2a None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:55:02.952541 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:55:03.037981 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ba84f-a640-42a6-80c4-99cecc970b2a None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:55:03.082373 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb860d-5499-4f61-aa46-16f28fbc9ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:55:03.083071 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb860d-5499-4f61-aa46-16f28fbc9ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:55:03.083360 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb860d-5499-4f61-aa46-16f28fbc9ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:55:03.083638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb860d-5499-4f61-aa46-16f28fbc9ab2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:55:03.084480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb860d-5499-4f61-aa46-16f28fbc9ab2 None admin] RBAC: Adding query filter params (interface=public, service_id=348d5a366c5142c6a70ed062d9965795, region_id=RegionOne) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:55:03.084799 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb860d-5499-4f61-aa46-16f28fbc9ab2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:55:03.086307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb860d-5499-4f61-aa46-16f28fbc9ab2 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:55:03.092744 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 659/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Wed May 18 16:55:02 2022] GET /identity/v3/endpoints?service_id=348d5a366c5142c6a70ed062d9965795&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:55:03.099524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a54d1-ca2d-4514-bbcf-b1dd7aab6c21 None admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:55:03.198235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:55:03.220705 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a54d1-ca2d-4514-bbcf-b1dd7aab6c21 None admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:55:03.260850 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d2ff7-3052-4d32-9d81-2514ae857c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:55:03.261578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d2ff7-3052-4d32-9d81-2514ae857c2d None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:55:03.261915 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d2ff7-3052-4d32-9d81-2514ae857c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:55:03.262194 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d2ff7-3052-4d32-9d81-2514ae857c2d None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:55:03.262896 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d2ff7-3052-4d32-9d81-2514ae857c2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:55:03.264315 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d2ff7-3052-4d32-9d81-2514ae857c2d None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:55:03.272847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 642/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Wed May 18 16:55:03 2022] GET /identity/v3/services => generated 2191 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 16:55:05.744032 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4670f6-3eeb-45ec-860e-f6ec2a01409f None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:55:05.744642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4670f6-3eeb-45ec-860e-f6ec2a01409f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:55:05.744642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4670f6-3eeb-45ec-860e-f6ec2a01409f None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:55:05.746068 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 660/1302] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:55:05.752921 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83408836-6200-4ae3-b1a9-d0c75a35ab9b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:55:05.753490 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83408836-6200-4ae3-b1a9-d0c75a35ab9b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:55:05.753590 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83408836-6200-4ae3-b1a9-d0c75a35ab9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:55:05.774516 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-83408836-6200-4ae3-b1a9-d0c75a35ab9b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:55:05.775912 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-83408836-6200-4ae3-b1a9-d0c75a35ab9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:55:05.863024 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 643/1303] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:55:05 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 18 16:55:05.887813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4670f6-3eeb-45ec-860e-f6ec2a01409f None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:55:06.005458 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:55:06.013792 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4670f6-3eeb-45ec-860e-f6ec2a01409f None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:55:06.052876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4091d49-0331-40f4-bded-c5a6dda8ab30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:55:06.053734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4091d49-0331-40f4-bded-c5a6dda8ab30 None admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:55:06.054023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4091d49-0331-40f4-bded-c5a6dda8ab30 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:55:06.054284 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4091d49-0331-40f4-bded-c5a6dda8ab30 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:55:06.054966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4091d49-0331-40f4-bded-c5a6dda8ab30 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:55:06.056388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4091d49-0331-40f4-bded-c5a6dda8ab30 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:55:06.074625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application [None req-c4091d49-0331-40f4-bded-c5a6dda8ab30 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 18 16:55:06.074625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:55:06.074625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 18 16:55:06.074625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 18 16:55:06.074625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 18 16:55:06.074625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 18 16:55:06.074625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 18 16:55:06.074625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:55:06.074625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 16:55:06.074625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:55:06.074625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 18 16:55:06.074625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:55:06.074625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 18 16:55:06.074625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 18 16:55:06.074625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 18 16:55:06.074625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 18 16:55:06.074625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 18 16:55:06.076036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 18 16:55:06.076036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 18 16:55:06.076036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 18 16:55:06.076036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 18 16:55:06.076036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 18 16:55:06.076036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 18 16:55:06.076036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 18 16:55:06.076036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 18 16:55:06.076036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 18 16:55:06.076036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 18 16:55:06.076036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 18 16:55:06.076036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 18 16:55:06.076036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 18 16:55:06.076036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 18 16:55:06.076036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 18 16:55:06.076036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.get_or_create( May 18 16:55:06.077124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 18 16:55:06.077124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application with Lock( May 18 16:55:06.077124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 18 16:55:06.077124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self._enter() May 18 16:55:06.077124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 18 16:55:06.077124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 18 16:55:06.077124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 18 16:55:06.077124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application return self.creator() May 18 16:55:06.077124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 18 16:55:06.077124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application created_value = creator( May 18 16:55:06.077124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 18 16:55:06.077124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 18 16:55:06.077124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 18 16:55:06.077124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: ERROR keystone.server.flask.application May 18 16:55:06.077124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 661/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Wed May 18 16:55:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 18 16:55:06.087379 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83408836-6200-4ae3-b1a9-d0c75a35ab9b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:55:06.179756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:55:06.209038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83408836-6200-4ae3-b1a9-d0c75a35ab9b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:55:06.250987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfb9c7-71c8-4a2c-97a9-d7532f027b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:55:06.251675 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfb9c7-71c8-4a2c-97a9-d7532f027b61 None admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:55:06.251966 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfb9c7-71c8-4a2c-97a9-d7532f027b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:55:06.252241 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfb9c7-71c8-4a2c-97a9-d7532f027b61 None admin] PATH_INFO: `/v3/services` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:55:06.252974 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfb9c7-71c8-4a2c-97a9-d7532f027b61 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 16:55:06.253277 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfb9c7-71c8-4a2c-97a9-d7532f027b61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:55:06.254708 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfb9c7-71c8-4a2c-97a9-d7532f027b61 None admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:55:06.261167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 644/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Wed May 18 16:55:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 16:55:06.271175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4091d49-0331-40f4-bded-c5a6dda8ab30 None admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:55:06.391176 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4091d49-0331-40f4-bded-c5a6dda8ab30 None admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:55:06.433680 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe39db7-834f-428c-9d98-b7b30eec1f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:55:06.434497 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe39db7-834f-428c-9d98-b7b30eec1f05 None admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:55:06.434785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe39db7-834f-428c-9d98-b7b30eec1f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:55:06.435066 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe39db7-834f-428c-9d98-b7b30eec1f05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:55:06.435881 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe39db7-834f-428c-9d98-b7b30eec1f05 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:55:06.437422 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe39db7-834f-428c-9d98-b7b30eec1f05 None admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:55:06.464273 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 662/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Wed May 18 16:55:06 2022] POST /identity/v3/endpoints => generated 331 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 16:55:16.257585 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=30 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:55:16.457122 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:56:24.210135 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12946d6-97de-4066-ba24-bcb05272e227 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:24.211349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12946d6-97de-4066-ba24-bcb05272e227 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:24.211799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12946d6-97de-4066-ba24-bcb05272e227 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:24.213439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 645/1307] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:56:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:56:24.219535 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaf135-874e-4e36-bd1b-433233abe0bb None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:24.220094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaf135-874e-4e36-bd1b-433233abe0bb None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:24.220453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaf135-874e-4e36-bd1b-433233abe0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:24.390681 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-8ebaf135-874e-4e36-bd1b-433233abe0bb None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:56:24.392379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8ebaf135-874e-4e36-bd1b-433233abe0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:24.680680 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 663/1308] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:56:24.765769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041815f3-a69b-46f4-810f-b63c0e3bfee8 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:24.766818 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041815f3-a69b-46f4-810f-b63c0e3bfee8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:24.767275 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041815f3-a69b-46f4-810f-b63c0e3bfee8 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:24.768905 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 646/1309] 10.222.0.49 () {54 vars in 964 bytes} [Wed May 18 16:56:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:56:24.779684 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82727c72-0c22-468c-b0a9-75cece13c82a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:24.780823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82727c72-0c22-468c-b0a9-75cece13c82a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:24.781329 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82727c72-0c22-468c-b0a9-75cece13c82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:25.045238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-82727c72-0c22-468c-b0a9-75cece13c82a None None] MFA Rules not processed for user `d35f21c5cc7c433882eb5fbe9a8072f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:56:25.048425 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-82727c72-0c22-468c-b0a9-75cece13c82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:25.098644 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:56:25.365002 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 664/1310] 10.222.0.49 () {58 vars in 1061 bytes} [Wed May 18 16:56:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 587 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:56:25.392495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041815f3-a69b-46f4-810f-b63c0e3bfee8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:56:25.396791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-041815f3-a69b-46f4-810f-b63c0e3bfee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:25.649186 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041815f3-a69b-46f4-810f-b63c0e3bfee8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:56:25.807060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f7702-9c3f-4b9d-936f-2a5e7a9ab720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:56:25.808855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f7702-9c3f-4b9d-936f-2a5e7a9ab720 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:25.809759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f7702-9c3f-4b9d-936f-2a5e7a9ab720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:25.810622 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f7702-9c3f-4b9d-936f-2a5e7a9ab720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:25.815400 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-101f7702-9c3f-4b9d-936f-2a5e7a9ab720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:25.927994 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:56:26.044859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f7702-9c3f-4b9d-936f-2a5e7a9ab720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:56:26.048834 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f7702-9c3f-4b9d-936f-2a5e7a9ab720 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:56:26.108861 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 647/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:56:29.077172 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e75f11-2476-4e8a-a6ad-851cf9cb6e77 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:29.077848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e75f11-2476-4e8a-a6ad-851cf9cb6e77 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:29.077848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e75f11-2476-4e8a-a6ad-851cf9cb6e77 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:29.079173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 665/1312] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:56:29.085220 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d60e3-c31b-4cea-b224-8aeb86407c38 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:29.086117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d60e3-c31b-4cea-b224-8aeb86407c38 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:29.086117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d60e3-c31b-4cea-b224-8aeb86407c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:29.181371 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5d5d60e3-c31b-4cea-b224-8aeb86407c38 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:56:29.182654 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5d5d60e3-c31b-4cea-b224-8aeb86407c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:29.315287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 648/1313] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:56:29.354843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e75f11-2476-4e8a-a6ad-851cf9cb6e77 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:56:29.356402 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d0e75f11-2476-4e8a-a6ad-851cf9cb6e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:29.471531 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e75f11-2476-4e8a-a6ad-851cf9cb6e77 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:56:29.549117 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:56:29.551668 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084ea59-3919-4cb4-8d2e-3cc0f69a5cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:56:29.552372 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084ea59-3919-4cb4-8d2e-3cc0f69a5cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:29.552908 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084ea59-3919-4cb4-8d2e-3cc0f69a5cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:29.553246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084ea59-3919-4cb4-8d2e-3cc0f69a5cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:29.555450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6084ea59-3919-4cb4-8d2e-3cc0f69a5cf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:29.682297 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084ea59-3919-4cb4-8d2e-3cc0f69a5cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:56:29.683872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084ea59-3919-4cb4-8d2e-3cc0f69a5cf8 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:56:29.706839 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 666/1314] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:56:32.536105 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc58195-b341-4ad8-b49e-0bd0532143ec None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:32.536726 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc58195-b341-4ad8-b49e-0bd0532143ec None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:32.536726 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc58195-b341-4ad8-b49e-0bd0532143ec None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:32.538116 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 649/1315] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:56:32.544020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fd13f-acab-4cd4-b1d7-e36912bbd3a7 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:32.544671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fd13f-acab-4cd4-b1d7-e36912bbd3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:32.544671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fd13f-acab-4cd4-b1d7-e36912bbd3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:32.624896 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ae0fd13f-acab-4cd4-b1d7-e36912bbd3a7 None None] MFA Rules not processed for user `24330ac4626a45eab74e07e162c2297b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:56:32.626424 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ae0fd13f-acab-4cd4-b1d7-e36912bbd3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:32.689992 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:56:32.749758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 667/1316] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 16:56:32.831038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84475f-66b1-4d3e-a6c7-a5e9c3cd5e44 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:32.831465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84475f-66b1-4d3e-a6c7-a5e9c3cd5e44 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:32.831840 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84475f-66b1-4d3e-a6c7-a5e9c3cd5e44 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:32.833684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 650/1317] 10.222.0.49 () {54 vars in 964 bytes} [Wed May 18 16:56:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:56:32.841462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a10a9-486d-4104-a89a-c2b444ea54a0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:32.841842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a10a9-486d-4104-a89a-c2b444ea54a0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:32.843022 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a10a9-486d-4104-a89a-c2b444ea54a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:32.934992 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ff1a10a9-486d-4104-a89a-c2b444ea54a0 None None] MFA Rules not processed for user `d35f21c5cc7c433882eb5fbe9a8072f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:56:32.936523 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ff1a10a9-486d-4104-a89a-c2b444ea54a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:33.027844 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 668/1318] 10.222.0.49 () {58 vars in 1061 bytes} [Wed May 18 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:56:33.038004 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84475f-66b1-4d3e-a6c7-a5e9c3cd5e44 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:56:33.039635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ed84475f-66b1-4d3e-a6c7-a5e9c3cd5e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:33.051455 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:56:33.163860 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84475f-66b1-4d3e-a6c7-a5e9c3cd5e44 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:56:33.288552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425e05b-e1c6-4c42-a9e9-4c5782ceaf45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:56:33.289699 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425e05b-e1c6-4c42-a9e9-4c5782ceaf45 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:33.290257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425e05b-e1c6-4c42-a9e9-4c5782ceaf45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:33.290767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425e05b-e1c6-4c42-a9e9-4c5782ceaf45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:33.294220 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7425e05b-e1c6-4c42-a9e9-4c5782ceaf45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:33.386809 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:56:33.442504 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425e05b-e1c6-4c42-a9e9-4c5782ceaf45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:56:33.444323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425e05b-e1c6-4c42-a9e9-4c5782ceaf45 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:56:33.466583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 651/1319] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:56:33 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:56:37.130305 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52338f-b39d-45f9-b19c-46f90745c154 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:37.130841 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52338f-b39d-45f9-b19c-46f90745c154 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:37.130976 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52338f-b39d-45f9-b19c-46f90745c154 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:37.132278 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 669/1320] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:56:37.141802 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3404c7-499b-47db-a39f-270aeea569ae None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:37.142397 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3404c7-499b-47db-a39f-270aeea569ae None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:37.142850 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3404c7-499b-47db-a39f-270aeea569ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:37.245584 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-af3404c7-499b-47db-a39f-270aeea569ae None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:56:37.246995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-af3404c7-499b-47db-a39f-270aeea569ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:37.365394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 652/1321] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:56:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:56:37.419078 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52338f-b39d-45f9-b19c-46f90745c154 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:56:37.420742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6c52338f-b39d-45f9-b19c-46f90745c154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:37.483298 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:56:37.552867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52338f-b39d-45f9-b19c-46f90745c154 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:56:37.681182 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209d55e-03ef-4053-be1e-caa6541273ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:56:37.682338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209d55e-03ef-4053-be1e-caa6541273ee service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:37.682842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209d55e-03ef-4053-be1e-caa6541273ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:37.683356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209d55e-03ef-4053-be1e-caa6541273ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:37.687378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a209d55e-03ef-4053-be1e-caa6541273ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:37.826331 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:56:37.844658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209d55e-03ef-4053-be1e-caa6541273ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:56:37.846375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209d55e-03ef-4053-be1e-caa6541273ee service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:56:37.867347 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 670/1322] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:56:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:56:41.267842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b2ff1-204a-4f36-937e-4d9d36607983 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:41.268375 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b2ff1-204a-4f36-937e-4d9d36607983 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:41.268557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b2ff1-204a-4f36-937e-4d9d36607983 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:41.270879 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 653/1323] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:56:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:56:41.277105 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5985e98-2bd7-46f5-b761-4252f7da8e44 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:41.277638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5985e98-2bd7-46f5-b761-4252f7da8e44 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:41.277855 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5985e98-2bd7-46f5-b761-4252f7da8e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:41.361102 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e5985e98-2bd7-46f5-b761-4252f7da8e44 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:56:41.362558 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e5985e98-2bd7-46f5-b761-4252f7da8e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:41.471635 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 671/1324] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:56:41.509088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b2ff1-204a-4f36-937e-4d9d36607983 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:56:41.510877 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e56b2ff1-204a-4f36-937e-4d9d36607983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:41.531506 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:56:41.657779 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b2ff1-204a-4f36-937e-4d9d36607983 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:56:41.772351 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7009c7b-f2ef-4161-98c6-5a33131c83f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:56:41.773012 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7009c7b-f2ef-4161-98c6-5a33131c83f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:41.773520 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7009c7b-f2ef-4161-98c6-5a33131c83f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:41.773758 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7009c7b-f2ef-4161-98c6-5a33131c83f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:41.776003 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d7009c7b-f2ef-4161-98c6-5a33131c83f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:41.918625 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:56:41.977703 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7009c7b-f2ef-4161-98c6-5a33131c83f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:56:41.979212 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7009c7b-f2ef-4161-98c6-5a33131c83f8 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:56:42.012993 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 654/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:56:44.495209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9e00d-2124-4b56-a0d2-23bb47b5401b None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:44.496029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9e00d-2124-4b56-a0d2-23bb47b5401b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:44.496029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9e00d-2124-4b56-a0d2-23bb47b5401b None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:44.497196 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 672/1326] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:56:44.507335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f395668-9127-4e58-9b2e-57e5a65a2890 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:44.507949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f395668-9127-4e58-9b2e-57e5a65a2890 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:44.508224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f395668-9127-4e58-9b2e-57e5a65a2890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:44.588956 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9f395668-9127-4e58-9b2e-57e5a65a2890 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:56:44.590258 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9f395668-9127-4e58-9b2e-57e5a65a2890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:44.710793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 655/1327] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:56:44.747545 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9e00d-2124-4b56-a0d2-23bb47b5401b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:56:44.749097 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1df9e00d-2124-4b56-a0d2-23bb47b5401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:44.822019 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:56:44.876857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9e00d-2124-4b56-a0d2-23bb47b5401b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:56:44.983437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458eba78-193c-4b2f-b538-d60fa722d072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:56:44.984242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eba78-193c-4b2f-b538-d60fa722d072 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:44.984614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eba78-193c-4b2f-b538-d60fa722d072 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:44.985004 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458eba78-193c-4b2f-b538-d60fa722d072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:44.987006 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-458eba78-193c-4b2f-b538-d60fa722d072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:45.157395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:56:45.160652 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458eba78-193c-4b2f-b538-d60fa722d072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:56:45.162166 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458eba78-193c-4b2f-b538-d60fa722d072 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:56:45.185201 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 673/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:56:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:56:47.874335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9f8c2-e9dd-46f2-a7b5-d1f627e661a9 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:47.875153 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9f8c2-e9dd-46f2-a7b5-d1f627e661a9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:47.875153 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9f8c2-e9dd-46f2-a7b5-d1f627e661a9 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:47.878131 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 656/1329] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:56:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:56:47.888055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ca084-c768-4ee8-9fa4-c8b003822c50 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:47.888637 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ca084-c768-4ee8-9fa4-c8b003822c50 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:47.889256 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ca084-c768-4ee8-9fa4-c8b003822c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:48.008377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-611ca084-c768-4ee8-9fa4-c8b003822c50 None None] MFA Rules not processed for user `24330ac4626a45eab74e07e162c2297b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:56:48.010007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-611ca084-c768-4ee8-9fa4-c8b003822c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:48.155811 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 674/1330] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:56:47 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:56:48.205745 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9f8c2-e9dd-46f2-a7b5-d1f627e661a9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:56:48.207630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9ef9f8c2-e9dd-46f2-a7b5-d1f627e661a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:48.250209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:56:48.349499 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9f8c2-e9dd-46f2-a7b5-d1f627e661a9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:56:48.451842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946a4ae-ec68-406b-ac9b-43094e9cc7e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:56:48.452887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946a4ae-ec68-406b-ac9b-43094e9cc7e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:48.453179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946a4ae-ec68-406b-ac9b-43094e9cc7e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:48.453449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946a4ae-ec68-406b-ac9b-43094e9cc7e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:48.455302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5946a4ae-ec68-406b-ac9b-43094e9cc7e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:48.562000 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:56:48.609317 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946a4ae-ec68-406b-ac9b-43094e9cc7e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:56:48.611970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946a4ae-ec68-406b-ac9b-43094e9cc7e4 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:56:48.641217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 657/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:56:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:56:51.950334 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161417e-0d97-447c-b32e-c2a923965777 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:51.951131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161417e-0d97-447c-b32e-c2a923965777 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:51.951131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161417e-0d97-447c-b32e-c2a923965777 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:51.958461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 675/1332] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:56:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:56:51.961392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81a1f2-5e22-4c53-97ad-20f0a7d811db None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:51.962349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81a1f2-5e22-4c53-97ad-20f0a7d811db None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:51.963032 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81a1f2-5e22-4c53-97ad-20f0a7d811db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:52.079973 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-bc81a1f2-5e22-4c53-97ad-20f0a7d811db None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:56:52.081243 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bc81a1f2-5e22-4c53-97ad-20f0a7d811db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:52.243116 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 658/1333] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:56:52.301252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161417e-0d97-447c-b32e-c2a923965777 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:56:52.302869 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3161417e-0d97-447c-b32e-c2a923965777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:52.396904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:56:52.456251 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161417e-0d97-447c-b32e-c2a923965777 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:56:52.548815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77127e4f-4ecd-45d5-90a5-a951babebf71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:56:52.549399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77127e4f-4ecd-45d5-90a5-a951babebf71 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:52.549705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77127e4f-4ecd-45d5-90a5-a951babebf71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:52.549991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77127e4f-4ecd-45d5-90a5-a951babebf71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:52.551771 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-77127e4f-4ecd-45d5-90a5-a951babebf71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:52.715472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77127e4f-4ecd-45d5-90a5-a951babebf71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:56:52.717650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77127e4f-4ecd-45d5-90a5-a951babebf71 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:56:52.730014 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:56:52.741038 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 676/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:56:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:56:55.173126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d2f8f-c87d-406f-af81-419842759ce1 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:55.173756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d2f8f-c87d-406f-af81-419842759ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:55.173756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d2f8f-c87d-406f-af81-419842759ce1 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:55.175391 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 659/1335] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:56:55.181778 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8cf4-13fd-45d3-b923-4186d877fad6 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:55.182619 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8cf4-13fd-45d3-b923-4186d877fad6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:55.182619 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8cf4-13fd-45d3-b923-4186d877fad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:55.266991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-3eba8cf4-13fd-45d3-b923-4186d877fad6 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:56:55.269639 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3eba8cf4-13fd-45d3-b923-4186d877fad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:55.415287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 677/1336] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:56:55.458237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d2f8f-c87d-406f-af81-419842759ce1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:56:55.460607 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-aa7d2f8f-c87d-406f-af81-419842759ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:55.513323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:56:55.581946 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d2f8f-c87d-406f-af81-419842759ce1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:56:55.598892 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b632e-f6f7-4872-96d7-bf15c2366813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:56:55.599550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b632e-f6f7-4872-96d7-bf15c2366813 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:55.599837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b632e-f6f7-4872-96d7-bf15c2366813 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:55.600117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b632e-f6f7-4872-96d7-bf15c2366813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:55.611365 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b632e-f6f7-4872-96d7-bf15c2366813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:56:55.612842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b632e-f6f7-4872-96d7-bf15c2366813 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:56:55.624696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 660/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:56:58.645627 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0313fce-90e5-4501-aa57-b21d4bd6cb01 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:58.646575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0313fce-90e5-4501-aa57-b21d4bd6cb01 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:58.646575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0313fce-90e5-4501-aa57-b21d4bd6cb01 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:58.648388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 678/1338] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:56:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:56:58.655087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c4e79-e512-40a2-a18e-1f7b61c0f053 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:58.655638 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c4e79-e512-40a2-a18e-1f7b61c0f053 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:58.656099 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c4e79-e512-40a2-a18e-1f7b61c0f053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:58.693542 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e90c4e79-e512-40a2-a18e-1f7b61c0f053 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:56:58.694793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e90c4e79-e512-40a2-a18e-1f7b61c0f053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:58.782028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 661/1339] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:56:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:56:58.824362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0313fce-90e5-4501-aa57-b21d4bd6cb01 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:56:58.826857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e0313fce-90e5-4501-aa57-b21d4bd6cb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:56:58.852216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0313fce-90e5-4501-aa57-b21d4bd6cb01 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:56:58.855879 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ba60c-ff38-4292-9f05-f56872136868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:56:58.856539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ba60c-ff38-4292-9f05-f56872136868 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:56:58.856820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ba60c-ff38-4292-9f05-f56872136868 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:56:58.857096 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ba60c-ff38-4292-9f05-f56872136868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:56:58.869017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ba60c-ff38-4292-9f05-f56872136868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:56:58.870535 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ba60c-ff38-4292-9f05-f56872136868 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:56:58.883381 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 679/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:56:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:57:04.026690 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c5cab-f88b-41b5-8e9a-f5c0f776cc31 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:04.027304 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c5cab-f88b-41b5-8e9a-f5c0f776cc31 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:04.027773 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c5cab-f88b-41b5-8e9a-f5c0f776cc31 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:04.032799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 662/1341] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:57:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:57:04.040564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0fdd4-bffc-4dec-95d2-7d9e94278d35 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:04.041164 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0fdd4-bffc-4dec-95d2-7d9e94278d35 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:04.041528 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0fdd4-bffc-4dec-95d2-7d9e94278d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:04.071108 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ffd0fdd4-bffc-4dec-95d2-7d9e94278d35 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:04.073391 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ffd0fdd4-bffc-4dec-95d2-7d9e94278d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:04.085261 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 680/1342] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:57:04.129506 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c5cab-f88b-41b5-8e9a-f5c0f776cc31 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:57:04.148773 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c5cab-f88b-41b5-8e9a-f5c0f776cc31 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:57:04.155295 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbbc42-4efe-4bea-a9f6-a883aa7f3e60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:57:04.156394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbbc42-4efe-4bea-a9f6-a883aa7f3e60 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:04.156888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbbc42-4efe-4bea-a9f6-a883aa7f3e60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:04.157370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbbc42-4efe-4bea-a9f6-a883aa7f3e60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:04.171688 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbbc42-4efe-4bea-a9f6-a883aa7f3e60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:57:04.173185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbbc42-4efe-4bea-a9f6-a883aa7f3e60 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:57:04.184344 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 663/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:57:07.574006 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead024b-c68a-4a16-bf8e-38643013946f None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:07.574803 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead024b-c68a-4a16-bf8e-38643013946f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:07.574987 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead024b-c68a-4a16-bf8e-38643013946f None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:07.577618 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 681/1344] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:57:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:57:07.587179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48e229-a8ea-4133-a958-5a6dc2daa052 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:07.587762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48e229-a8ea-4133-a958-5a6dc2daa052 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:07.588189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48e229-a8ea-4133-a958-5a6dc2daa052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:07.619630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4c48e229-a8ea-4133-a958-5a6dc2daa052 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:07.621834 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4c48e229-a8ea-4133-a958-5a6dc2daa052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:07.636706 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 664/1345] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:57:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:57:07.682300 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead024b-c68a-4a16-bf8e-38643013946f None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:57:07.709747 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead024b-c68a-4a16-bf8e-38643013946f None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:57:07.713971 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3f0c5-6722-4d1b-841f-8822f1a9a2b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:57:07.714747 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3f0c5-6722-4d1b-841f-8822f1a9a2b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:07.715135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3f0c5-6722-4d1b-841f-8822f1a9a2b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:07.715519 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3f0c5-6722-4d1b-841f-8822f1a9a2b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:07.729841 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3f0c5-6722-4d1b-841f-8822f1a9a2b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:57:07.731716 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3f0c5-6722-4d1b-841f-8822f1a9a2b7 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:57:07.746833 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 682/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:57:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:57:12.899397 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3da117-c8d1-4ce3-89b6-464c07279c1c None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:12.899978 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3da117-c8d1-4ce3-89b6-464c07279c1c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:12.900144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3da117-c8d1-4ce3-89b6-464c07279c1c None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:12.901605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 665/1347] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:57:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:57:12.907949 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df751f-80a9-4b5b-9903-8040a9722bc0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:12.908586 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df751f-80a9-4b5b-9903-8040a9722bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:12.908586 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df751f-80a9-4b5b-9903-8040a9722bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:12.929573 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b5df751f-80a9-4b5b-9903-8040a9722bc0 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:12.931549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b5df751f-80a9-4b5b-9903-8040a9722bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:12.945756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 683/1348] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:57:12.985861 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3da117-c8d1-4ce3-89b6-464c07279c1c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:57:13.000933 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3da117-c8d1-4ce3-89b6-464c07279c1c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:57:13.006471 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec81a8-8eb9-4fba-bd43-a9d3d4b21d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:57:13.007274 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec81a8-8eb9-4fba-bd43-a9d3d4b21d54 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:13.007615 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec81a8-8eb9-4fba-bd43-a9d3d4b21d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:13.007964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec81a8-8eb9-4fba-bd43-a9d3d4b21d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:13.020747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec81a8-8eb9-4fba-bd43-a9d3d4b21d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:57:13.022263 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec81a8-8eb9-4fba-bd43-a9d3d4b21d54 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:57:13.033697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 666/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:57:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:57:20.698101 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93bc29-e354-4192-a7f0-4d0190f4d119 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:20.699595 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93bc29-e354-4192-a7f0-4d0190f4d119 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:20.700365 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93bc29-e354-4192-a7f0-4d0190f4d119 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:20.704056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 684/1350] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 18 16:57:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:57:20.713920 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb7c42-2307-4406-9647-137d8c63f97e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:20.714692 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb7c42-2307-4406-9647-137d8c63f97e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:20.714934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb7c42-2307-4406-9647-137d8c63f97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:20.832900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:57:20.902069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-efdb7c42-2307-4406-9647-137d8c63f97e None None] MFA Rules not processed for user `bebc8414d01a40c8ab34afa9b1312a59`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:20.910272 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-efdb7c42-2307-4406-9647-137d8c63f97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:21.054131 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 667/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 18 16:57:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:57:22.922269 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:57:27.148602 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe698512-f04e-477b-86c6-7a90bf4963d8 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:27.150380 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe698512-f04e-477b-86c6-7a90bf4963d8 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:27.151108 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe698512-f04e-477b-86c6-7a90bf4963d8 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:27.155495 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 685/1352] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 18 16:57:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:57:27.163435 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200c3c2-82d3-4a73-846c-fdc4f7dc707d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:27.164293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200c3c2-82d3-4a73-846c-fdc4f7dc707d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:27.164446 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200c3c2-82d3-4a73-846c-fdc4f7dc707d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:27.219883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8200c3c2-82d3-4a73-846c-fdc4f7dc707d None None] MFA Rules not processed for user `bebc8414d01a40c8ab34afa9b1312a59`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:27.222031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8200c3c2-82d3-4a73-846c-fdc4f7dc707d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:27.240109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 668/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 18 16:57:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:57:28.996544 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f07960-3047-4cb1-9c67-7b4a8ff2b9f1 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:28.997382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f07960-3047-4cb1-9c67-7b4a8ff2b9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:28.997541 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f07960-3047-4cb1-9c67-7b4a8ff2b9f1 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:28.999509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 686/1354] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 18 16:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:57:29.006745 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c7159-92c3-4baa-b90b-7937f15ee1ea None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:29.007326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c7159-92c3-4baa-b90b-7937f15ee1ea None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:29.007953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c7159-92c3-4baa-b90b-7937f15ee1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:29.033610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-681c7159-92c3-4baa-b90b-7937f15ee1ea None None] MFA Rules not processed for user `bebc8414d01a40c8ab34afa9b1312a59`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:29.035112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-681c7159-92c3-4baa-b90b-7937f15ee1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:29.045556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 669/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 18 16:57:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:57:32.751704 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3fd19-250a-42a1-ac43-1a7056886cde None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:32.752516 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3fd19-250a-42a1-ac43-1a7056886cde None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:32.752516 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3fd19-250a-42a1-ac43-1a7056886cde None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:32.759406 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 687/1356] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:57:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:57:32.761279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a61ce-d692-40ca-91f9-bac078a4c76f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:32.762087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a61ce-d692-40ca-91f9-bac078a4c76f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:32.762269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a61ce-d692-40ca-91f9-bac078a4c76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:32.786364 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-991a61ce-d692-40ca-91f9-bac078a4c76f None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:32.787812 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-991a61ce-d692-40ca-91f9-bac078a4c76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:32.801831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 670/1357] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:57:32.863071 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736dd0a-ad01-4404-a989-2f45036727e8 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:32.863768 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736dd0a-ad01-4404-a989-2f45036727e8 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:32.864428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736dd0a-ad01-4404-a989-2f45036727e8 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:32.869414 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 688/1358] 10.222.0.49 () {54 vars in 961 bytes} [Wed May 18 16:57:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:57:32.879341 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4f4ca-7511-46f9-84b3-3379611d8918 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:32.879664 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4f4ca-7511-46f9-84b3-3379611d8918 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:32.879918 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4f4ca-7511-46f9-84b3-3379611d8918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:32.958075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0ca4f4ca-7511-46f9-84b3-3379611d8918 None None] MFA Rules not processed for user `c9e3c0ef5ed943d183b064f383fc01f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:32.960126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0ca4f4ca-7511-46f9-84b3-3379611d8918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:33.113947 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 671/1359] 10.222.0.49 () {58 vars in 1058 bytes} [Wed May 18 16:57:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 16:57:33.124968 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736dd0a-ad01-4404-a989-2f45036727e8 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:57:33.142049 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736dd0a-ad01-4404-a989-2f45036727e8 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:57:33.148321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b02a3-22a6-48d2-879e-73f0e517be33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:57:33.149152 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b02a3-22a6-48d2-879e-73f0e517be33 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:33.149433 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b02a3-22a6-48d2-879e-73f0e517be33 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:33.149994 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b02a3-22a6-48d2-879e-73f0e517be33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:33.161788 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b02a3-22a6-48d2-879e-73f0e517be33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:57:33.163736 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b02a3-22a6-48d2-879e-73f0e517be33 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:57:33.188292 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 689/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:57:36.343755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0623b-8da9-429b-80fc-8499b127d1f8 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:36.344568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0623b-8da9-429b-80fc-8499b127d1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:36.344750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0623b-8da9-429b-80fc-8499b127d1f8 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:36.347008 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 672/1361] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:57:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:57:36.353618 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e6601-2a79-41e6-ba6a-a5ca33423c65 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:36.354428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e6601-2a79-41e6-ba6a-a5ca33423c65 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:36.354575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e6601-2a79-41e6-ba6a-a5ca33423c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:36.385188 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-3f2e6601-2a79-41e6-ba6a-a5ca33423c65 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:36.386847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3f2e6601-2a79-41e6-ba6a-a5ca33423c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:36.400907 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 690/1362] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 16:57:36.449305 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0623b-8da9-429b-80fc-8499b127d1f8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:57:36.468941 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0623b-8da9-429b-80fc-8499b127d1f8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:57:36.474730 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70976225-37b8-4058-bcb7-318570effc8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:57:36.475384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70976225-37b8-4058-bcb7-318570effc8c service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:36.475673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70976225-37b8-4058-bcb7-318570effc8c service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:36.475952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70976225-37b8-4058-bcb7-318570effc8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:36.487172 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70976225-37b8-4058-bcb7-318570effc8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:57:36.488834 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70976225-37b8-4058-bcb7-318570effc8c service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:57:36.495359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:57:36.502639 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 673/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:57:39.233897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527fa98-1729-4dd1-b13e-63fae0f6dd4c None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:39.234718 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527fa98-1729-4dd1-b13e-63fae0f6dd4c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:39.234718 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527fa98-1729-4dd1-b13e-63fae0f6dd4c None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:39.235892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 691/1364] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:57:39.241992 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247c56-87e8-463b-88d7-6e9a35ca2fc7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:39.242528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247c56-87e8-463b-88d7-6e9a35ca2fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:39.242528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247c56-87e8-463b-88d7-6e9a35ca2fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:39.267578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e1247c56-87e8-463b-88d7-6e9a35ca2fc7 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:39.269406 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e1247c56-87e8-463b-88d7-6e9a35ca2fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:39.306366 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 674/1365] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:57:39.352602 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810ff78-1aad-4640-ab68-a23cf74bbcc4 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:39.352897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810ff78-1aad-4640-ab68-a23cf74bbcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:39.353158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810ff78-1aad-4640-ab68-a23cf74bbcc4 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:39.354608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 692/1366] 10.222.0.49 () {54 vars in 961 bytes} [Wed May 18 16:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:57:39.361797 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086fdfe-813a-49c5-9a5e-4d21b4bf4e9d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:39.362084 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086fdfe-813a-49c5-9a5e-4d21b4bf4e9d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:39.362369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086fdfe-813a-49c5-9a5e-4d21b4bf4e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:39.383319 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c086fdfe-813a-49c5-9a5e-4d21b4bf4e9d None None] MFA Rules not processed for user `c9e3c0ef5ed943d183b064f383fc01f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:39.384547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c086fdfe-813a-49c5-9a5e-4d21b4bf4e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:39.395695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 675/1367] 10.222.0.49 () {58 vars in 1058 bytes} [Wed May 18 16:57:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:57:39.404235 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810ff78-1aad-4640-ab68-a23cf74bbcc4 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:57:39.420081 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810ff78-1aad-4640-ab68-a23cf74bbcc4 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:57:39.426549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7379871-82cc-4688-aab1-eb207fe74139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:57:39.427284 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7379871-82cc-4688-aab1-eb207fe74139 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:39.427762 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7379871-82cc-4688-aab1-eb207fe74139 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:39.428382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7379871-82cc-4688-aab1-eb207fe74139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:39.442736 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7379871-82cc-4688-aab1-eb207fe74139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:57:39.444669 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7379871-82cc-4688-aab1-eb207fe74139 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:57:39.457548 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 693/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:57:42.648947 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2261bca-d65c-4c03-b301-6fa104e46299 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:42.649759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2261bca-d65c-4c03-b301-6fa104e46299 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:42.650172 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2261bca-d65c-4c03-b301-6fa104e46299 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:42.652966 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 676/1369] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:57:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:57:42.663227 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1455e-42d9-4566-a8f4-55a6f31e3b05 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:42.663996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1455e-42d9-4566-a8f4-55a6f31e3b05 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:42.664279 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1455e-42d9-4566-a8f4-55a6f31e3b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:42.698637 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-17b1455e-42d9-4566-a8f4-55a6f31e3b05 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:42.700795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-17b1455e-42d9-4566-a8f4-55a6f31e3b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:42.713712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 694/1370] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:57:42.770574 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2261bca-d65c-4c03-b301-6fa104e46299 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:57:42.790210 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2261bca-d65c-4c03-b301-6fa104e46299 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:57:42.798200 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a62a3-dbd9-45b8-8f70-02bf5bc206d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:57:42.799277 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a62a3-dbd9-45b8-8f70-02bf5bc206d4 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:42.799748 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a62a3-dbd9-45b8-8f70-02bf5bc206d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:42.800166 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a62a3-dbd9-45b8-8f70-02bf5bc206d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:42.812164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a62a3-dbd9-45b8-8f70-02bf5bc206d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:57:42.814152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a62a3-dbd9-45b8-8f70-02bf5bc206d4 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:57:42.828319 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 677/1371] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:57:43.725470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d199e51-5ddc-4349-b1a6-e9f7b3052ee9 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:43.726378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d199e51-5ddc-4349-b1a6-e9f7b3052ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:43.726852 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d199e51-5ddc-4349-b1a6-e9f7b3052ee9 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:43.729501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 695/1372] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:57:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:57:43.736389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25391c-c763-45ad-b93e-0ab767bd8a08 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:43.737180 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25391c-c763-45ad-b93e-0ab767bd8a08 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:43.737180 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25391c-c763-45ad-b93e-0ab767bd8a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:43.760097 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ec25391c-c763-45ad-b93e-0ab767bd8a08 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:43.761365 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ec25391c-c763-45ad-b93e-0ab767bd8a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:43.771614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 678/1373] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:57:44.072035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca0798-bff1-47d8-9677-f702fad8f2f5 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:44.073086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca0798-bff1-47d8-9677-f702fad8f2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:44.073590 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca0798-bff1-47d8-9677-f702fad8f2f5 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:44.076338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 696/1374] 10.222.0.49 () {54 vars in 963 bytes} [Wed May 18 16:57:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:57:44.083233 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d62dac-eb5f-49cb-ad9f-61cf63be8c31 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:44.084124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d62dac-eb5f-49cb-ad9f-61cf63be8c31 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:44.084607 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d62dac-eb5f-49cb-ad9f-61cf63be8c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:44.151593 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d1d62dac-eb5f-49cb-ad9f-61cf63be8c31 None None] MFA Rules not processed for user `102a6c55061040129802a9739f43036a`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:44.153123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d1d62dac-eb5f-49cb-ad9f-61cf63be8c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:44.240863 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 679/1375] 10.222.0.49 () {58 vars in 1060 bytes} [Wed May 18 16:57:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:57:44.248820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca0798-bff1-47d8-9677-f702fad8f2f5 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:57:44.262107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca0798-bff1-47d8-9677-f702fad8f2f5 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:57:44.267775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192b195-b542-4399-b63a-44ec5c03b776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:57:44.268796 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192b195-b542-4399-b63a-44ec5c03b776 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:44.269313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192b195-b542-4399-b63a-44ec5c03b776 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:44.269872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192b195-b542-4399-b63a-44ec5c03b776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:44.283254 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192b195-b542-4399-b63a-44ec5c03b776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:57:44.285425 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192b195-b542-4399-b63a-44ec5c03b776 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:57:44.299266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 697/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:57:46.302778 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5c6f2-5deb-4713-bb95-26311f4f2f42 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:46.303641 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5c6f2-5deb-4713-bb95-26311f4f2f42 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:46.303801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5c6f2-5deb-4713-bb95-26311f4f2f42 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:46.305502 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 680/1377] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:57:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:57:46.313515 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89427a0d-9e05-4ffe-88ac-0ea7ac7c9c2b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:46.314396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89427a0d-9e05-4ffe-88ac-0ea7ac7c9c2b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:46.314560 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89427a0d-9e05-4ffe-88ac-0ea7ac7c9c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:46.336124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-89427a0d-9e05-4ffe-88ac-0ea7ac7c9c2b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:46.337312 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-89427a0d-9e05-4ffe-88ac-0ea7ac7c9c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:46.347215 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 698/1378] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:57:46.397624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5c6f2-5deb-4713-bb95-26311f4f2f42 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:57:46.413256 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5c6f2-5deb-4713-bb95-26311f4f2f42 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:57:46.419363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86209d-6b5a-4d4e-9381-e83d5fc01ae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:57:46.420070 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86209d-6b5a-4d4e-9381-e83d5fc01ae8 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:46.420351 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86209d-6b5a-4d4e-9381-e83d5fc01ae8 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:46.420623 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86209d-6b5a-4d4e-9381-e83d5fc01ae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:46.430368 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86209d-6b5a-4d4e-9381-e83d5fc01ae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:57:46.432116 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86209d-6b5a-4d4e-9381-e83d5fc01ae8 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:57:46.443883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 681/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:57:48.964055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39923b2-a7a5-418f-9588-5da2540709b5 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:48.966232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39923b2-a7a5-418f-9588-5da2540709b5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:48.967369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39923b2-a7a5-418f-9588-5da2540709b5 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:48.973180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 699/1380] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:57:48 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:57:48.983881 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89865dc6-568b-4a12-a003-5ab2f8ad058a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:48.985410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89865dc6-568b-4a12-a003-5ab2f8ad058a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:48.986188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89865dc6-568b-4a12-a003-5ab2f8ad058a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:49.019265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-89865dc6-568b-4a12-a003-5ab2f8ad058a None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:49.021789 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-89865dc6-568b-4a12-a003-5ab2f8ad058a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:49.040413 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 682/1381] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:57:49.111072 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39923b2-a7a5-418f-9588-5da2540709b5 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:57:49.149869 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39923b2-a7a5-418f-9588-5da2540709b5 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:57:49.160497 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fad5d-e656-4bba-aa50-652915124a43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:57:49.161821 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fad5d-e656-4bba-aa50-652915124a43 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:49.162551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fad5d-e656-4bba-aa50-652915124a43 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:49.163742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fad5d-e656-4bba-aa50-652915124a43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:49.176953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fad5d-e656-4bba-aa50-652915124a43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:57:49.178644 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fad5d-e656-4bba-aa50-652915124a43 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:57:49.191395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 700/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:57:52.370904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66767d5c-3754-406e-8069-5eef627f3464 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:52.373173 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66767d5c-3754-406e-8069-5eef627f3464 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:52.373873 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66767d5c-3754-406e-8069-5eef627f3464 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:52.377167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 683/1383] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:57:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:57:52.387129 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f762fed-24d0-4670-8b55-f72908af777e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:52.388538 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f762fed-24d0-4670-8b55-f72908af777e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:52.388717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f762fed-24d0-4670-8b55-f72908af777e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:52.422895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-8f762fed-24d0-4670-8b55-f72908af777e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:52.425065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8f762fed-24d0-4670-8b55-f72908af777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:52.440754 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 701/1384] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:57:52.520744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66767d5c-3754-406e-8069-5eef627f3464 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:57:52.552850 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66767d5c-3754-406e-8069-5eef627f3464 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:57:52.565489 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316e133-6f15-49fa-a058-02b40ed597a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:57:52.567153 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316e133-6f15-49fa-a058-02b40ed597a9 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:52.568381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316e133-6f15-49fa-a058-02b40ed597a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:52.569058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316e133-6f15-49fa-a058-02b40ed597a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:52.590259 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316e133-6f15-49fa-a058-02b40ed597a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:57:52.596447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316e133-6f15-49fa-a058-02b40ed597a9 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:57:52.620654 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 684/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:57:55.582756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ca903-ca22-43b9-a09a-12a0b7a720d2 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:55.583835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ca903-ca22-43b9-a09a-12a0b7a720d2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:55.583835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ca903-ca22-43b9-a09a-12a0b7a720d2 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:55.585546 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 702/1386] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:57:55.592728 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204bf13-fea9-4506-b528-933b5671bfa1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:55.593322 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204bf13-fea9-4506-b528-933b5671bfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:55.593406 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204bf13-fea9-4506-b528-933b5671bfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:55.619519 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f204bf13-fea9-4506-b528-933b5671bfa1 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:55.620764 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f204bf13-fea9-4506-b528-933b5671bfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:55.629456 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 685/1387] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:57:55.678982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ca903-ca22-43b9-a09a-12a0b7a720d2 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:57:55.695979 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ca903-ca22-43b9-a09a-12a0b7a720d2 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:57:55.703651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcde3a9-2135-48c7-a2e8-c3f4e389ca4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:57:55.704768 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcde3a9-2135-48c7-a2e8-c3f4e389ca4c service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:55.705191 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcde3a9-2135-48c7-a2e8-c3f4e389ca4c service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:55.705784 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcde3a9-2135-48c7-a2e8-c3f4e389ca4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:55.719054 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcde3a9-2135-48c7-a2e8-c3f4e389ca4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:57:55.721041 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcde3a9-2135-48c7-a2e8-c3f4e389ca4c service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:57:55.737546 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 703/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:57:58.535329 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd7424-8f73-47c6-a4d1-23d83375ea60 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:58.536445 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd7424-8f73-47c6-a4d1-23d83375ea60 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:58.536445 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd7424-8f73-47c6-a4d1-23d83375ea60 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:58.537785 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 686/1389] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:57:58.544744 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37105615-9ced-4c1d-b0f4-1bf433d930cc None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:58.546143 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37105615-9ced-4c1d-b0f4-1bf433d930cc None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:58.546619 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37105615-9ced-4c1d-b0f4-1bf433d930cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:58.574473 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-37105615-9ced-4c1d-b0f4-1bf433d930cc None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:57:58.577275 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-37105615-9ced-4c1d-b0f4-1bf433d930cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:57:58.588936 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 704/1390] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:57:58.673894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd7424-8f73-47c6-a4d1-23d83375ea60 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:57:58.691461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd7424-8f73-47c6-a4d1-23d83375ea60 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:57:58.702410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e076b52-d1c8-441c-96c1-25989012c393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:57:58.703549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e076b52-d1c8-441c-96c1-25989012c393 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:57:58.704063 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e076b52-d1c8-441c-96c1-25989012c393 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:57:58.704580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e076b52-d1c8-441c-96c1-25989012c393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:57:58.721636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e076b52-d1c8-441c-96c1-25989012c393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:57:58.724774 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e076b52-d1c8-441c-96c1-25989012c393 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:57:58.747950 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 687/1391] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:58:01.260882 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea73f0-3f8c-46a9-9bc5-29fb26ef555a None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:01.261555 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea73f0-3f8c-46a9-9bc5-29fb26ef555a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:01.262017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea73f0-3f8c-46a9-9bc5-29fb26ef555a None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:01.265308 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 705/1392] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:58:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:58:01.271697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992d475-ded9-464f-b295-92896a388d38 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:01.272615 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992d475-ded9-464f-b295-92896a388d38 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:01.272615 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992d475-ded9-464f-b295-92896a388d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:01.293685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6992d475-ded9-464f-b295-92896a388d38 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:01.295262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6992d475-ded9-464f-b295-92896a388d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:01.305200 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 688/1393] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:01.354632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea73f0-3f8c-46a9-9bc5-29fb26ef555a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:01.372675 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea73f0-3f8c-46a9-9bc5-29fb26ef555a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:01.379216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de677656-a453-480e-998d-0119e96b1a0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:01.380116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de677656-a453-480e-998d-0119e96b1a0a service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:01.380464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de677656-a453-480e-998d-0119e96b1a0a service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:01.380800 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de677656-a453-480e-998d-0119e96b1a0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:01.392088 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de677656-a453-480e-998d-0119e96b1a0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:01.393990 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de677656-a453-480e-998d-0119e96b1a0a service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:01.408635 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 706/1394] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:58:02.331287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb74234-54f2-4ba0-9a0a-fa1716d04425 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:02.331938 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb74234-54f2-4ba0-9a0a-fa1716d04425 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:02.332225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb74234-54f2-4ba0-9a0a-fa1716d04425 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:02.335295 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 689/1395] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:58:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:58:02.344113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dd02d-bd7f-44aa-921f-d5619e8193ac None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:02.344970 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dd02d-bd7f-44aa-921f-d5619e8193ac None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:02.345153 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dd02d-bd7f-44aa-921f-d5619e8193ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:02.369022 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b71dd02d-bd7f-44aa-921f-d5619e8193ac None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:02.371605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b71dd02d-bd7f-44aa-921f-d5619e8193ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:02.382735 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 707/1396] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:02.480976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f6998-7b1c-4648-80f9-610599f16e66 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:02.482127 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f6998-7b1c-4648-80f9-610599f16e66 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:02.482478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f6998-7b1c-4648-80f9-610599f16e66 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:02.484864 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 690/1397] 10.222.0.49 () {54 vars in 962 bytes} [Wed May 18 16:58:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:58:02.494473 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2149f-db0b-41cd-a4c4-4a2b203b30a2 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:02.495580 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2149f-db0b-41cd-a4c4-4a2b203b30a2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:02.496139 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2149f-db0b-41cd-a4c4-4a2b203b30a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:02.605336 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-3bb2149f-db0b-41cd-a4c4-4a2b203b30a2 None None] MFA Rules not processed for user `0d69d99d980744fba12a6b38586e7bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:02.608112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3bb2149f-db0b-41cd-a4c4-4a2b203b30a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:02.726110 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 708/1398] 10.222.0.49 () {58 vars in 1059 bytes} [Wed May 18 16:58:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:02.735511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f6998-7b1c-4648-80f9-610599f16e66 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:02.755578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f6998-7b1c-4648-80f9-610599f16e66 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:02.761776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bb9cf-9097-4d4e-877a-131b18822869 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d69d99d980744fba12a6b38586e7bf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:02.764261 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bb9cf-9097-4d4e-877a-131b18822869 service glance] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:02.764770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bb9cf-9097-4d4e-877a-131b18822869 service glance] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:02.765251 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bb9cf-9097-4d4e-877a-131b18822869 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:02.783780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bb9cf-9097-4d4e-877a-131b18822869 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:02.786465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bb9cf-9097-4d4e-877a-131b18822869 service glance] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:02.806140 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 691/1399] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:58:03.627861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09723b1f-87b6-4818-87f8-009208a76794 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:03.628754 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09723b1f-87b6-4818-87f8-009208a76794 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:03.629098 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09723b1f-87b6-4818-87f8-009208a76794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:03.635328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=93 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:58:03.703145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-09723b1f-87b6-4818-87f8-009208a76794 None None] MFA Rules not processed for user `9692d55c8c924544a1bff62054731ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:03.704624 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-09723b1f-87b6-4818-87f8-009208a76794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:03.794649 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 709/1400] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 18 16:58:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:03.856846 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52373ce-099a-41f6-800c-bb8751611cbe None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:03.858480 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52373ce-099a-41f6-800c-bb8751611cbe None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:03.858480 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52373ce-099a-41f6-800c-bb8751611cbe None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:03.860162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 692/1401] 10.222.0.49 () {54 vars in 942 bytes} [Wed May 18 16:58:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:58:03.869390 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58b626-b1dc-4d7f-9348-77345760c96f None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:03.869959 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58b626-b1dc-4d7f-9348-77345760c96f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:03.870466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58b626-b1dc-4d7f-9348-77345760c96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:03.963080 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-1e58b626-b1dc-4d7f-9348-77345760c96f None None] MFA Rules not processed for user `b712c7f5fce54fe2a89d63863f3845f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:03.965255 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1e58b626-b1dc-4d7f-9348-77345760c96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:04.060734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 710/1402] 10.222.0.49 () {58 vars in 1039 bytes} [Wed May 18 16:58:03 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:04.072773 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52373ce-099a-41f6-800c-bb8751611cbe None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:04.090007 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52373ce-099a-41f6-800c-bb8751611cbe None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:04.096110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2c5a3-3620-4b70-8fb5-c9c012bf4b55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b712c7f5fce54fe2a89d63863f3845f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:04.096865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2c5a3-3620-4b70-8fb5-c9c012bf4b55 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:04.097155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2c5a3-3620-4b70-8fb5-c9c012bf4b55 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:04.097438 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2c5a3-3620-4b70-8fb5-c9c012bf4b55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:04.107494 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2c5a3-3620-4b70-8fb5-c9c012bf4b55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:04.109032 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2c5a3-3620-4b70-8fb5-c9c012bf4b55 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:04.118835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 693/1403] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 18 16:58:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 16:58:04.483272 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a899d3-d084-4398-bdb0-b65ffa363200 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:04.483817 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a899d3-d084-4398-bdb0-b65ffa363200 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:04.484273 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a899d3-d084-4398-bdb0-b65ffa363200 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:04.487238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 711/1404] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:58:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:58:04.497345 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a792e0-fc08-4a35-bf34-7aeac91aaef9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:04.498248 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a792e0-fc08-4a35-bf34-7aeac91aaef9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:04.498746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a792e0-fc08-4a35-bf34-7aeac91aaef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:04.539410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-07a792e0-fc08-4a35-bf34-7aeac91aaef9 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:04.541612 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-07a792e0-fc08-4a35-bf34-7aeac91aaef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:04.556094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 694/1405] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:04.635265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a899d3-d084-4398-bdb0-b65ffa363200 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:04.663658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a899d3-d084-4398-bdb0-b65ffa363200 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:04.673811 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d268d7-96a4-4c75-9081-c59782b2ce28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:04.675372 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d268d7-96a4-4c75-9081-c59782b2ce28 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:04.675855 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d268d7-96a4-4c75-9081-c59782b2ce28 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:04.676425 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d268d7-96a4-4c75-9081-c59782b2ce28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:04.743479 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d268d7-96a4-4c75-9081-c59782b2ce28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:04.752991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d268d7-96a4-4c75-9081-c59782b2ce28 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:04.787322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 712/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:58:07.877405 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68dab0-45fa-49c4-ab60-b4e05c34ec35 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:07.878262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68dab0-45fa-49c4-ab60-b4e05c34ec35 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:07.878262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68dab0-45fa-49c4-ab60-b4e05c34ec35 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:07.880223 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 695/1407] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:58:07.889599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39447eef-e4e0-4404-92fe-cb325d695b2a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:07.890435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39447eef-e4e0-4404-92fe-cb325d695b2a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:07.890435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39447eef-e4e0-4404-92fe-cb325d695b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:07.919931 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-39447eef-e4e0-4404-92fe-cb325d695b2a None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:07.919931 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-39447eef-e4e0-4404-92fe-cb325d695b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:07.933169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 713/1408] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:08.006342 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68dab0-45fa-49c4-ab60-b4e05c34ec35 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:08.022676 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:58:08.042611 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68dab0-45fa-49c4-ab60-b4e05c34ec35 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:08.054264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401844f-2ab6-4871-9f30-184654b5a943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:08.064301 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401844f-2ab6-4871-9f30-184654b5a943 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:08.065136 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401844f-2ab6-4871-9f30-184654b5a943 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:08.065862 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401844f-2ab6-4871-9f30-184654b5a943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:08.085600 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401844f-2ab6-4871-9f30-184654b5a943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:08.087696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401844f-2ab6-4871-9f30-184654b5a943 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:08.108504 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 696/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:58:17.910135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:58:18.095407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:58:29.681108 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe3f7e-8d5c-45be-80af-c84eaeeb3e69 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:29.681970 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe3f7e-8d5c-45be-80af-c84eaeeb3e69 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:29.681970 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe3f7e-8d5c-45be-80af-c84eaeeb3e69 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:29.683232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 714/1410] 10.222.0.49 () {54 vars in 918 bytes} [Wed May 18 16:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:58:29.690731 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b3623-2236-4606-8377-caecf87b62ff None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:29.691412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b3623-2236-4606-8377-caecf87b62ff None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:29.691652 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b3623-2236-4606-8377-caecf87b62ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:29.714370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0a9b3623-2236-4606-8377-caecf87b62ff None None] MFA Rules not processed for user `bebc8414d01a40c8ab34afa9b1312a59`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:29.716149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0a9b3623-2236-4606-8377-caecf87b62ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:29.726416 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 697/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Wed May 18 16:58:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:29.744885 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5997f-a9ba-4957-a579-0683580d9357 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:29.745328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5997f-a9ba-4957-a579-0683580d9357 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:29.745553 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5997f-a9ba-4957-a579-0683580d9357 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:29.747787 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 715/1412] 10.222.0.49 () {54 vars in 918 bytes} [Wed May 18 16:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:58:29.754577 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f44dc0-129d-4e36-9528-d48374f7d1ee None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:29.755072 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f44dc0-129d-4e36-9528-d48374f7d1ee None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:29.755563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f44dc0-129d-4e36-9528-d48374f7d1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:29.787950 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-05f44dc0-129d-4e36-9528-d48374f7d1ee None None] MFA Rules not processed for user `c9e3c0ef5ed943d183b064f383fc01f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:29.790094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-05f44dc0-129d-4e36-9528-d48374f7d1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:29.801762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 698/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Wed May 18 16:58:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:32.844431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd925f-4922-4677-ad59-85da4b86dd21 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:32.845297 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd925f-4922-4677-ad59-85da4b86dd21 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:32.845297 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd925f-4922-4677-ad59-85da4b86dd21 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:32.846424 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 16:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:58:32.852576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc3819-7b6e-47cc-90b8-7641bdba6983 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:32.853189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc3819-7b6e-47cc-90b8-7641bdba6983 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:32.853326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc3819-7b6e-47cc-90b8-7641bdba6983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:32.873942 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-62bc3819-7b6e-47cc-90b8-7641bdba6983 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:32.875180 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-62bc3819-7b6e-47cc-90b8-7641bdba6983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:32.883289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 16:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:32.929982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd925f-4922-4677-ad59-85da4b86dd21 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:32.951886 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd925f-4922-4677-ad59-85da4b86dd21 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:32.959469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be8cbd-d123-4316-b5ae-b0cb62bc148e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:32.960648 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be8cbd-d123-4316-b5ae-b0cb62bc148e service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:32.961162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be8cbd-d123-4316-b5ae-b0cb62bc148e service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:32.961722 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be8cbd-d123-4316-b5ae-b0cb62bc148e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:32.978186 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be8cbd-d123-4316-b5ae-b0cb62bc148e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:32.980144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be8cbd-d123-4316-b5ae-b0cb62bc148e service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:32.992777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 717/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:58:34.103218 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea463d-6e25-416c-b528-528409febb64 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:34.103837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea463d-6e25-416c-b528-528409febb64 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:34.103837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea463d-6e25-416c-b528-528409febb64 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:34.105265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 16:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:58:34.111276 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11757126-dfa6-4170-b87e-111602902b06 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:34.111879 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11757126-dfa6-4170-b87e-111602902b06 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:34.111879 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11757126-dfa6-4170-b87e-111602902b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:34.132435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-11757126-dfa6-4170-b87e-111602902b06 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:34.133837 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-11757126-dfa6-4170-b87e-111602902b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:34.144133 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 16:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 16:58:34.346058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea463d-6e25-416c-b528-528409febb64 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:34.362566 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea463d-6e25-416c-b528-528409febb64 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:34.368425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfcdf2-4cf2-4b8c-b31f-3d1773654820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:34.369092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfcdf2-4cf2-4b8c-b31f-3d1773654820 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:34.369373 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfcdf2-4cf2-4b8c-b31f-3d1773654820 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:34.369668 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfcdf2-4cf2-4b8c-b31f-3d1773654820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:34.379456 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfcdf2-4cf2-4b8c-b31f-3d1773654820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:34.381079 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfcdf2-4cf2-4b8c-b31f-3d1773654820 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:34.392082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 701/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:58:35.498406 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd0e14-52d5-4807-8687-39f83f2a5c7a None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:35.499106 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd0e14-52d5-4807-8687-39f83f2a5c7a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:35.499106 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd0e14-52d5-4807-8687-39f83f2a5c7a None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:35.500642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 16:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:58:35.506647 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53241aaf-b3dd-4ade-acea-540fd703dd72 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:35.507514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53241aaf-b3dd-4ade-acea-540fd703dd72 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:35.507689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53241aaf-b3dd-4ade-acea-540fd703dd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:35.529505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-53241aaf-b3dd-4ade-acea-540fd703dd72 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:35.530780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-53241aaf-b3dd-4ade-acea-540fd703dd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:35.539150 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 16:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:35.832980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd0e14-52d5-4807-8687-39f83f2a5c7a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:35.854983 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd0e14-52d5-4807-8687-39f83f2a5c7a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:35.864735 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027d8a1-9c0a-4b3f-a961-356ad7ac9fe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:35.865880 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027d8a1-9c0a-4b3f-a961-356ad7ac9fe4 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:35.866347 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027d8a1-9c0a-4b3f-a961-356ad7ac9fe4 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:35.866799 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027d8a1-9c0a-4b3f-a961-356ad7ac9fe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:35.883531 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027d8a1-9c0a-4b3f-a961-356ad7ac9fe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:35.886567 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027d8a1-9c0a-4b3f-a961-356ad7ac9fe4 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:35.908020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 720/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:58:36.975214 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90dbb-7bb2-4075-b5d5-d26508998b82 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:36.975773 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90dbb-7bb2-4075-b5d5-d26508998b82 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:36.976250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90dbb-7bb2-4075-b5d5-d26508998b82 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:36.978996 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 16:58:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:58:36.985492 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af44680-8d81-4b68-a717-2793dab2cd18 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:36.986135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af44680-8d81-4b68-a717-2793dab2cd18 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:36.986135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af44680-8d81-4b68-a717-2793dab2cd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:37.006905 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4af44680-8d81-4b68-a717-2793dab2cd18 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:37.008240 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4af44680-8d81-4b68-a717-2793dab2cd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:37.019809 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 16:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 16:58:37.183380 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f90dbb-7bb2-4075-b5d5-d26508998b82 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:37.200282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f90dbb-7bb2-4075-b5d5-d26508998b82 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:37.206638 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b74e6-af4a-4f66-b4a6-61351f5e8d39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:37.207368 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b74e6-af4a-4f66-b4a6-61351f5e8d39 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:37.207691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b74e6-af4a-4f66-b4a6-61351f5e8d39 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:37.208007 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b74e6-af4a-4f66-b4a6-61351f5e8d39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:37.220442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b74e6-af4a-4f66-b4a6-61351f5e8d39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:37.222830 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b74e6-af4a-4f66-b4a6-61351f5e8d39 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:37.238258 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 704/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:58:38.279998 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a9000-af36-4b0a-ad3d-f3d79cef7487 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:38.280567 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a9000-af36-4b0a-ad3d-f3d79cef7487 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:38.280918 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a9000-af36-4b0a-ad3d-f3d79cef7487 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:38.282757 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 16:58:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:58:38.288681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530615-0b4c-4051-a397-3b3aec120832 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:38.289293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530615-0b4c-4051-a397-3b3aec120832 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:38.289293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530615-0b4c-4051-a397-3b3aec120832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:38.309861 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-76530615-0b4c-4051-a397-3b3aec120832 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:38.311113 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-76530615-0b4c-4051-a397-3b3aec120832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:38.319426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 16:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:38.490605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a9000-af36-4b0a-ad3d-f3d79cef7487 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:38.506594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a9000-af36-4b0a-ad3d-f3d79cef7487 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:38.513096 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afd866-075d-4ea8-b592-04a48e78df09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:38.514356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afd866-075d-4ea8-b592-04a48e78df09 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:38.514879 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afd866-075d-4ea8-b592-04a48e78df09 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:38.525127 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afd866-075d-4ea8-b592-04a48e78df09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:38.532834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afd866-075d-4ea8-b592-04a48e78df09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:38.536035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afd866-075d-4ea8-b592-04a48e78df09 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:38.555941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 723/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:58:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:58:39.489013 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d45bf-ab0d-4a95-8bcc-6fd12c0333d1 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:39.489613 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d45bf-ab0d-4a95-8bcc-6fd12c0333d1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:39.489613 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d45bf-ab0d-4a95-8bcc-6fd12c0333d1 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:39.491073 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 16:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:58:39.498005 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3df49f-7b9b-41f4-a511-814808a48550 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:39.498630 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3df49f-7b9b-41f4-a511-814808a48550 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:39.498745 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3df49f-7b9b-41f4-a511-814808a48550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:39.519236 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ec3df49f-7b9b-41f4-a511-814808a48550 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:39.520495 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ec3df49f-7b9b-41f4-a511-814808a48550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:39.530035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 16:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 16:58:39.688891 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d45bf-ab0d-4a95-8bcc-6fd12c0333d1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:39.712498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d45bf-ab0d-4a95-8bcc-6fd12c0333d1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:39.719435 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a7d76-a045-4f7a-b30b-fa2d20c6f318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:39.720171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a7d76-a045-4f7a-b30b-fa2d20c6f318 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:39.720458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a7d76-a045-4f7a-b30b-fa2d20c6f318 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:39.720802 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a7d76-a045-4f7a-b30b-fa2d20c6f318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:39.730486 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a7d76-a045-4f7a-b30b-fa2d20c6f318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:39.732566 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a7d76-a045-4f7a-b30b-fa2d20c6f318 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:39.748538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 707/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:58:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:58:40.734451 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc4815-092e-4e2a-b2d4-633e579bf5d9 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:40.735064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc4815-092e-4e2a-b2d4-633e579bf5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:40.735064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc4815-092e-4e2a-b2d4-633e579bf5d9 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:40.736414 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 16:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:58:40.742841 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e23eaa-cb67-4621-8a57-8af2ec562531 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:40.743531 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e23eaa-cb67-4621-8a57-8af2ec562531 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:40.744031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e23eaa-cb67-4621-8a57-8af2ec562531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:40.772996 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-51e23eaa-cb67-4621-8a57-8af2ec562531 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:40.775067 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-51e23eaa-cb67-4621-8a57-8af2ec562531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:40.789175 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 16:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:40.940860 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc4815-092e-4e2a-b2d4-633e579bf5d9 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:40.956598 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc4815-092e-4e2a-b2d4-633e579bf5d9 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:40.962647 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c971265-4c53-410a-8975-4e295a7c7fcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:40.963317 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c971265-4c53-410a-8975-4e295a7c7fcf service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:40.963604 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c971265-4c53-410a-8975-4e295a7c7fcf service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:40.963884 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c971265-4c53-410a-8975-4e295a7c7fcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:40.974149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c971265-4c53-410a-8975-4e295a7c7fcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:40.975805 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c971265-4c53-410a-8975-4e295a7c7fcf service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:40.994965 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 726/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:58:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:58:42.388737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bb452-a11d-4ea1-9692-c67acc24560f None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:42.389297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bb452-a11d-4ea1-9692-c67acc24560f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:42.389297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bb452-a11d-4ea1-9692-c67acc24560f None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:42.390654 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 16:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:58:42.396327 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426dcaa-9d83-44be-a7a6-d9953e7229c5 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:42.397027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426dcaa-9d83-44be-a7a6-d9953e7229c5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:42.397027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426dcaa-9d83-44be-a7a6-d9953e7229c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:42.417719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2426dcaa-9d83-44be-a7a6-d9953e7229c5 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:42.419271 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2426dcaa-9d83-44be-a7a6-d9953e7229c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:42.427412 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 16:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:42.583184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bb452-a11d-4ea1-9692-c67acc24560f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:42.606188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bb452-a11d-4ea1-9692-c67acc24560f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:42.613280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da91a21-98b1-47a0-9884-d24ee803bb94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:42.614132 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da91a21-98b1-47a0-9884-d24ee803bb94 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:42.614509 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da91a21-98b1-47a0-9884-d24ee803bb94 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:42.614875 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da91a21-98b1-47a0-9884-d24ee803bb94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:42.625953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da91a21-98b1-47a0-9884-d24ee803bb94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:42.627638 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da91a21-98b1-47a0-9884-d24ee803bb94 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:42.639906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 710/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:58:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:58:43.592134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54adc7-4bcd-45af-8075-2a3c50993800 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:43.592953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54adc7-4bcd-45af-8075-2a3c50993800 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:43.593347 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54adc7-4bcd-45af-8075-2a3c50993800 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:43.595121 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 16:58:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:58:43.601519 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2499d12-8afe-462a-b21a-9825320218c8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:43.602530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2499d12-8afe-462a-b21a-9825320218c8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:43.602530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2499d12-8afe-462a-b21a-9825320218c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:43.624911 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f2499d12-8afe-462a-b21a-9825320218c8 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:43.626202 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f2499d12-8afe-462a-b21a-9825320218c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:43.635072 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 16:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:43.916028 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54adc7-4bcd-45af-8075-2a3c50993800 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:43.932694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54adc7-4bcd-45af-8075-2a3c50993800 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:43.939300 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043937d6-6cf0-47f4-ba43-ae8924c3deb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:43.940064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043937d6-6cf0-47f4-ba43-ae8924c3deb1 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:43.940400 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043937d6-6cf0-47f4-ba43-ae8924c3deb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:43.940723 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043937d6-6cf0-47f4-ba43-ae8924c3deb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:43.952108 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043937d6-6cf0-47f4-ba43-ae8924c3deb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:43.953854 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043937d6-6cf0-47f4-ba43-ae8924c3deb1 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:43.969738 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 729/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:58:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:58:46.275481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c09c2a-1590-4a29-86af-ec293017dcae None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:46.276092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c09c2a-1590-4a29-86af-ec293017dcae None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:46.276454 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c09c2a-1590-4a29-86af-ec293017dcae None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:46.279729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 16:58:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:58:46.285954 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa5f53-18cb-4a31-966d-ede692c181c9 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:46.286541 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa5f53-18cb-4a31-966d-ede692c181c9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:46.286541 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa5f53-18cb-4a31-966d-ede692c181c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:46.305310 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-77fa5f53-18cb-4a31-966d-ede692c181c9 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:46.306683 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-77fa5f53-18cb-4a31-966d-ede692c181c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:46.315883 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 16:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:46.355597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c09c2a-1590-4a29-86af-ec293017dcae None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:46.367247 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c09c2a-1590-4a29-86af-ec293017dcae None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:46.370808 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e4e30-bfac-4e93-8e5c-ce90e91289b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:46.372026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e4e30-bfac-4e93-8e5c-ce90e91289b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:46.372309 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e4e30-bfac-4e93-8e5c-ce90e91289b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:46.372706 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e4e30-bfac-4e93-8e5c-ce90e91289b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:46.383188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e4e30-bfac-4e93-8e5c-ce90e91289b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:46.384659 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e4e30-bfac-4e93-8e5c-ce90e91289b8 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:46.396536 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 713/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:58:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:58:49.050375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151497d-12f3-48a8-bf18-fae151c6560d None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:49.051231 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151497d-12f3-48a8-bf18-fae151c6560d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:49.051409 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151497d-12f3-48a8-bf18-fae151c6560d None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:49.053718 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 16:58:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:58:49.063048 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fbda4-8fae-4263-a3d8-f46575814f14 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:49.063897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fbda4-8fae-4263-a3d8-f46575814f14 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:49.064067 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fbda4-8fae-4263-a3d8-f46575814f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:49.093387 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-298fbda4-8fae-4263-a3d8-f46575814f14 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:49.095583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-298fbda4-8fae-4263-a3d8-f46575814f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:49.110182 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 16:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:49.153930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151497d-12f3-48a8-bf18-fae151c6560d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:49.165795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151497d-12f3-48a8-bf18-fae151c6560d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:49.171048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d567d52-1991-4047-abd9-7151182b50a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:49.171852 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d567d52-1991-4047-abd9-7151182b50a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:49.172238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d567d52-1991-4047-abd9-7151182b50a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:49.172618 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d567d52-1991-4047-abd9-7151182b50a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:49.184335 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d567d52-1991-4047-abd9-7151182b50a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:49.186070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d567d52-1991-4047-abd9-7151182b50a0 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:49.197519 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 732/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:58:51.965284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb651a99-de0c-4784-b4d2-9a310591b563 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:51.965942 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb651a99-de0c-4784-b4d2-9a310591b563 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:51.965942 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb651a99-de0c-4784-b4d2-9a310591b563 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:51.967310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 16:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:58:51.973612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711a705-696c-4535-b539-006769221eff None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:51.974216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711a705-696c-4535-b539-006769221eff None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:51.974523 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711a705-696c-4535-b539-006769221eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:51.994378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9711a705-696c-4535-b539-006769221eff None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:51.995625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9711a705-696c-4535-b539-006769221eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:52.004592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 16:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:52.046452 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb651a99-de0c-4784-b4d2-9a310591b563 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:52.058265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb651a99-de0c-4784-b4d2-9a310591b563 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:52.064298 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07680b-04cd-4ec5-9ef1-6b5520a1e34f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:52.065269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07680b-04cd-4ec5-9ef1-6b5520a1e34f service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:52.065721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07680b-04cd-4ec5-9ef1-6b5520a1e34f service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:52.066137 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07680b-04cd-4ec5-9ef1-6b5520a1e34f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:52.079556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07680b-04cd-4ec5-9ef1-6b5520a1e34f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:52.081093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07680b-04cd-4ec5-9ef1-6b5520a1e34f service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:52.093367 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 716/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:58:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:58:54.655127 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a5e53-d9a2-4dd0-aec7-93ee1fb0f1fd None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:54.655746 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a5e53-d9a2-4dd0-aec7-93ee1fb0f1fd None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:54.655746 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a5e53-d9a2-4dd0-aec7-93ee1fb0f1fd None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:54.657302 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 16:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:58:54.663757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557897b-fc3a-4cb4-9109-86fa8d47eb70 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:54.664353 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557897b-fc3a-4cb4-9109-86fa8d47eb70 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:54.664353 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557897b-fc3a-4cb4-9109-86fa8d47eb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:54.685359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c557897b-fc3a-4cb4-9109-86fa8d47eb70 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:54.686778 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c557897b-fc3a-4cb4-9109-86fa8d47eb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:54.696145 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 16:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:58:54.739835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a5e53-d9a2-4dd0-aec7-93ee1fb0f1fd None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:54.752260 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a5e53-d9a2-4dd0-aec7-93ee1fb0f1fd None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:54.756123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdae108-3922-45ab-ad5b-512620570bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:54.756812 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdae108-3922-45ab-ad5b-512620570bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:54.757114 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdae108-3922-45ab-ad5b-512620570bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:54.757390 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdae108-3922-45ab-ad5b-512620570bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:54.768185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdae108-3922-45ab-ad5b-512620570bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:54.769851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdae108-3922-45ab-ad5b-512620570bb6 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:54.781837 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 735/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:58:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:58:57.526600 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9e100-c50c-4278-90ed-89142eacd6ac None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:57.527904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9e100-c50c-4278-90ed-89142eacd6ac None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:57.528141 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9e100-c50c-4278-90ed-89142eacd6ac None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:57.531070 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 16:58:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:58:57.537395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e51e7a-c414-4333-9ebd-e0d25b8ab52d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:57.538028 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e51e7a-c414-4333-9ebd-e0d25b8ab52d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:57.538028 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e51e7a-c414-4333-9ebd-e0d25b8ab52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:57.556623 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a2e51e7a-c414-4333-9ebd-e0d25b8ab52d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:58:57.557907 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a2e51e7a-c414-4333-9ebd-e0d25b8ab52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:58:57.567690 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 16:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 16:58:57.610000 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9e100-c50c-4278-90ed-89142eacd6ac None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:58:57.624510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9e100-c50c-4278-90ed-89142eacd6ac None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:58:57.628762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db03c4-2315-4f8a-8615-cab826707a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:58:57.629498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db03c4-2315-4f8a-8615-cab826707a78 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:58:57.629891 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db03c4-2315-4f8a-8615-cab826707a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:58:57.630238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db03c4-2315-4f8a-8615-cab826707a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:58:57.642164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db03c4-2315-4f8a-8615-cab826707a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:58:57.643661 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db03c4-2315-4f8a-8615-cab826707a78 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:58:57.655687 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 719/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:59:00.111935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccf0d6-4cae-411b-ac92-d4ac888eda1b None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:00.112738 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccf0d6-4cae-411b-ac92-d4ac888eda1b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:00.112738 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccf0d6-4cae-411b-ac92-d4ac888eda1b None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:00.114020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 16:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:59:00.120695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb192d96-efed-49aa-b020-113d01ca277a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:00.121311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb192d96-efed-49aa-b020-113d01ca277a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:00.121545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb192d96-efed-49aa-b020-113d01ca277a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:00.128228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=70 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:59:00.145214 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-fb192d96-efed-49aa-b020-113d01ca277a None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:59:00.146598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fb192d96-efed-49aa-b020-113d01ca277a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:59:00.156125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 16:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:59:00.196201 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccf0d6-4cae-411b-ac92-d4ac888eda1b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:59:00.203094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=64 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:59:00.210813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccf0d6-4cae-411b-ac92-d4ac888eda1b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:59:00.216166 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1d05f-9d37-4eca-ac25-ba71969dc6df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:59:00.216991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1d05f-9d37-4eca-ac25-ba71969dc6df service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:00.217386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1d05f-9d37-4eca-ac25-ba71969dc6df service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:00.217816 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1d05f-9d37-4eca-ac25-ba71969dc6df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:00.228944 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1d05f-9d37-4eca-ac25-ba71969dc6df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:59:00.230512 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1d05f-9d37-4eca-ac25-ba71969dc6df service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:59:00.242203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 738/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:59:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:59:02.711410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325ee6a-dd4c-43f8-8503-5c6acffbd448 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:02.711410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325ee6a-dd4c-43f8-8503-5c6acffbd448 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:02.712281 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325ee6a-dd4c-43f8-8503-5c6acffbd448 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:02.713135 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 16:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:59:02.719802 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34db21-0a0a-4624-b38c-fd957e1ecb5d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:02.720369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34db21-0a0a-4624-b38c-fd957e1ecb5d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:02.720369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34db21-0a0a-4624-b38c-fd957e1ecb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:02.740993 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-1a34db21-0a0a-4624-b38c-fd957e1ecb5d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:59:02.742337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1a34db21-0a0a-4624-b38c-fd957e1ecb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:59:02.750985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 16:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:59:02.790150 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325ee6a-dd4c-43f8-8503-5c6acffbd448 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:59:02.804132 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325ee6a-dd4c-43f8-8503-5c6acffbd448 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:59:02.807939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3765f0-593b-48c5-ae43-62d8ab21caed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:59:02.809262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3765f0-593b-48c5-ae43-62d8ab21caed service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:02.809543 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3765f0-593b-48c5-ae43-62d8ab21caed service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:02.809849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3765f0-593b-48c5-ae43-62d8ab21caed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:02.821287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3765f0-593b-48c5-ae43-62d8ab21caed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:59:02.822960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3765f0-593b-48c5-ae43-62d8ab21caed service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:59:02.834836 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 722/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:59:05.431051 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138022d-bd92-499a-a035-d4ecf5488a27 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:05.431660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138022d-bd92-499a-a035-d4ecf5488a27 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:05.431660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138022d-bd92-499a-a035-d4ecf5488a27 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:05.433086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 16:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:59:05.441092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedd7c9-7e59-49b7-a1d3-9fd9692eae1d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:05.441642 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedd7c9-7e59-49b7-a1d3-9fd9692eae1d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:05.441642 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedd7c9-7e59-49b7-a1d3-9fd9692eae1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:05.463299 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7fedd7c9-7e59-49b7-a1d3-9fd9692eae1d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:59:05.465403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7fedd7c9-7e59-49b7-a1d3-9fd9692eae1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:59:05.474331 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 16:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 16:59:05.516224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138022d-bd92-499a-a035-d4ecf5488a27 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:59:05.529392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138022d-bd92-499a-a035-d4ecf5488a27 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:59:05.534123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ea1de-e87a-4d6f-8850-0c15ab854088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:59:05.534927 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ea1de-e87a-4d6f-8850-0c15ab854088 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:05.535314 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ea1de-e87a-4d6f-8850-0c15ab854088 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:05.535697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ea1de-e87a-4d6f-8850-0c15ab854088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:05.547351 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ea1de-e87a-4d6f-8850-0c15ab854088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:59:05.549010 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ea1de-e87a-4d6f-8850-0c15ab854088 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:59:05.559774 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 741/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:59:08.183303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769d857-33c4-48d0-90bf-300d6d006195 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:08.183930 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769d857-33c4-48d0-90bf-300d6d006195 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:08.184217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769d857-33c4-48d0-90bf-300d6d006195 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:08.185795 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 16:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:59:08.191728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ca710-a1cd-415b-a17d-69ff64b4b58f None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:08.192267 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ca710-a1cd-415b-a17d-69ff64b4b58f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:08.192432 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ca710-a1cd-415b-a17d-69ff64b4b58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:08.211734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b41ca710-a1cd-415b-a17d-69ff64b4b58f None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:59:08.212980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b41ca710-a1cd-415b-a17d-69ff64b4b58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:59:08.223872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 16:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 16:59:08.262270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769d857-33c4-48d0-90bf-300d6d006195 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:59:08.273604 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769d857-33c4-48d0-90bf-300d6d006195 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:59:08.277375 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b4c03-4ea9-4405-9cfd-0304914e17ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:59:08.278071 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b4c03-4ea9-4405-9cfd-0304914e17ea service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:08.278355 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b4c03-4ea9-4405-9cfd-0304914e17ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:08.278636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b4c03-4ea9-4405-9cfd-0304914e17ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:08.288649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b4c03-4ea9-4405-9cfd-0304914e17ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:59:08.290154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b4c03-4ea9-4405-9cfd-0304914e17ea service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:59:08.301575 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 725/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:59:10.710469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81e77c-75c1-4b65-8063-c04297c2b8a3 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:10.711053 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81e77c-75c1-4b65-8063-c04297c2b8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:10.711315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81e77c-75c1-4b65-8063-c04297c2b8a3 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:10.713791 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 16:59:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:59:10.720134 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611460a7-d316-4ad7-b025-3ef7d3df729d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:10.720877 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611460a7-d316-4ad7-b025-3ef7d3df729d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:10.720877 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611460a7-d316-4ad7-b025-3ef7d3df729d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:10.741069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-611460a7-d316-4ad7-b025-3ef7d3df729d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:59:10.742354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-611460a7-d316-4ad7-b025-3ef7d3df729d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:59:10.752333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 16:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:59:10.791651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81e77c-75c1-4b65-8063-c04297c2b8a3 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:59:10.804224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81e77c-75c1-4b65-8063-c04297c2b8a3 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:59:10.809021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78681d-d240-4338-87f2-0e024ffadaa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:59:10.809617 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78681d-d240-4338-87f2-0e024ffadaa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:10.809933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78681d-d240-4338-87f2-0e024ffadaa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:10.810212 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78681d-d240-4338-87f2-0e024ffadaa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:10.821202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78681d-d240-4338-87f2-0e024ffadaa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:59:10.822790 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78681d-d240-4338-87f2-0e024ffadaa3 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:59:10.835098 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 744/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:59:20.735355 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=20 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:59:20.830065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=23 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:59:47.300452 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827ab3c-296f-4480-8cac-50797ee017d1 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:47.301280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827ab3c-296f-4480-8cac-50797ee017d1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:47.301280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827ab3c-296f-4480-8cac-50797ee017d1 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:47.302491 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 727/1471] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:59:47.309949 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015f7ab-6422-4a3b-8e41-5b9f03b701e0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:47.310543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015f7ab-6422-4a3b-8e41-5b9f03b701e0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:47.310872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015f7ab-6422-4a3b-8e41-5b9f03b701e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:47.335221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d015f7ab-6422-4a3b-8e41-5b9f03b701e0 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:59:47.336366 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d015f7ab-6422-4a3b-8e41-5b9f03b701e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:59:47.346110 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 745/1472] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:59:47.396718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6a92a-e4ba-4463-920c-5b016e217f05 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:47.397155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6a92a-e4ba-4463-920c-5b016e217f05 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:47.397800 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6a92a-e4ba-4463-920c-5b016e217f05 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:47.399400 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 728/1473] 10.222.0.49 () {54 vars in 962 bytes} [Wed May 18 16:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:59:47.406210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58663702-edc4-4605-9003-fec4e1f4a9b5 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:47.406739 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58663702-edc4-4605-9003-fec4e1f4a9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:47.407229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58663702-edc4-4605-9003-fec4e1f4a9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:47.430698 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-58663702-edc4-4605-9003-fec4e1f4a9b5 None None] MFA Rules not processed for user `0d69d99d980744fba12a6b38586e7bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:59:47.431972 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-58663702-edc4-4605-9003-fec4e1f4a9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:59:47.439579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 746/1474] 10.222.0.49 () {58 vars in 1059 bytes} [Wed May 18 16:59:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:59:47.447405 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6a92a-e4ba-4463-920c-5b016e217f05 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:59:47.459583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6a92a-e4ba-4463-920c-5b016e217f05 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:59:47.463947 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c4211-0194-49a7-8c27-b6f0935e2bd3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d69d99d980744fba12a6b38586e7bf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:59:47.464813 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c4211-0194-49a7-8c27-b6f0935e2bd3 service glance] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:47.464958 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c4211-0194-49a7-8c27-b6f0935e2bd3 service glance] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:47.465167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c4211-0194-49a7-8c27-b6f0935e2bd3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:47.476157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c4211-0194-49a7-8c27-b6f0935e2bd3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:59:47.477874 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c4211-0194-49a7-8c27-b6f0935e2bd3 service glance] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:59:47.489560 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 729/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:59:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 16:59:50.100320 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16904988-fdab-4e5c-931d-25421de67fac None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:50.100991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16904988-fdab-4e5c-931d-25421de67fac None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:50.100991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16904988-fdab-4e5c-931d-25421de67fac None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:50.102360 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 747/1476] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:59:50.109174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624337e-6577-4711-a485-ff4d0f4c3015 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:50.110094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624337e-6577-4711-a485-ff4d0f4c3015 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:50.110272 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624337e-6577-4711-a485-ff4d0f4c3015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:50.130714 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-5624337e-6577-4711-a485-ff4d0f4c3015 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:59:50.132003 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5624337e-6577-4711-a485-ff4d0f4c3015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:59:50.140995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 730/1477] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 16:59:50.177364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16904988-fdab-4e5c-931d-25421de67fac None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:59:50.191453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16904988-fdab-4e5c-931d-25421de67fac None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:59:50.197150 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15f747-b370-4bf5-a0b7-dcb6bc4d0121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:59:50.198431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15f747-b370-4bf5-a0b7-dcb6bc4d0121 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:50.198874 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15f747-b370-4bf5-a0b7-dcb6bc4d0121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:50.199159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15f747-b370-4bf5-a0b7-dcb6bc4d0121 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:50.199904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15f747-b370-4bf5-a0b7-dcb6bc4d0121 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:59:50.201754 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: WARNING py.warnings [None req-ed15f747-b370-4bf5-a0b7-dcb6bc4d0121 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 16:59:50.201754 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: warnings.warn(msg) May 18 16:59:50.201754 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: May 18 16:59:50.202927 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15f747-b370-4bf5-a0b7-dcb6bc4d0121 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:59:50.225688 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 748/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Wed May 18 16:59:50 2022] GET /identity/v3/projects => generated 2553 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 16:59:52.726227 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55aa9f6-9833-4ed3-88a5-e1d203bc86e9 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:52.726985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55aa9f6-9833-4ed3-88a5-e1d203bc86e9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:52.726985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55aa9f6-9833-4ed3-88a5-e1d203bc86e9 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:52.728171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 731/1479] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:59:52.735672 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18c89a-5e32-4303-bf85-c1b1eceac0bf None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:52.736379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18c89a-5e32-4303-bf85-c1b1eceac0bf None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:52.736645 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18c89a-5e32-4303-bf85-c1b1eceac0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:52.766009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-af18c89a-5e32-4303-bf85-c1b1eceac0bf None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:59:52.767259 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-af18c89a-5e32-4303-bf85-c1b1eceac0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:59:52.775438 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 749/1480] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:59:52.823203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55aa9f6-9833-4ed3-88a5-e1d203bc86e9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:59:52.840260 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55aa9f6-9833-4ed3-88a5-e1d203bc86e9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:59:52.846381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd390a-be5e-4eae-a6ee-559f27110dd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:59:52.847184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd390a-be5e-4eae-a6ee-559f27110dd2 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:52.847578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd390a-be5e-4eae-a6ee-559f27110dd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:52.847944 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd390a-be5e-4eae-a6ee-559f27110dd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:52.858324 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd390a-be5e-4eae-a6ee-559f27110dd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:59:52.860225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd390a-be5e-4eae-a6ee-559f27110dd2 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:59:52.874999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 732/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:59:55.595331 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b200b-86d1-4277-baaf-deb701da1460 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:55.595913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b200b-86d1-4277-baaf-deb701da1460 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:55.596015 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b200b-86d1-4277-baaf-deb701da1460 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:55.597485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 750/1482] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:59:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 16:59:55.604019 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ce97f-a839-4f80-bdaf-f4d92ba45ea4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:55.605384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ce97f-a839-4f80-bdaf-f4d92ba45ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:55.605384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ce97f-a839-4f80-bdaf-f4d92ba45ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:55.625289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-954ce97f-a839-4f80-bdaf-f4d92ba45ea4 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:59:55.626605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-954ce97f-a839-4f80-bdaf-f4d92ba45ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:59:55.635067 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 733/1483] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 16:59:55.674518 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b200b-86d1-4277-baaf-deb701da1460 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:59:55.687627 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b200b-86d1-4277-baaf-deb701da1460 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:59:55.691575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab683b81-0e13-4f8e-a55b-55c709872a61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:59:55.692256 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab683b81-0e13-4f8e-a55b-55c709872a61 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:55.692542 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab683b81-0e13-4f8e-a55b-55c709872a61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:55.692855 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab683b81-0e13-4f8e-a55b-55c709872a61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:55.704857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab683b81-0e13-4f8e-a55b-55c709872a61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:59:55.706397 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab683b81-0e13-4f8e-a55b-55c709872a61 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:59:55.718679 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 751/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:59:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 16:59:58.234124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a3b53-4c79-4e35-b6c9-719a655147f1 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:58.234918 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a3b53-4c79-4e35-b6c9-719a655147f1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:58.234918 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a3b53-4c79-4e35-b6c9-719a655147f1 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:58.236027 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 734/1485] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 16:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 16:59:58.242333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df8266-0546-4f99-951a-884102fa2975 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:58.242910 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df8266-0546-4f99-951a-884102fa2975 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:58.243029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df8266-0546-4f99-951a-884102fa2975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:58.268130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c2df8266-0546-4f99-951a-884102fa2975 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 16:59:58.270247 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c2df8266-0546-4f99-951a-884102fa2975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 16:59:58.280395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 752/1486] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 16:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 16:59:58.321677 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a3b53-4c79-4e35-b6c9-719a655147f1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 16:59:58.339388 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a3b53-4c79-4e35-b6c9-719a655147f1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 16:59:58.343481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3dd69-2956-4772-8795-3db01ad8e28f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 16:59:58.344149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3dd69-2956-4772-8795-3db01ad8e28f service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 16:59:58.344436 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3dd69-2956-4772-8795-3db01ad8e28f service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 16:59:58.344716 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3dd69-2956-4772-8795-3db01ad8e28f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 16:59:58.355903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3dd69-2956-4772-8795-3db01ad8e28f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 16:59:58.357410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3dd69-2956-4772-8795-3db01ad8e28f service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 16:59:58.368666 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 735/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 16:59:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:00:00.911918 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6c362-554e-47cf-a1b5-7c3bcf236c8c None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:00:00.912534 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6c362-554e-47cf-a1b5-7c3bcf236c8c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:00:00.912534 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6c362-554e-47cf-a1b5-7c3bcf236c8c None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:00:00.913939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 753/1488] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 17:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:00:00.920122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae438ad-a436-4b2c-9b20-6b4566f446cf None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:00:00.920682 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae438ad-a436-4b2c-9b20-6b4566f446cf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:00:00.920682 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae438ad-a436-4b2c-9b20-6b4566f446cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:00:00.941254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9ae438ad-a436-4b2c-9b20-6b4566f446cf None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:00:00.942556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9ae438ad-a436-4b2c-9b20-6b4566f446cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:00:00.952070 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 736/1489] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 17:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:00:00.996375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6c362-554e-47cf-a1b5-7c3bcf236c8c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:00:01.008328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6c362-554e-47cf-a1b5-7c3bcf236c8c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:00:01.012088 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dde967-803f-4240-b8b3-9e369d2bdcb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:00:01.012754 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dde967-803f-4240-b8b3-9e369d2bdcb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:00:01.013036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dde967-803f-4240-b8b3-9e369d2bdcb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:00:01.013308 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dde967-803f-4240-b8b3-9e369d2bdcb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:00:01.025592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dde967-803f-4240-b8b3-9e369d2bdcb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:00:01.027454 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dde967-803f-4240-b8b3-9e369d2bdcb2 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:00:01.038265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 754/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:00:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:00:03.985972 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd8a37-218b-4d69-bfa6-a8d2483c848b None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:00:03.986652 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd8a37-218b-4d69-bfa6-a8d2483c848b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:00:03.987036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd8a37-218b-4d69-bfa6-a8d2483c848b None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:00:03.989996 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 737/1491] 10.222.0.49 () {54 vars in 926 bytes} [Wed May 18 17:00:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:00:04.000581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d59b43-285d-44b1-91ac-dc6f4b4a234e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:00:04.001150 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d59b43-285d-44b1-91ac-dc6f4b4a234e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:00:04.001150 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d59b43-285d-44b1-91ac-dc6f4b4a234e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:00:04.020702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-90d59b43-285d-44b1-91ac-dc6f4b4a234e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:00:04.021999 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-90d59b43-285d-44b1-91ac-dc6f4b4a234e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:00:04.030438 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 755/1492] 10.222.0.49 () {58 vars in 1023 bytes} [Wed May 18 17:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:00:04.073429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd8a37-218b-4d69-bfa6-a8d2483c848b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:00:04.086782 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd8a37-218b-4d69-bfa6-a8d2483c848b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:00:04.091194 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04483f40-2eb4-4438-ae4c-b6c2c5088235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:00:04.091863 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04483f40-2eb4-4438-ae4c-b6c2c5088235 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:00:04.092143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04483f40-2eb4-4438-ae4c-b6c2c5088235 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:00:04.092420 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04483f40-2eb4-4438-ae4c-b6c2c5088235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:00:04.116552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04483f40-2eb4-4438-ae4c-b6c2c5088235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:00:04.120390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04483f40-2eb4-4438-ae4c-b6c2c5088235 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:00:04.133262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 738/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:00:14.014844 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=33 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:00:14.128269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=33 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:01:56.860802 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c5084-f8ca-4492-9fce-824cbc984d99 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:01:56.861531 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c5084-f8ca-4492-9fce-824cbc984d99 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:01:56.861531 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c5084-f8ca-4492-9fce-824cbc984d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:01:56.881405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-750c5084-f8ca-4492-9fce-824cbc984d99 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:01:56.883405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-750c5084-f8ca-4492-9fce-824cbc984d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:01:56.891853 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 756/1494] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:01:56.902770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b397b0a-9f7a-44e1-a214-17e5ddbb9e31 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:01:56.903350 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b397b0a-9f7a-44e1-a214-17e5ddbb9e31 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:01:56.903350 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b397b0a-9f7a-44e1-a214-17e5ddbb9e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:01:56.929166 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8b397b0a-9f7a-44e1-a214-17e5ddbb9e31 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:01:56.931835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8b397b0a-9f7a-44e1-a214-17e5ddbb9e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:01:56.946225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 739/1495] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:01:56.951381 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c5084-f8ca-4492-9fce-824cbc984d99 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:01:56.962944 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c5084-f8ca-4492-9fce-824cbc984d99 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:01:56.968207 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609503b7-081e-46f8-98de-48def3b46132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:01:56.968944 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609503b7-081e-46f8-98de-48def3b46132 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:01:56.969271 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609503b7-081e-46f8-98de-48def3b46132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:01:56.969717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609503b7-081e-46f8-98de-48def3b46132 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:01:56.970603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609503b7-081e-46f8-98de-48def3b46132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:01:56.971020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609503b7-081e-46f8-98de-48def3b46132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:01:56.972221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: WARNING py.warnings [None req-609503b7-081e-46f8-98de-48def3b46132 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 17:01:56.972221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: warnings.warn(msg) May 18 17:01:56.972221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: May 18 17:01:56.973474 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609503b7-081e-46f8-98de-48def3b46132 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:01:56.988328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 757/1496] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:01:56.998009 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b397b0a-9f7a-44e1-a214-17e5ddbb9e31 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:01:57.009397 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b397b0a-9f7a-44e1-a214-17e5ddbb9e31 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:01:57.014946 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366a9d8-ac01-4598-90bb-761a9eb41417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:01:57.015691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366a9d8-ac01-4598-90bb-761a9eb41417 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:01:57.015974 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366a9d8-ac01-4598-90bb-761a9eb41417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:01:57.016305 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366a9d8-ac01-4598-90bb-761a9eb41417 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:01:57.017074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366a9d8-ac01-4598-90bb-761a9eb41417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:01:57.019090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: WARNING py.warnings [None req-0366a9d8-ac01-4598-90bb-761a9eb41417 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 17:01:57.019090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: warnings.warn(msg) May 18 17:01:57.019090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: May 18 17:01:57.020422 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366a9d8-ac01-4598-90bb-761a9eb41417 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:01:57.066979 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 740/1497] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:01:56 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:01:57.072098 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609503b7-081e-46f8-98de-48def3b46132 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:01:57.083075 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609503b7-081e-46f8-98de-48def3b46132 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:01:57.154584 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895f4e6-c47f-4a69-ad87-495d7a3d3ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:01:57.155427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895f4e6-c47f-4a69-ad87-495d7a3d3ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:01:57.155824 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895f4e6-c47f-4a69-ad87-495d7a3d3ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:01:57.156209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895f4e6-c47f-4a69-ad87-495d7a3d3ab3 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:01:57.157045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895f4e6-c47f-4a69-ad87-495d7a3d3ab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:01:57.158340 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: WARNING py.warnings [None req-0895f4e6-c47f-4a69-ad87-495d7a3d3ab3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 17:01:57.158340 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: warnings.warn(msg) May 18 17:01:57.158340 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: May 18 17:01:57.159841 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895f4e6-c47f-4a69-ad87-495d7a3d3ab3 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:01:57.185262 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 758/1498] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:01:57 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:01:57.195843 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366a9d8-ac01-4598-90bb-761a9eb41417 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:01:57.215207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366a9d8-ac01-4598-90bb-761a9eb41417 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:01:57.223172 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c7a16-8db0-4577-9079-a5e2f3babb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:01:57.224184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c7a16-8db0-4577-9079-a5e2f3babb5e admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:01:57.224670 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c7a16-8db0-4577-9079-a5e2f3babb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:01:57.225148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c7a16-8db0-4577-9079-a5e2f3babb5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:01:57.226592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c7a16-8db0-4577-9079-a5e2f3babb5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:01:57.228510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: WARNING py.warnings [None req-2f6c7a16-8db0-4577-9079-a5e2f3babb5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 17:01:57.228510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: warnings.warn(msg) May 18 17:01:57.228510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: May 18 17:01:57.230310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c7a16-8db0-4577-9079-a5e2f3babb5e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:01:57.256032 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 741/1499] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:01:57.261211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895f4e6-c47f-4a69-ad87-495d7a3d3ab3 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:01:57.279429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895f4e6-c47f-4a69-ad87-495d7a3d3ab3 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:01:57.285995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03189a-6039-425d-91c5-335f980d9a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:01:57.286797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03189a-6039-425d-91c5-335f980d9a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:01:57.287243 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03189a-6039-425d-91c5-335f980d9a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:01:57.287576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03189a-6039-425d-91c5-335f980d9a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:01:57.288386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03189a-6039-425d-91c5-335f980d9a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:01:57.290388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: WARNING py.warnings [None req-9a03189a-6039-425d-91c5-335f980d9a3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 17:01:57.290388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: warnings.warn(msg) May 18 17:01:57.290388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: May 18 17:01:57.291467 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03189a-6039-425d-91c5-335f980d9a3f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:01:57.307853 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 759/1500] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:01:57.312643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c7a16-8db0-4577-9079-a5e2f3babb5e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:01:57.324984 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c7a16-8db0-4577-9079-a5e2f3babb5e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:01:57.330833 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a28916-89ad-4728-9d11-bb2ac9e9b204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:01:57.331757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a28916-89ad-4728-9d11-bb2ac9e9b204 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:01:57.332051 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a28916-89ad-4728-9d11-bb2ac9e9b204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:01:57.332328 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a28916-89ad-4728-9d11-bb2ac9e9b204 admin admin] PATH_INFO: `/v3/projects/42b09d6237bd4be196f4afa147fc2fa6/users/14a85dbd1fb94fbebe572634b9f5ae33/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:01:57.351359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a28916-89ad-4728-9d11-bb2ac9e9b204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b09d6237bd4be196f4afa147fc2fa6, user_id=14a85dbd1fb94fbebe572634b9f5ae33, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:01:57.352592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: WARNING py.warnings [None req-31a28916-89ad-4728-9d11-bb2ac9e9b204 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 17:01:57.352592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: warnings.warn(msg) May 18 17:01:57.352592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: May 18 17:01:57.354601 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a28916-89ad-4728-9d11-bb2ac9e9b204 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:01:57.371429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 742/1501] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:01:57 2022] PUT /identity/v3/projects/42b09d6237bd4be196f4afa147fc2fa6/users/14a85dbd1fb94fbebe572634b9f5ae33/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:01:57.384807 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86f490-226a-4ccb-8c8e-07ff15c67609 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:01:57.385338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86f490-226a-4ccb-8c8e-07ff15c67609 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:01:57.385888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86f490-226a-4ccb-8c8e-07ff15c67609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:01:57.423061 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9e86f490-226a-4ccb-8c8e-07ff15c67609 None None] MFA Rules not processed for user `14a85dbd1fb94fbebe572634b9f5ae33`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:01:57.424564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9e86f490-226a-4ccb-8c8e-07ff15c67609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:01:57.502525 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 760/1502] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:01:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:01:57.517350 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dc599-a867-4c93-89fb-82eee79a941b None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:01:57.517774 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dc599-a867-4c93-89fb-82eee79a941b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:01:57.518104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dc599-a867-4c93-89fb-82eee79a941b None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:01:57.519584 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 743/1503] 10.222.0.49 () {54 vars in 963 bytes} [Wed May 18 17:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:01:57.526884 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61938fa-c26b-4616-852d-b88872de1853 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:01:57.527408 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61938fa-c26b-4616-852d-b88872de1853 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:01:57.527890 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61938fa-c26b-4616-852d-b88872de1853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:01:57.559425 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e61938fa-c26b-4616-852d-b88872de1853 None None] MFA Rules not processed for user `102a6c55061040129802a9739f43036a`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:01:57.561583 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e61938fa-c26b-4616-852d-b88872de1853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:01:57.641418 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:01:57.651963 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 761/1504] 10.222.0.49 () {58 vars in 1060 bytes} [Wed May 18 17:01:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:01:57.660374 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dc599-a867-4c93-89fb-82eee79a941b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:01:57.673159 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268dc599-a867-4c93-89fb-82eee79a941b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:01:57.677227 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a451f-f1c0-44a0-9da8-52ba26c7344e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:01:57.678017 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a451f-f1c0-44a0-9da8-52ba26c7344e service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:01:57.678375 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a451f-f1c0-44a0-9da8-52ba26c7344e service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:01:57.678782 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a451f-f1c0-44a0-9da8-52ba26c7344e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:01:57.692034 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a451f-f1c0-44a0-9da8-52ba26c7344e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:01:57.693550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a451f-f1c0-44a0-9da8-52ba26c7344e service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:01:57.705546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 744/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:01:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:01:57.755771 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99d214-1129-4299-8380-6832f1fcefa3 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:01:57.756232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99d214-1129-4299-8380-6832f1fcefa3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:01:57.756727 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99d214-1129-4299-8380-6832f1fcefa3 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:01:57.759901 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 762/1506] 10.222.0.49 () {52 vars in 829 bytes} [Wed May 18 17:01:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:01:57.764907 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a451f-f1c0-44a0-9da8-52ba26c7344e service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:01:57.841932 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a451f-f1c0-44a0-9da8-52ba26c7344e service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:01:57.847447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a29ad-7e94-4234-8978-610184f05c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:01:57.848398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a29ad-7e94-4234-8978-610184f05c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:01:57.848703 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a29ad-7e94-4234-8978-610184f05c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:01:57.848986 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a29ad-7e94-4234-8978-610184f05c76 admin admin] PATH_INFO: `/v3/users/14a85dbd1fb94fbebe572634b9f5ae33` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:01:57.850387 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a29ad-7e94-4234-8978-610184f05c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a85dbd1fb94fbebe572634b9f5ae33)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:01:57.852506 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: WARNING py.warnings [None req-a52a29ad-7e94-4234-8978-610184f05c76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 17:01:57.852506 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: warnings.warn(msg) May 18 17:01:57.852506 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: May 18 17:01:57.853964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a29ad-7e94-4234-8978-610184f05c76 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:01:57.939009 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a52a29ad-7e94-4234-8978-610184f05c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a85dbd1fb94fbebe572634b9f5ae33'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:01:57.940533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a52a29ad-7e94-4234-8978-610184f05c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a85dbd1fb94fbebe572634b9f5ae33'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:01:57.954083 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a52a29ad-7e94-4234-8978-610184f05c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a85dbd1fb94fbebe572634b9f5ae33'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:01:57.969358 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a52a29ad-7e94-4234-8978-610184f05c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a85dbd1fb94fbebe572634b9f5ae33'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:01:57.989573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:01:57.993418 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a52a29ad-7e94-4234-8978-610184f05c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a85dbd1fb94fbebe572634b9f5ae33'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:01:58.006442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 745/1507] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:01:57 2022] DELETE /identity/v3/users/14a85dbd1fb94fbebe572634b9f5ae33 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:01:58.014384 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0336b3f-0ab3-4b2a-80a6-c7e0f9ce9163 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:01:58.015109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0336b3f-0ab3-4b2a-80a6-c7e0f9ce9163 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:01:58.015607 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0336b3f-0ab3-4b2a-80a6-c7e0f9ce9163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:01:58.047569 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b0336b3f-0ab3-4b2a-80a6-c7e0f9ce9163 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:01:58.048866 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b0336b3f-0ab3-4b2a-80a6-c7e0f9ce9163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:01:58.124091 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 763/1508] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:01:58.138597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a29ad-7e94-4234-8978-610184f05c76 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:01:58.140982 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a52a29ad-7e94-4234-8978-610184f05c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:01:58.219546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a29ad-7e94-4234-8978-610184f05c76 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:01:58.223962 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31862e-056a-497a-9ff2-31bf60843424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:01:58.224736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31862e-056a-497a-9ff2-31bf60843424 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:01:58.225069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31862e-056a-497a-9ff2-31bf60843424 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:01:58.225387 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31862e-056a-497a-9ff2-31bf60843424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:01:58.236960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31862e-056a-497a-9ff2-31bf60843424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:01:58.238640 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31862e-056a-497a-9ff2-31bf60843424 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:01:58.250413 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 746/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:01:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:01:58.691011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0336b3f-0ab3-4b2a-80a6-c7e0f9ce9163 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:01:58.692957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b0336b3f-0ab3-4b2a-80a6-c7e0f9ce9163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:01:58.709816 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0336b3f-0ab3-4b2a-80a6-c7e0f9ce9163 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:01:58.718069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43713e09-3a2f-47f7-aa9e-cd8a1d8bbde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:01:58.719111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43713e09-3a2f-47f7-aa9e-cd8a1d8bbde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:01:58.719500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43713e09-3a2f-47f7-aa9e-cd8a1d8bbde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:01:58.719881 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43713e09-3a2f-47f7-aa9e-cd8a1d8bbde7 admin admin] PATH_INFO: `/v3/projects/42b09d6237bd4be196f4afa147fc2fa6` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:01:58.721902 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43713e09-3a2f-47f7-aa9e-cd8a1d8bbde7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b09d6237bd4be196f4afa147fc2fa6)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:01:58.722576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: WARNING py.warnings [None req-43713e09-3a2f-47f7-aa9e-cd8a1d8bbde7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 17:01:58.722576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: warnings.warn(msg) May 18 17:01:58.722576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: May 18 17:01:58.724003 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43713e09-3a2f-47f7-aa9e-cd8a1d8bbde7 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:01:58.814982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-43713e09-3a2f-47f7-aa9e-cd8a1d8bbde7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b09d6237bd4be196f4afa147fc2fa6', 'request_id': 'req-43713e09-3a2f-47f7-aa9e-cd8a1d8bbde7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:01:58.823158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-43713e09-3a2f-47f7-aa9e-cd8a1d8bbde7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b09d6237bd4be196f4afa147fc2fa6', 'request_id': 'req-43713e09-3a2f-47f7-aa9e-cd8a1d8bbde7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:01:58.839942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-43713e09-3a2f-47f7-aa9e-cd8a1d8bbde7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b09d6237bd4be196f4afa147fc2fa6', 'request_id': 'req-43713e09-3a2f-47f7-aa9e-cd8a1d8bbde7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:01:58.857767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-43713e09-3a2f-47f7-aa9e-cd8a1d8bbde7 admin admin] The token cache is being invalidate because project 42b09d6237bd4be196f4afa147fc2fa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:01:58.858087 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-43713e09-3a2f-47f7-aa9e-cd8a1d8bbde7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:01:58.858841 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-43713e09-3a2f-47f7-aa9e-cd8a1d8bbde7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:01:58.860458 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 764/1510] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:01:58 2022] DELETE /identity/v3/projects/42b09d6237bd4be196f4afa147fc2fa6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:02:08.245506 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:02:08.854398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:03:43.205702 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1b854-7e90-4a85-bb99-741499f9ba01 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:03:43.206304 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1b854-7e90-4a85-bb99-741499f9ba01 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:03:43.206304 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1b854-7e90-4a85-bb99-741499f9ba01 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:03:43.207672 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 17:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:03:43.214866 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000b758-41b1-43e9-a0af-633b2a1d45e2 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:03:43.215727 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000b758-41b1-43e9-a0af-633b2a1d45e2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:03:43.215899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000b758-41b1-43e9-a0af-633b2a1d45e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:03:43.236464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-1000b758-41b1-43e9-a0af-633b2a1d45e2 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:03:43.237844 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1000b758-41b1-43e9-a0af-633b2a1d45e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:03:43.306781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 17:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:03:43.483434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1b854-7e90-4a85-bb99-741499f9ba01 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:03:43.485342 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-82b1b854-7e90-4a85-bb99-741499f9ba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:03:43.579452 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1b854-7e90-4a85-bb99-741499f9ba01 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:03:43.585001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afac2a-a9db-451f-81c3-df484bab495b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:03:43.585680 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afac2a-a9db-451f-81c3-df484bab495b service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:03:43.585973 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afac2a-a9db-451f-81c3-df484bab495b service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:03:43.586248 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afac2a-a9db-451f-81c3-df484bab495b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:03:43.595449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afac2a-a9db-451f-81c3-df484bab495b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:03:43.597062 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afac2a-a9db-451f-81c3-df484bab495b service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:03:43.607563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 748/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:03:44.572169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc68a95-11f7-4d9e-8a99-2a6521c81a75 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:03:44.572760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc68a95-11f7-4d9e-8a99-2a6521c81a75 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:03:44.572985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc68a95-11f7-4d9e-8a99-2a6521c81a75 None None] PATH_INFO: `/v3` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:03:44.574416 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 766/1514] 10.222.0.73 () {54 vars in 925 bytes} [Wed May 18 17:03:44 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:03:44.574569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbb5a4-4e66-471e-b2d8-8859ca863d2d None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:03:44.575024 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbb5a4-4e66-471e-b2d8-8859ca863d2d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:03:44.575189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbb5a4-4e66-471e-b2d8-8859ca863d2d None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:03:44.576601 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 749/1515] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 17:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:03:44.581046 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a545686-1071-4748-b4fe-88ce58327891 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:03:44.581422 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a545686-1071-4748-b4fe-88ce58327891 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:03:44.581609 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea242bd-0487-4e3d-b32a-1738f784e5e8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:03:44.581797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a545686-1071-4748-b4fe-88ce58327891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:03:44.581950 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea242bd-0487-4e3d-b32a-1738f784e5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:03:44.582183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea242bd-0487-4e3d-b32a-1738f784e5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:03:44.602930 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7ea242bd-0487-4e3d-b32a-1738f784e5e8 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:03:44.603255 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-1a545686-1071-4748-b4fe-88ce58327891 None None] MFA Rules not processed for user `bebc8414d01a40c8ab34afa9b1312a59`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:03:44.604285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1a545686-1071-4748-b4fe-88ce58327891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:03:44.605214 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7ea242bd-0487-4e3d-b32a-1738f784e5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:03:44.617768 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 750/1516] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 17:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:03:44.699599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 767/1517] 10.222.0.73 () {58 vars in 1015 bytes} [Wed May 18 17:03:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:03:44.772489 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea242bd-0487-4e3d-b32a-1738f784e5e8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:03:44.788658 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea242bd-0487-4e3d-b32a-1738f784e5e8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:03:44.794241 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3709e-4c7f-4695-af69-00035a6da6ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:03:44.794900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3709e-4c7f-4695-af69-00035a6da6ee service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:03:44.795186 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3709e-4c7f-4695-af69-00035a6da6ee service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:03:44.795467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3709e-4c7f-4695-af69-00035a6da6ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:03:44.806016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3709e-4c7f-4695-af69-00035a6da6ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:03:44.807622 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3709e-4c7f-4695-af69-00035a6da6ee service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:03:44.818006 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 751/1518] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:03:54.018758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc4fdc-7ec6-4694-9f02-e73c5091da6c None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:03:54.019308 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc4fdc-7ec6-4694-9f02-e73c5091da6c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:03:54.019308 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc4fdc-7ec6-4694-9f02-e73c5091da6c None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:03:54.020751 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 768/1519] 10.222.0.49 () {54 vars in 960 bytes} [Wed May 18 17:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:03:54.026583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973f309-7a8d-46e7-9c02-85840eccc414 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:03:54.027078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973f309-7a8d-46e7-9c02-85840eccc414 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:03:54.027175 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973f309-7a8d-46e7-9c02-85840eccc414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:03:54.045422 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0973f309-7a8d-46e7-9c02-85840eccc414 None None] MFA Rules not processed for user `bebc8414d01a40c8ab34afa9b1312a59`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:03:54.046669 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0973f309-7a8d-46e7-9c02-85840eccc414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:03:54.055931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 752/1520] 10.222.0.49 () {58 vars in 1057 bytes} [Wed May 18 17:03:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:03:54.064047 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc4fdc-7ec6-4694-9f02-e73c5091da6c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:03:54.078869 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc4fdc-7ec6-4694-9f02-e73c5091da6c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:03:54.084542 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec971a2-6f2b-457d-a90f-2604c34f27ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bebc8414d01a40c8ab34afa9b1312a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:03:54.085198 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec971a2-6f2b-457d-a90f-2604c34f27ab service placement] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:03:54.085479 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec971a2-6f2b-457d-a90f-2604c34f27ab service placement] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:03:54.085788 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec971a2-6f2b-457d-a90f-2604c34f27ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:03:54.095581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec971a2-6f2b-457d-a90f-2604c34f27ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:03:54.097218 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec971a2-6f2b-457d-a90f-2604c34f27ab service placement] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:03:54.110985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 769/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:03:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:03:56.186330 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12273a0-03ad-4444-9c29-a476cf985cd6 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:03:56.186935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12273a0-03ad-4444-9c29-a476cf985cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:03:56.186935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12273a0-03ad-4444-9c29-a476cf985cd6 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:03:56.188305 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 753/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 17:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:03:56.193338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c10e53-d5e5-41c9-829d-da48c5be56ee None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:03:56.193834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c10e53-d5e5-41c9-829d-da48c5be56ee None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:03:56.193934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c10e53-d5e5-41c9-829d-da48c5be56ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:03:56.212979 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a1c10e53-d5e5-41c9-829d-da48c5be56ee None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:03:56.214244 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a1c10e53-d5e5-41c9-829d-da48c5be56ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:03:56.222210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 770/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 17:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:03:56.386123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12273a0-03ad-4444-9c29-a476cf985cd6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:03:56.404310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12273a0-03ad-4444-9c29-a476cf985cd6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:03:56.410328 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b101ca5-2ee6-4734-b928-75edc57bc57a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:03:56.411010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b101ca5-2ee6-4734-b928-75edc57bc57a service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:03:56.411313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b101ca5-2ee6-4734-b928-75edc57bc57a service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:03:56.411602 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b101ca5-2ee6-4734-b928-75edc57bc57a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:03:56.421748 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b101ca5-2ee6-4734-b928-75edc57bc57a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:03:56.423403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b101ca5-2ee6-4734-b928-75edc57bc57a service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:03:56.435976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 754/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:03:57.388459 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041851d-6259-46cb-bfb6-b30560974748 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:03:57.389023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041851d-6259-46cb-bfb6-b30560974748 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:03:57.389023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041851d-6259-46cb-bfb6-b30560974748 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:03:57.390409 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 771/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 18 17:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:03:57.396514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b611b34-8005-47a3-ba50-5bfef839f96c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:03:57.397077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b611b34-8005-47a3-ba50-5bfef839f96c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:03:57.397077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b611b34-8005-47a3-ba50-5bfef839f96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:03:57.415757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0b611b34-8005-47a3-ba50-5bfef839f96c None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:03:57.416989 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0b611b34-8005-47a3-ba50-5bfef839f96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:03:57.425082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 755/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 18 17:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:03:57.580312 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041851d-6259-46cb-bfb6-b30560974748 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:03:57.595321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041851d-6259-46cb-bfb6-b30560974748 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:03:57.601140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf7aae-e54f-470d-967e-d973e4c05ed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:03:57.601843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf7aae-e54f-470d-967e-d973e4c05ed5 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:03:57.602131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf7aae-e54f-470d-967e-d973e4c05ed5 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:03:57.602411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf7aae-e54f-470d-967e-d973e4c05ed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:03:57.611760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf7aae-e54f-470d-967e-d973e4c05ed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:03:57.613391 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf7aae-e54f-470d-967e-d973e4c05ed5 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:03:57.624272 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 772/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:04:01.639408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9fe23-8881-4510-a3a2-385763667b41 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:04:01.639986 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9fe23-8881-4510-a3a2-385763667b41 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:04:01.639986 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9fe23-8881-4510-a3a2-385763667b41 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:04:01.641367 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 756/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 17:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:04:01.647107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219334-8e62-49ed-8f10-4c0b78009ca6 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:04:01.647591 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219334-8e62-49ed-8f10-4c0b78009ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:04:01.647702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219334-8e62-49ed-8f10-4c0b78009ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:04:01.666523 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6c219334-8e62-49ed-8f10-4c0b78009ca6 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:04:01.667734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6c219334-8e62-49ed-8f10-4c0b78009ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:04:01.676140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 773/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 17:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:04:01.713722 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9fe23-8881-4510-a3a2-385763667b41 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:04:01.715427 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c9d9fe23-8881-4510-a3a2-385763667b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:04:01.775649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9fe23-8881-4510-a3a2-385763667b41 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:04:01.779062 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97dbe9-2107-4d8b-99e8-ce94437fdf35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:04:01.779717 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97dbe9-2107-4d8b-99e8-ce94437fdf35 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:04:01.780004 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97dbe9-2107-4d8b-99e8-ce94437fdf35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:04:01.780901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97dbe9-2107-4d8b-99e8-ce94437fdf35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:04:01.790286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97dbe9-2107-4d8b-99e8-ce94437fdf35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:04:01.791758 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97dbe9-2107-4d8b-99e8-ce94437fdf35 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:04:01.801257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 757/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:04:04.183810 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7e901-7294-4a74-b1ec-55fd3eb32b41 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:04:04.184371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7e901-7294-4a74-b1ec-55fd3eb32b41 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:04:04.184371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d7e901-7294-4a74-b1ec-55fd3eb32b41 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:04:04.185779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 774/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 17:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:04:04.191523 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9966da-ccdd-4bdd-afda-5f6e7886d783 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:04:04.192006 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9966da-ccdd-4bdd-afda-5f6e7886d783 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:04:04.192108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9966da-ccdd-4bdd-afda-5f6e7886d783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:04:04.211412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-aa9966da-ccdd-4bdd-afda-5f6e7886d783 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:04:04.212889 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-aa9966da-ccdd-4bdd-afda-5f6e7886d783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:04:04.221091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 758/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 17:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:04:04.257945 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7e901-7294-4a74-b1ec-55fd3eb32b41 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:04:04.260122 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-77d7e901-7294-4a74-b1ec-55fd3eb32b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:04:04.276895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d7e901-7294-4a74-b1ec-55fd3eb32b41 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:04:04.285041 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083d37c-5872-4e9c-b65a-70f7fe283b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:04:04.285313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083d37c-5872-4e9c-b65a-70f7fe283b86 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:04:04.285591 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083d37c-5872-4e9c-b65a-70f7fe283b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:04:04.285903 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083d37c-5872-4e9c-b65a-70f7fe283b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:04:04.300872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083d37c-5872-4e9c-b65a-70f7fe283b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:04:04.302998 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083d37c-5872-4e9c-b65a-70f7fe283b86 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:04:04.313458 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 775/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:04:07.922520 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944b9d3-4931-45ca-a3b4-d4222784f2a7 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:04:07.923086 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944b9d3-4931-45ca-a3b4-d4222784f2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:04:07.923086 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944b9d3-4931-45ca-a3b4-d4222784f2a7 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:04:07.924453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 759/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 17:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:04:07.929889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3bed0-c191-4a84-acfe-628ae597958c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:04:07.930359 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3bed0-c191-4a84-acfe-628ae597958c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:04:07.930473 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3bed0-c191-4a84-acfe-628ae597958c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:04:07.949820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6fc3bed0-c191-4a84-acfe-628ae597958c None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:04:07.951037 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6fc3bed0-c191-4a84-acfe-628ae597958c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:04:07.959874 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 776/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 17:04:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:04:08.234124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944b9d3-4931-45ca-a3b4-d4222784f2a7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:04:08.235768 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7944b9d3-4931-45ca-a3b4-d4222784f2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:04:08.255001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:04:08.296069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944b9d3-4931-45ca-a3b4-d4222784f2a7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:04:08.299584 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecf18f-3033-4c2f-bd81-d8e249838df6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:04:08.300229 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecf18f-3033-4c2f-bd81-d8e249838df6 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:04:08.300517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecf18f-3033-4c2f-bd81-d8e249838df6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:04:08.300797 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecf18f-3033-4c2f-bd81-d8e249838df6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:04:08.310116 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecf18f-3033-4c2f-bd81-d8e249838df6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:04:08.311541 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecf18f-3033-4c2f-bd81-d8e249838df6 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:04:08.321618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 760/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:04:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:04:10.602819 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59040c75-c2e0-4e20-8b46-bc6638eca0d3 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:04:10.603397 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59040c75-c2e0-4e20-8b46-bc6638eca0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:04:10.603397 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59040c75-c2e0-4e20-8b46-bc6638eca0d3 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:04:10.604763 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 777/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 18 17:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:04:10.610062 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18886e-a9d8-429b-ad17-1f91ef4a063c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:04:10.610466 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18886e-a9d8-429b-ad17-1f91ef4a063c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:04:10.610623 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18886e-a9d8-429b-ad17-1f91ef4a063c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:04:10.629960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-fd18886e-a9d8-429b-ad17-1f91ef4a063c None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:04:10.631394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fd18886e-a9d8-429b-ad17-1f91ef4a063c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:04:10.639365 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 761/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 18 17:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:04:10.911484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59040c75-c2e0-4e20-8b46-bc6638eca0d3 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:04:10.913274 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-59040c75-c2e0-4e20-8b46-bc6638eca0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:04:10.920930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=84 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:04:10.927410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59040c75-c2e0-4e20-8b46-bc6638eca0d3 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:04:10.931043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47581546-54ea-4df1-9661-36b1781b7868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:04:10.931680 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47581546-54ea-4df1-9661-36b1781b7868 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:04:10.931963 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47581546-54ea-4df1-9661-36b1781b7868 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:04:10.932245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47581546-54ea-4df1-9661-36b1781b7868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:04:10.941576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47581546-54ea-4df1-9661-36b1781b7868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:04:10.943077 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47581546-54ea-4df1-9661-36b1781b7868 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:04:10.953357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 778/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:04:20.624452 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=22 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:04:20.949141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:45.737487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf3dd5-6741-44b7-b2fc-cca5ca9ded33 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:45.738161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf3dd5-6741-44b7-b2fc-cca5ca9ded33 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:45.738258 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf3dd5-6741-44b7-b2fc-cca5ca9ded33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:45.775173 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-77cf3dd5-6741-44b7-b2fc-cca5ca9ded33 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:45.776883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-77cf3dd5-6741-44b7-b2fc-cca5ca9ded33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:45.811794 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 762/1540] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:05:45.837540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51248858-fad9-433e-bbec-9ec282e1bc40 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:45.838418 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51248858-fad9-433e-bbec-9ec282e1bc40 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:45.838867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51248858-fad9-433e-bbec-9ec282e1bc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:45.882729 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-51248858-fad9-433e-bbec-9ec282e1bc40 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:45.885388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-51248858-fad9-433e-bbec-9ec282e1bc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:45.899827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08c4e8-52d1-4737-8c8b-5c86b01a72e1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:45.900193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08c4e8-52d1-4737-8c8b-5c86b01a72e1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:45.900390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08c4e8-52d1-4737-8c8b-5c86b01a72e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:45.910175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 779/1541] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:45.927571 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51248858-fad9-433e-bbec-9ec282e1bc40 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:45.938162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-eb08c4e8-52d1-4737-8c8b-5c86b01a72e1 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:45.939890 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-eb08c4e8-52d1-4737-8c8b-5c86b01a72e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:45.946281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51248858-fad9-433e-bbec-9ec282e1bc40 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:45.958727 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 763/1542] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:45.960901 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da677a9-9c1d-4feb-8ec4-9f8c2f8898c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:45.961623 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da677a9-9c1d-4feb-8ec4-9f8c2f8898c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:45.961943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da677a9-9c1d-4feb-8ec4-9f8c2f8898c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:45.962230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da677a9-9c1d-4feb-8ec4-9f8c2f8898c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:45.963252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da677a9-9c1d-4feb-8ec4-9f8c2f8898c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:05:45.963569 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da677a9-9c1d-4feb-8ec4-9f8c2f8898c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:45.965810 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da677a9-9c1d-4feb-8ec4-9f8c2f8898c9 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:45.969469 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9bb0f-fcea-4b2a-86f4-aeb6e93e36e1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:45.969839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9bb0f-fcea-4b2a-86f4-aeb6e93e36e1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:45.970065 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9bb0f-fcea-4b2a-86f4-aeb6e93e36e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.000221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 780/1543] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:05:46.005017 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f0d9bb0f-fcea-4b2a-86f4-aeb6e93e36e1 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:46.006325 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f0d9bb0f-fcea-4b2a-86f4-aeb6e93e36e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:46.023310 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da677a9-9c1d-4feb-8ec4-9f8c2f8898c9 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:46.024477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 764/1544] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:05:46.030066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9bb0f-fcea-4b2a-86f4-aeb6e93e36e1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:46.040583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9bb0f-fcea-4b2a-86f4-aeb6e93e36e1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:46.047330 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da677a9-9c1d-4feb-8ec4-9f8c2f8898c9 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:46.073696 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477b3bc-4423-4ad7-9af1-84ab58e5ff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:46.073696 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477b3bc-4423-4ad7-9af1-84ab58e5ff32 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.073696 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477b3bc-4423-4ad7-9af1-84ab58e5ff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.073696 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477b3bc-4423-4ad7-9af1-84ab58e5ff32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.074294 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477b3bc-4423-4ad7-9af1-84ab58e5ff32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:46.074294 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: WARNING py.warnings [None req-5477b3bc-4423-4ad7-9af1-84ab58e5ff32 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 17:05:46.074294 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: warnings.warn(msg) May 18 17:05:46.074294 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: May 18 17:05:46.074294 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477b3bc-4423-4ad7-9af1-84ab58e5ff32 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:46.087380 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b68d9-7adf-42c2-b414-75d4eed57bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:46.088331 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b68d9-7adf-42c2-b414-75d4eed57bcf admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.088614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b68d9-7adf-42c2-b414-75d4eed57bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.088892 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b68d9-7adf-42c2-b414-75d4eed57bcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.089640 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b68d9-7adf-42c2-b414-75d4eed57bcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:05:46.089970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b68d9-7adf-42c2-b414-75d4eed57bcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:46.092170 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: WARNING py.warnings [None req-7c7b68d9-7adf-42c2-b414-75d4eed57bcf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 17:05:46.092170 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: warnings.warn(msg) May 18 17:05:46.092170 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: May 18 17:05:46.093117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b68d9-7adf-42c2-b414-75d4eed57bcf admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:46.120002 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 765/1545] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:05:46.121399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed709763-0135-40de-8392-4515f7ba1f5a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.121717 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed709763-0135-40de-8392-4515f7ba1f5a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.122058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed709763-0135-40de-8392-4515f7ba1f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.149871 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 781/1546] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:46.151377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60919d7e-4900-4d8c-b52f-b3202ef06995 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.151678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60919d7e-4900-4d8c-b52f-b3202ef06995 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.151966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60919d7e-4900-4d8c-b52f-b3202ef06995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.153888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ed709763-0135-40de-8392-4515f7ba1f5a None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:46.155192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ed709763-0135-40de-8392-4515f7ba1f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:46.204744 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-60919d7e-4900-4d8c-b52f-b3202ef06995 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:46.207672 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-60919d7e-4900-4d8c-b52f-b3202ef06995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:46.262049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 766/1547] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:46.263660 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed709763-0135-40de-8392-4515f7ba1f5a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:46.273741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed709763-0135-40de-8392-4515f7ba1f5a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:46.279033 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57cb644-0408-40e2-af1f-b5d86beccaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:46.279725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cb644-0408-40e2-af1f-b5d86beccaca admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.279990 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cb644-0408-40e2-af1f-b5d86beccaca admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.280319 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cb644-0408-40e2-af1f-b5d86beccaca admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.280953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57cb644-0408-40e2-af1f-b5d86beccaca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:46.281999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: WARNING py.warnings [None req-d57cb644-0408-40e2-af1f-b5d86beccaca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 17:05:46.281999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: warnings.warn(msg) May 18 17:05:46.281999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: May 18 17:05:46.283215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57cb644-0408-40e2-af1f-b5d86beccaca admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:46.284164 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 782/1548] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:46.284852 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60919d7e-4900-4d8c-b52f-b3202ef06995 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:46.295447 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60919d7e-4900-4d8c-b52f-b3202ef06995 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:46.300939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96ee60-3cea-4919-98e8-34ec080cd619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:46.301590 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96ee60-3cea-4919-98e8-34ec080cd619 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.301915 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96ee60-3cea-4919-98e8-34ec080cd619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.302188 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96ee60-3cea-4919-98e8-34ec080cd619 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.302882 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96ee60-3cea-4919-98e8-34ec080cd619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:46.304860 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96ee60-3cea-4919-98e8-34ec080cd619 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:46.308644 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 767/1549] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/users => generated 292 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:46.312427 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8bf97-16a8-4e59-8e70-4aff915cf2a5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.312427 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8bf97-16a8-4e59-8e70-4aff915cf2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.312427 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8bf97-16a8-4e59-8e70-4aff915cf2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.331185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7ec8bf97-16a8-4e59-8e70-4aff915cf2a5 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:46.332447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7ec8bf97-16a8-4e59-8e70-4aff915cf2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:46.339755 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 783/1550] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:46.341754 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88f4e0-8481-4eae-aff6-364bb9fde6b6 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.341979 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88f4e0-8481-4eae-aff6-364bb9fde6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.342255 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88f4e0-8481-4eae-aff6-364bb9fde6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.344572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 768/1551] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:46.345972 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e36eb5-478f-4acb-bbb6-94ddc5ae8160 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.346265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e36eb5-478f-4acb-bbb6-94ddc5ae8160 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.346541 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e36eb5-478f-4acb-bbb6-94ddc5ae8160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.368645 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-60e36eb5-478f-4acb-bbb6-94ddc5ae8160 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:46.369919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-60e36eb5-478f-4acb-bbb6-94ddc5ae8160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:46.370050 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-aa88f4e0-8481-4eae-aff6-364bb9fde6b6 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:46.371241 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-aa88f4e0-8481-4eae-aff6-364bb9fde6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:46.441489 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 769/1552] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:46.451636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6d859-71d5-4003-b877-7bde2aab4e7f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.451636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6d859-71d5-4003-b877-7bde2aab4e7f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.451636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6d859-71d5-4003-b877-7bde2aab4e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.456759 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 784/1553] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:46.458434 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726511d-7889-46b0-bc04-29fd241815cf None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.458725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726511d-7889-46b0-bc04-29fd241815cf None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.459005 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726511d-7889-46b0-bc04-29fd241815cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.472750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-34e6d859-71d5-4003-b877-7bde2aab4e7f None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:46.474023 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-34e6d859-71d5-4003-b877-7bde2aab4e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:46.478735 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-8726511d-7889-46b0-bc04-29fd241815cf None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:46.479936 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8726511d-7889-46b0-bc04-29fd241815cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:46.483064 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 770/1554] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:46.484379 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a5988-9c10-41aa-b47d-8ada9b767056 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.484671 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a5988-9c10-41aa-b47d-8ada9b767056 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.484955 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a5988-9c10-41aa-b47d-8ada9b767056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.494020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 785/1555] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:46.495087 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726511d-7889-46b0-bc04-29fd241815cf None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:46.506116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726511d-7889-46b0-bc04-29fd241815cf None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:46.510282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ef9a5988-9c10-41aa-b47d-8ada9b767056 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:46.511192 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e16b25-5bd8-4f3f-913c-5936dc387857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:46.511693 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ef9a5988-9c10-41aa-b47d-8ada9b767056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:46.512014 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e16b25-5bd8-4f3f-913c-5936dc387857 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.512517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e16b25-5bd8-4f3f-913c-5936dc387857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.512790 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e16b25-5bd8-4f3f-913c-5936dc387857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.513831 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e16b25-5bd8-4f3f-913c-5936dc387857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:46.515533 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e16b25-5bd8-4f3f-913c-5936dc387857 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:46.521456 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 771/1556] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:46.522336 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a5988-9c10-41aa-b47d-8ada9b767056 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:46.526885 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 786/1557] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:46.528650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df15ac-400c-461f-9f9c-166560cf2d49 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.528650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df15ac-400c-461f-9f9c-166560cf2d49 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.528882 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df15ac-400c-461f-9f9c-166560cf2d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.533779 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a5988-9c10-41aa-b47d-8ada9b767056 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:46.538688 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803ea11-7333-4b0d-a07e-4196738a78e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:46.539368 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803ea11-7333-4b0d-a07e-4196738a78e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.539650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803ea11-7333-4b0d-a07e-4196738a78e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.539926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803ea11-7333-4b0d-a07e-4196738a78e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.540626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803ea11-7333-4b0d-a07e-4196738a78e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:46.542601 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803ea11-7333-4b0d-a07e-4196738a78e9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:46.548913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-37df15ac-400c-461f-9f9c-166560cf2d49 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:46.550415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-37df15ac-400c-461f-9f9c-166560cf2d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:46.561568 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 787/1558] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:46.563119 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40606032-0ce8-4653-a9db-3e033e1c8d2d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.563414 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40606032-0ce8-4653-a9db-3e033e1c8d2d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.563694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40606032-0ce8-4653-a9db-3e033e1c8d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.572524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 772/1559] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:46.572524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b89a22-81b1-4401-80e2-227fbff3596f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.572524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b89a22-81b1-4401-80e2-227fbff3596f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.572524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b89a22-81b1-4401-80e2-227fbff3596f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.583454 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-40606032-0ce8-4653-a9db-3e033e1c8d2d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:46.584700 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-40606032-0ce8-4653-a9db-3e033e1c8d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:46.591614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d9b89a22-81b1-4401-80e2-227fbff3596f None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:46.592840 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d9b89a22-81b1-4401-80e2-227fbff3596f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:46.594482 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 788/1560] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:46.595781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69bd14-6d69-4cb1-8637-561d15cd9c92 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.596134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69bd14-6d69-4cb1-8637-561d15cd9c92 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.596553 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69bd14-6d69-4cb1-8637-561d15cd9c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.601767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 773/1561] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:46.602585 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b89a22-81b1-4401-80e2-227fbff3596f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:46.610713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:46.618382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4e69bd14-6d69-4cb1-8637-561d15cd9c92 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:46.618610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b89a22-81b1-4401-80e2-227fbff3596f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:46.625746 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4e69bd14-6d69-4cb1-8637-561d15cd9c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:46.626054 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e61573-ebf3-44bd-b6d4-64b59aaa6504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:46.627191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e61573-ebf3-44bd-b6d4-64b59aaa6504 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.627701 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e61573-ebf3-44bd-b6d4-64b59aaa6504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.628202 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e61573-ebf3-44bd-b6d4-64b59aaa6504 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.629586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e61573-ebf3-44bd-b6d4-64b59aaa6504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:05:46.630535 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e61573-ebf3-44bd-b6d4-64b59aaa6504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:46.632189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e61573-ebf3-44bd-b6d4-64b59aaa6504 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:46.634084 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:46.634666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 789/1562] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:46.636362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69bd14-6d69-4cb1-8637-561d15cd9c92 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:46.648042 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 774/1563] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:05:46.648458 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69bd14-6d69-4cb1-8637-561d15cd9c92 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:46.650698 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e61573-ebf3-44bd-b6d4-64b59aaa6504 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:46.653400 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ed881-ee34-4b8b-a453-320923f05bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:46.654202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ed881-ee34-4b8b-a453-320923f05bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.654532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ed881-ee34-4b8b-a453-320923f05bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.654876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ed881-ee34-4b8b-a453-320923f05bc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.655694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ed881-ee34-4b8b-a453-320923f05bc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:05:46.656018 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ed881-ee34-4b8b-a453-320923f05bc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:46.657649 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ed881-ee34-4b8b-a453-320923f05bc0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:46.662340 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e61573-ebf3-44bd-b6d4-64b59aaa6504 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:46.667054 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a93ab5-d826-42ee-983a-bb4028f0ccc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:46.667720 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a93ab5-d826-42ee-983a-bb4028f0ccc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.668007 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a93ab5-d826-42ee-983a-bb4028f0ccc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.668280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a93ab5-d826-42ee-983a-bb4028f0ccc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.669558 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a93ab5-d826-42ee-983a-bb4028f0ccc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:46.671163 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 790/1564] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:05:46.671420 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a93ab5-d826-42ee-983a-bb4028f0ccc0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:46.672154 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ed881-ee34-4b8b-a453-320923f05bc0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:46.683549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ed881-ee34-4b8b-a453-320923f05bc0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:46.689239 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 775/1565] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:46.689429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bf92d-d87a-4322-a4fb-61e228d822f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:46.690059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bf92d-d87a-4322-a4fb-61e228d822f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.690187 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a93ab5-d826-42ee-983a-bb4028f0ccc0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:46.690355 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bf92d-d87a-4322-a4fb-61e228d822f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.690633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bf92d-d87a-4322-a4fb-61e228d822f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.691374 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bf92d-d87a-4322-a4fb-61e228d822f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:05:46.691690 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bf92d-d87a-4322-a4fb-61e228d822f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:46.693336 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bf92d-d87a-4322-a4fb-61e228d822f5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:46.701810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a93ab5-d826-42ee-983a-bb4028f0ccc0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:46.708405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 791/1566] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:05:46.709342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bf92d-d87a-4322-a4fb-61e228d822f5 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:46.715933 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0571c-f0a8-4e2e-8c56-658d98912e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:46.716912 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0571c-f0a8-4e2e-8c56-658d98912e9d admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.717458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0571c-f0a8-4e2e-8c56-658d98912e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.717603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0571c-f0a8-4e2e-8c56-658d98912e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.718575 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0571c-f0a8-4e2e-8c56-658d98912e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:46.720226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0571c-f0a8-4e2e-8c56-658d98912e9d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:46.725649 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bf92d-d87a-4322-a4fb-61e228d822f5 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:46.730461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fde015-5e23-4ad9-8f94-37b3b8514e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:46.731833 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 776/1567] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:46.731962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fde015-5e23-4ad9-8f94-37b3b8514e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.731962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fde015-5e23-4ad9-8f94-37b3b8514e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.732914 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fde015-5e23-4ad9-8f94-37b3b8514e81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.732914 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fde015-5e23-4ad9-8f94-37b3b8514e81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:05:46.733240 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fde015-5e23-4ad9-8f94-37b3b8514e81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:46.734877 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fde015-5e23-4ad9-8f94-37b3b8514e81 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:46.735256 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0571c-f0a8-4e2e-8c56-658d98912e9d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:46.746454 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0571c-f0a8-4e2e-8c56-658d98912e9d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:46.752400 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f4c36-a805-40fa-915d-30a53f269a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:46.753075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f4c36-a805-40fa-915d-30a53f269a3c admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.753356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f4c36-a805-40fa-915d-30a53f269a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.753632 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f4c36-a805-40fa-915d-30a53f269a3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.754525 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f4c36-a805-40fa-915d-30a53f269a3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:05:46.754829 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f4c36-a805-40fa-915d-30a53f269a3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:46.756449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f4c36-a805-40fa-915d-30a53f269a3c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:46.760113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 792/1568] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:05:46.761378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fde015-5e23-4ad9-8f94-37b3b8514e81 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:46.772830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fde015-5e23-4ad9-8f94-37b3b8514e81 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:46.778450 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 777/1569] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:05:46.778450 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f4c36-a805-40fa-915d-30a53f269a3c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:46.785806 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519c20a-e77d-480c-96e6-778ed375ca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:46.786814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519c20a-e77d-480c-96e6-778ed375ca1b admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.787096 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519c20a-e77d-480c-96e6-778ed375ca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.787371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519c20a-e77d-480c-96e6-778ed375ca1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.788116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519c20a-e77d-480c-96e6-778ed375ca1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:05:46.788422 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519c20a-e77d-480c-96e6-778ed375ca1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:46.790328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519c20a-e77d-480c-96e6-778ed375ca1b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:46.792086 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f4c36-a805-40fa-915d-30a53f269a3c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:46.802314 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560023d-984d-440a-8753-7a636c4ada4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:46.803007 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560023d-984d-440a-8753-7a636c4ada4c admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.803300 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560023d-984d-440a-8753-7a636c4ada4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.803582 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560023d-984d-440a-8753-7a636c4ada4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.804357 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560023d-984d-440a-8753-7a636c4ada4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:46.805279 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 793/1570] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:05:46.806519 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519c20a-e77d-480c-96e6-778ed375ca1b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:46.816278 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560023d-984d-440a-8753-7a636c4ada4c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:46.819248 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519c20a-e77d-480c-96e6-778ed375ca1b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:46.827343 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e22053-572f-4b7f-a68f-e0f67b9c1fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:46.828711 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e22053-572f-4b7f-a68f-e0f67b9c1fab admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.829414 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e22053-572f-4b7f-a68f-e0f67b9c1fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.830099 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e22053-572f-4b7f-a68f-e0f67b9c1fab admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.831335 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e22053-572f-4b7f-a68f-e0f67b9c1fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:46.835288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e22053-572f-4b7f-a68f-e0f67b9c1fab admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:46.850600 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 778/1571] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:46.852015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560023d-984d-440a-8753-7a636c4ada4c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:46.877894 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 794/1572] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:46.877894 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e22053-572f-4b7f-a68f-e0f67b9c1fab admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:46.930299 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560023d-984d-440a-8753-7a636c4ada4c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:46.971508 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e22053-572f-4b7f-a68f-e0f67b9c1fab admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:46.977596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f3216-1b6f-4914-8856-bad14843acfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:46.978306 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f3216-1b6f-4914-8856-bad14843acfd admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.978596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f3216-1b6f-4914-8856-bad14843acfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.978874 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f3216-1b6f-4914-8856-bad14843acfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:46.979576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f3216-1b6f-4914-8856-bad14843acfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:46.981600 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f3216-1b6f-4914-8856-bad14843acfd admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:46.996261 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0f7f6-b1ed-4990-96aa-2e450e8f23f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:46.997775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0f7f6-b1ed-4990-96aa-2e450e8f23f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:46.998058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0f7f6-b1ed-4990-96aa-2e450e8f23f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:46.998342 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0f7f6-b1ed-4990-96aa-2e450e8f23f3 admin admin] PATH_INFO: `/v3/projects/b0f5daaa505d4985a76f95f1cf7b2da6/users/01881ccdf756480b8fcc1ac599fdf905/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.014409 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 795/1573] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:05:46 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:47.015916 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f3216-1b6f-4914-8856-bad14843acfd admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.028270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0f7f6-b1ed-4990-96aa-2e450e8f23f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f5daaa505d4985a76f95f1cf7b2da6, user_id=01881ccdf756480b8fcc1ac599fdf905, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.031050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0f7f6-b1ed-4990-96aa-2e450e8f23f3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.045088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 779/1574] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:05:46 2022] PUT /identity/v3/projects/b0f5daaa505d4985a76f95f1cf7b2da6/users/01881ccdf756480b8fcc1ac599fdf905/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:05:47.046086 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0f7f6-b1ed-4990-96aa-2e450e8f23f3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.081281 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:47.089088 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f3216-1b6f-4914-8856-bad14843acfd admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.103488 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:47.116112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0f7f6-b1ed-4990-96aa-2e450e8f23f3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.121392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b75aca-07ff-449b-a4d0-ddd1ef923e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.122628 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b75aca-07ff-449b-a4d0-ddd1ef923e90 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.123240 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b75aca-07ff-449b-a4d0-ddd1ef923e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.123240 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b75aca-07ff-449b-a4d0-ddd1ef923e90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.123841 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b75aca-07ff-449b-a4d0-ddd1ef923e90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.125800 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b75aca-07ff-449b-a4d0-ddd1ef923e90 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.155188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 780/1575] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:05:47 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:47.157081 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b2545-7478-423f-b0bc-9da58def4803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.157829 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b2545-7478-423f-b0bc-9da58def4803 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.158154 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b2545-7478-423f-b0bc-9da58def4803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.158616 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b2545-7478-423f-b0bc-9da58def4803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.159145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b2545-7478-423f-b0bc-9da58def4803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.159408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b75aca-07ff-449b-a4d0-ddd1ef923e90 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.161220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b2545-7478-423f-b0bc-9da58def4803 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.172457 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 796/1576] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:47.173324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b2545-7478-423f-b0bc-9da58def4803 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.183939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b2545-7478-423f-b0bc-9da58def4803 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.238736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b75aca-07ff-449b-a4d0-ddd1ef923e90 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.243629 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8688d5-7915-4563-adf6-8e8ffdbc07f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.244291 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8688d5-7915-4563-adf6-8e8ffdbc07f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.244573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8688d5-7915-4563-adf6-8e8ffdbc07f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.244850 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8688d5-7915-4563-adf6-8e8ffdbc07f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.245545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8688d5-7915-4563-adf6-8e8ffdbc07f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.246558 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bdb5e-08c6-48c2-b093-7f399ea9e54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.248091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8688d5-7915-4563-adf6-8e8ffdbc07f4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.248465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bdb5e-08c6-48c2-b093-7f399ea9e54a admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.248755 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bdb5e-08c6-48c2-b093-7f399ea9e54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.249070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bdb5e-08c6-48c2-b093-7f399ea9e54a admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.249765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bdb5e-08c6-48c2-b093-7f399ea9e54a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.251671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bdb5e-08c6-48c2-b093-7f399ea9e54a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.276450 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 781/1577] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:05:47 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:47.282460 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 797/1578] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:05:47 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:47.282460 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bdb5e-08c6-48c2-b093-7f399ea9e54a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.282719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8688d5-7915-4563-adf6-8e8ffdbc07f4 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.344810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8688d5-7915-4563-adf6-8e8ffdbc07f4 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.345267 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bdb5e-08c6-48c2-b093-7f399ea9e54a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.349755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c7624-3e83-4ba2-b934-5c45ab516cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.349940 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e28e2-3905-410d-a5d0-474c962c81ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.350433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c7624-3e83-4ba2-b934-5c45ab516cbe admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.350578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e28e2-3905-410d-a5d0-474c962c81ec admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.350711 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c7624-3e83-4ba2-b934-5c45ab516cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.350867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e28e2-3905-410d-a5d0-474c962c81ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.350983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c7624-3e83-4ba2-b934-5c45ab516cbe admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.351670 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c7624-3e83-4ba2-b934-5c45ab516cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.351769 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e28e2-3905-410d-a5d0-474c962c81ec admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.352464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e28e2-3905-410d-a5d0-474c962c81ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.353788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c7624-3e83-4ba2-b934-5c45ab516cbe admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.354458 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e28e2-3905-410d-a5d0-474c962c81ec admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.378307 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 782/1580] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:05:47 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:47.378519 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 798/1580] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:05:47 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:47.382062 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c7624-3e83-4ba2-b934-5c45ab516cbe admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.383116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462460f-89ad-45c8-a67d-5a8d60bcaafb None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.383683 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462460f-89ad-45c8-a67d-5a8d60bcaafb None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.384067 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462460f-89ad-45c8-a67d-5a8d60bcaafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.392216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c7624-3e83-4ba2-b934-5c45ab516cbe admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.396884 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea29d5d-48cd-4dca-a805-93a9f28c1da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.397693 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea29d5d-48cd-4dca-a805-93a9f28c1da4 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.397880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea29d5d-48cd-4dca-a805-93a9f28c1da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.398143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea29d5d-48cd-4dca-a805-93a9f28c1da4 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.398835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea29d5d-48cd-4dca-a805-93a9f28c1da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.400760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea29d5d-48cd-4dca-a805-93a9f28c1da4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.404590 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4462460f-89ad-45c8-a67d-5a8d60bcaafb None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:47.405846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4462460f-89ad-45c8-a67d-5a8d60bcaafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:47.414068 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 799/1581] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:47.414999 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462460f-89ad-45c8-a67d-5a8d60bcaafb None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.426264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 783/1582] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:05:47 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:47.426264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea29d5d-48cd-4dca-a805-93a9f28c1da4 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.429918 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462460f-89ad-45c8-a67d-5a8d60bcaafb None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.435420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ee3eb-1ee5-4478-a10d-cd006ac24f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.436098 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ee3eb-1ee5-4478-a10d-cd006ac24f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.436383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ee3eb-1ee5-4478-a10d-cd006ac24f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.436660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ee3eb-1ee5-4478-a10d-cd006ac24f55 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.437420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ee3eb-1ee5-4478-a10d-cd006ac24f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.437711 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea29d5d-48cd-4dca-a805-93a9f28c1da4 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.439465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ee3eb-1ee5-4478-a10d-cd006ac24f55 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.442449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0590be-8091-4928-8040-83225508115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.443334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0590be-8091-4928-8040-83225508115b admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.443620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0590be-8091-4928-8040-83225508115b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.443898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0590be-8091-4928-8040-83225508115b admin admin] PATH_INFO: `/v3/projects/af6df110a2604ba3adab104ec1decf4c/users/5e28c0ca22d143eebe6fc93f85442a7f/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.448086 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:47.462107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 800/1583] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:05:47 2022] POST /identity/v3/users => generated 284 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:47.462425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0590be-8091-4928-8040-83225508115b admin admin] RBAC: Authorizing `identity:create_grant(project_id=af6df110a2604ba3adab104ec1decf4c, user_id=5e28c0ca22d143eebe6fc93f85442a7f, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.463151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ee3eb-1ee5-4478-a10d-cd006ac24f55 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.465377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0590be-8091-4928-8040-83225508115b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.469330 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:47.473851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ee3eb-1ee5-4478-a10d-cd006ac24f55 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.478595 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af426d5d-6b8e-408e-a74a-d490c436d029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.479262 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af426d5d-6b8e-408e-a74a-d490c436d029 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.479542 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af426d5d-6b8e-408e-a74a-d490c436d029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.479816 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af426d5d-6b8e-408e-a74a-d490c436d029 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.480496 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af426d5d-6b8e-408e-a74a-d490c436d029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.483667 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af426d5d-6b8e-408e-a74a-d490c436d029 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.491264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 784/1584] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:05:47 2022] PUT /identity/v3/projects/af6df110a2604ba3adab104ec1decf4c/users/5e28c0ca22d143eebe6fc93f85442a7f/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:05:47.492136 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0590be-8091-4928-8040-83225508115b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.513182 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 801/1585] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:05:47 2022] POST /identity/v3/users => generated 290 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:47.513182 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af426d5d-6b8e-408e-a74a-d490c436d029 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.522841 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af426d5d-6b8e-408e-a74a-d490c436d029 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.566661 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0590be-8091-4928-8040-83225508115b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.571323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437c607-9df8-4394-a30a-cca7452338a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.572145 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437c607-9df8-4394-a30a-cca7452338a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.572425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437c607-9df8-4394-a30a-cca7452338a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.572700 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437c607-9df8-4394-a30a-cca7452338a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.573396 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437c607-9df8-4394-a30a-cca7452338a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.575502 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437c607-9df8-4394-a30a-cca7452338a5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.596238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a176b7-578c-4e7b-99b7-d0a1b3fbda87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.596945 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a176b7-578c-4e7b-99b7-d0a1b3fbda87 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.597252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a176b7-578c-4e7b-99b7-d0a1b3fbda87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.597478 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a176b7-578c-4e7b-99b7-d0a1b3fbda87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.598239 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a176b7-578c-4e7b-99b7-d0a1b3fbda87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.599849 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a176b7-578c-4e7b-99b7-d0a1b3fbda87 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.601278 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 785/1586] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:05:47 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:47.602864 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437c607-9df8-4394-a30a-cca7452338a5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.612681 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 802/1587] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:47.613622 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a176b7-578c-4e7b-99b7-d0a1b3fbda87 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.615498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437c607-9df8-4394-a30a-cca7452338a5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.620859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d3dc9-17b2-4d2c-b38a-517182dae8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.621545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d3dc9-17b2-4d2c-b38a-517182dae8ba admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.621884 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d3dc9-17b2-4d2c-b38a-517182dae8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.622188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d3dc9-17b2-4d2c-b38a-517182dae8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.622918 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d3dc9-17b2-4d2c-b38a-517182dae8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.624553 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d3dc9-17b2-4d2c-b38a-517182dae8ba admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.635448 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 786/1588] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:47.636132 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d3dc9-17b2-4d2c-b38a-517182dae8ba admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.646954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d3dc9-17b2-4d2c-b38a-517182dae8ba admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.651718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df0dc4-f110-4f89-a6bf-64b91e2f2ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.652392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df0dc4-f110-4f89-a6bf-64b91e2f2ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.652680 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df0dc4-f110-4f89-a6bf-64b91e2f2ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.653460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df0dc4-f110-4f89-a6bf-64b91e2f2ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.654245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df0dc4-f110-4f89-a6bf-64b91e2f2ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.656047 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df0dc4-f110-4f89-a6bf-64b91e2f2ac6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.667341 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 787/1589] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:47.668279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df0dc4-f110-4f89-a6bf-64b91e2f2ac6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.677888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a176b7-578c-4e7b-99b7-d0a1b3fbda87 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.680639 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df0dc4-f110-4f89-a6bf-64b91e2f2ac6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.681464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7cb46-4324-4168-9552-6b00416b8d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.682154 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7cb46-4324-4168-9552-6b00416b8d84 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.682503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7cb46-4324-4168-9552-6b00416b8d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.682707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7cb46-4324-4168-9552-6b00416b8d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.685998 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c5393-82e6-4291-9ee2-7c051b7d4bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.686658 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c5393-82e6-4291-9ee2-7c051b7d4bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.687079 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c5393-82e6-4291-9ee2-7c051b7d4bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.687286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c5393-82e6-4291-9ee2-7c051b7d4bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.688060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c5393-82e6-4291-9ee2-7c051b7d4bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.689571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c5393-82e6-4291-9ee2-7c051b7d4bc8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.694624 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7cb46-4324-4168-9552-6b00416b8d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.696329 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7cb46-4324-4168-9552-6b00416b8d84 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.700497 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 788/1590] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:47.701927 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6ff86-390b-436e-a0f5-ae113725b9df None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.702216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6ff86-390b-436e-a0f5-ae113725b9df None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.702492 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6ff86-390b-436e-a0f5-ae113725b9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.710607 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 803/1591] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:05:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:05:47.711229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7cb46-4324-4168-9552-6b00416b8d84 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.723128 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7cb46-4324-4168-9552-6b00416b8d84 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.724292 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c9d6ff86-390b-436e-a0f5-ae113725b9df None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:47.726176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c9d6ff86-390b-436e-a0f5-ae113725b9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:47.728458 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4e478-82c5-47a2-a31e-8f754bfee2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.729209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4e478-82c5-47a2-a31e-8f754bfee2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.729632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4e478-82c5-47a2-a31e-8f754bfee2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.730007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4e478-82c5-47a2-a31e-8f754bfee2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.730846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4e478-82c5-47a2-a31e-8f754bfee2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.733186 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4e478-82c5-47a2-a31e-8f754bfee2a5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.739265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 789/1592] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:47.740622 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6ff86-390b-436e-a0f5-ae113725b9df None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.752228 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 804/1593] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:47.755854 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4e478-82c5-47a2-a31e-8f754bfee2a5 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.759394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6ff86-390b-436e-a0f5-ae113725b9df None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.767597 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4e478-82c5-47a2-a31e-8f754bfee2a5 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.768943 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f29988-8f71-446f-b30d-7ff580792125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.770046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f29988-8f71-446f-b30d-7ff580792125 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.770629 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f29988-8f71-446f-b30d-7ff580792125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.771399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f29988-8f71-446f-b30d-7ff580792125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.772785 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f29988-8f71-446f-b30d-7ff580792125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.773175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78425d-d1f1-4ba1-9a04-46281d7acf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.774101 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78425d-d1f1-4ba1-9a04-46281d7acf21 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.774447 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78425d-d1f1-4ba1-9a04-46281d7acf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.774734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78425d-d1f1-4ba1-9a04-46281d7acf21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.775608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78425d-d1f1-4ba1-9a04-46281d7acf21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.776866 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f29988-8f71-446f-b30d-7ff580792125 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.777544 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78425d-d1f1-4ba1-9a04-46281d7acf21 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.793045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 805/1594] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:47.795383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78425d-d1f1-4ba1-9a04-46281d7acf21 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.799374 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 790/1595] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:47.801450 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f29988-8f71-446f-b30d-7ff580792125 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.815097 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78425d-d1f1-4ba1-9a04-46281d7acf21 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.821432 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f29988-8f71-446f-b30d-7ff580792125 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.822319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dce08f-9ff0-4795-a6d5-572930b48392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.823221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dce08f-9ff0-4795-a6d5-572930b48392 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.823544 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dce08f-9ff0-4795-a6d5-572930b48392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.823860 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dce08f-9ff0-4795-a6d5-572930b48392 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.824604 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dce08f-9ff0-4795-a6d5-572930b48392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.827206 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dce08f-9ff0-4795-a6d5-572930b48392 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.829496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c56f9a-b568-46fa-b43b-269a7d631469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.830339 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c56f9a-b568-46fa-b43b-269a7d631469 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.830691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c56f9a-b568-46fa-b43b-269a7d631469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.831091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c56f9a-b568-46fa-b43b-269a7d631469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.831901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c56f9a-b568-46fa-b43b-269a7d631469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.833643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c56f9a-b568-46fa-b43b-269a7d631469 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.840933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 806/1596] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:47.842138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dce08f-9ff0-4795-a6d5-572930b48392 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.849110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 791/1597] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:47.850672 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c56f9a-b568-46fa-b43b-269a7d631469 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.852555 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dce08f-9ff0-4795-a6d5-572930b48392 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.859770 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec49fa-1c28-442a-96e9-37c35dbb2232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.860537 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec49fa-1c28-442a-96e9-37c35dbb2232 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.860923 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec49fa-1c28-442a-96e9-37c35dbb2232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.861231 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c56f9a-b568-46fa-b43b-269a7d631469 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.861402 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec49fa-1c28-442a-96e9-37c35dbb2232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.862613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec49fa-1c28-442a-96e9-37c35dbb2232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.864575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec49fa-1c28-442a-96e9-37c35dbb2232 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.865186 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e0b59-fd9e-4db1-a6eb-b5cc0c471edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.865959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e0b59-fd9e-4db1-a6eb-b5cc0c471edb service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.866345 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e0b59-fd9e-4db1-a6eb-b5cc0c471edb service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.866706 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e0b59-fd9e-4db1-a6eb-b5cc0c471edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.878093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e0b59-fd9e-4db1-a6eb-b5cc0c471edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.879000 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 807/1598] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:47.879767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e0b59-fd9e-4db1-a6eb-b5cc0c471edb service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.882888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec49fa-1c28-442a-96e9-37c35dbb2232 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.891974 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 792/1599] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:05:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:05:47.894823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec49fa-1c28-442a-96e9-37c35dbb2232 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.899661 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e0b59-fd9e-4db1-a6eb-b5cc0c471edb service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.900589 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40fa71-bf6d-40aa-a205-1fcc2be334db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.901343 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40fa71-bf6d-40aa-a205-1fcc2be334db admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.901765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40fa71-bf6d-40aa-a205-1fcc2be334db admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.902112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40fa71-bf6d-40aa-a205-1fcc2be334db admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.903152 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40fa71-bf6d-40aa-a205-1fcc2be334db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.904916 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40fa71-bf6d-40aa-a205-1fcc2be334db admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.914629 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e0b59-fd9e-4db1-a6eb-b5cc0c471edb service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.920316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 808/1600] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:47.921265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40fa71-bf6d-40aa-a205-1fcc2be334db admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.922092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accc505-cc15-48e9-95fd-c0b120c24263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.923145 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accc505-cc15-48e9-95fd-c0b120c24263 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.923730 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accc505-cc15-48e9-95fd-c0b120c24263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.924382 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accc505-cc15-48e9-95fd-c0b120c24263 admin admin] PATH_INFO: `/v3/projects/b951375b8ac14f22b50dc3dc49aa4e24/users/6d333ebaed9e4a8384159f7b65a71f22/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.933675 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40fa71-bf6d-40aa-a205-1fcc2be334db admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:47.940416 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa958696-38b0-412f-beaf-0a95c1840754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:47.941337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa958696-38b0-412f-beaf-0a95c1840754 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:47.941576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa958696-38b0-412f-beaf-0a95c1840754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:47.941962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa958696-38b0-412f-beaf-0a95c1840754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:47.942760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa958696-38b0-412f-beaf-0a95c1840754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.944669 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa958696-38b0-412f-beaf-0a95c1840754 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.945742 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accc505-cc15-48e9-95fd-c0b120c24263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b951375b8ac14f22b50dc3dc49aa4e24, user_id=6d333ebaed9e4a8384159f7b65a71f22, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:47.949527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accc505-cc15-48e9-95fd-c0b120c24263 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:47.957779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 809/1601] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:47.958887 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa958696-38b0-412f-beaf-0a95c1840754 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.979095 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 793/1602] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:05:47 2022] PUT /identity/v3/projects/b951375b8ac14f22b50dc3dc49aa4e24/users/6d333ebaed9e4a8384159f7b65a71f22/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:05:47.980350 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accc505-cc15-48e9-95fd-c0b120c24263 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:47.990486 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa958696-38b0-412f-beaf-0a95c1840754 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:48.021016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:48.045267 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:48.094122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accc505-cc15-48e9-95fd-c0b120c24263 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:48.099750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf1ec7-0e24-4858-8c33-0a58d6027b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:48.100393 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f0618-2540-455d-a0c8-5299ab94ed43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:48.100758 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf1ec7-0e24-4858-8c33-0a58d6027b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:48.101379 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf1ec7-0e24-4858-8c33-0a58d6027b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:48.101641 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f0618-2540-455d-a0c8-5299ab94ed43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:48.101924 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf1ec7-0e24-4858-8c33-0a58d6027b78 admin admin] PATH_INFO: `/v3/projects/2ffb442f11714159af838b0176f885ca/users/9b596d7285294117b826f459a39872c1/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:48.102145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f0618-2540-455d-a0c8-5299ab94ed43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:48.102367 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f0618-2540-455d-a0c8-5299ab94ed43 admin admin] PATH_INFO: `/v3/projects/0b3e1f13b2444681a0a32ac3810b7876/users/8ce65ea6e70145af9ef012219f753b53/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:48.126950 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf1ec7-0e24-4858-8c33-0a58d6027b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ffb442f11714159af838b0176f885ca, user_id=9b596d7285294117b826f459a39872c1, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:48.130329 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf1ec7-0e24-4858-8c33-0a58d6027b78 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:48.156613 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 794/1603] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:05:47 2022] PUT /identity/v3/projects/2ffb442f11714159af838b0176f885ca/users/9b596d7285294117b826f459a39872c1/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:05:48.157491 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf1ec7-0e24-4858-8c33-0a58d6027b78 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:48.163410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f0618-2540-455d-a0c8-5299ab94ed43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3e1f13b2444681a0a32ac3810b7876, user_id=8ce65ea6e70145af9ef012219f753b53, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:48.164608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: WARNING py.warnings [None req-a14f0618-2540-455d-a0c8-5299ab94ed43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 17:05:48.164608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: warnings.warn(msg) May 18 17:05:48.164608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: May 18 17:05:48.166760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f0618-2540-455d-a0c8-5299ab94ed43 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:48.201463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 810/1604] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:05:47 2022] PUT /identity/v3/projects/0b3e1f13b2444681a0a32ac3810b7876/users/8ce65ea6e70145af9ef012219f753b53/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:05:48.202629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f0618-2540-455d-a0c8-5299ab94ed43 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:48.295443 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf1ec7-0e24-4858-8c33-0a58d6027b78 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:48.303302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f9261-fe1c-4642-abb9-b1d7c07b3a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:48.305034 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f9261-fe1c-4642-abb9-b1d7c07b3a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:48.305536 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f9261-fe1c-4642-abb9-b1d7c07b3a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:48.306606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f9261-fe1c-4642-abb9-b1d7c07b3a2d admin admin] PATH_INFO: `/v3/projects/1d783438e69647c1bcb2e341add1d326/users/ee65fa3e191545d08780f3423a078484/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:48.309096 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f0618-2540-455d-a0c8-5299ab94ed43 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:48.320530 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f55ee3-d064-4259-a951-f2bb9148eff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:48.321521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f55ee3-d064-4259-a951-f2bb9148eff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:48.321846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f55ee3-d064-4259-a951-f2bb9148eff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:48.322167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f55ee3-d064-4259-a951-f2bb9148eff6 admin admin] PATH_INFO: `/v3/projects/0f0e2176993f4c61bd976aa95fe55346/users/69ca0baaf3854917bf6fc02883b0b949/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:48.332214 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f9261-fe1c-4642-abb9-b1d7c07b3a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d783438e69647c1bcb2e341add1d326, user_id=ee65fa3e191545d08780f3423a078484, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:48.335392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f9261-fe1c-4642-abb9-b1d7c07b3a2d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:48.344250 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f55ee3-d064-4259-a951-f2bb9148eff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f0e2176993f4c61bd976aa95fe55346, user_id=69ca0baaf3854917bf6fc02883b0b949, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:48.348463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f55ee3-d064-4259-a951-f2bb9148eff6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:48.353388 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 795/1605] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:05:48 2022] PUT /identity/v3/projects/1d783438e69647c1bcb2e341add1d326/users/ee65fa3e191545d08780f3423a078484/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:05:48.354446 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f9261-fe1c-4642-abb9-b1d7c07b3a2d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:48.405036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 811/1606] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:05:48 2022] PUT /identity/v3/projects/0f0e2176993f4c61bd976aa95fe55346/users/69ca0baaf3854917bf6fc02883b0b949/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:05:48.408661 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8285b5b-1b41-4ced-978b-95b80e32d51a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:48.408661 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8285b5b-1b41-4ced-978b-95b80e32d51a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:48.408661 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8285b5b-1b41-4ced-978b-95b80e32d51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:48.448165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f9261-fe1c-4642-abb9-b1d7c07b3a2d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:48.472923 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a8285b5b-1b41-4ced-978b-95b80e32d51a None None] MFA Rules not processed for user `6d333ebaed9e4a8384159f7b65a71f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:48.474395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a8285b5b-1b41-4ced-978b-95b80e32d51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:48.521065 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:48.555950 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579610f-d11f-4967-bc01-ee21fc695845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:48.557048 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579610f-d11f-4967-bc01-ee21fc695845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:48.557482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579610f-d11f-4967-bc01-ee21fc695845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:48.557800 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579610f-d11f-4967-bc01-ee21fc695845 admin admin] PATH_INFO: `/v3/projects/091b4f2f90bb45faaac46e59e35dd08b/users/59c033bb26aa457eae960dbd1aee7b81/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:48.602982 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579610f-d11f-4967-bc01-ee21fc695845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=091b4f2f90bb45faaac46e59e35dd08b, user_id=59c033bb26aa457eae960dbd1aee7b81, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:48.605755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579610f-d11f-4967-bc01-ee21fc695845 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:48.613760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 812/1607] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:48.613760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87dbbd-d495-40d3-9445-6c4f1f444ee1 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:48.613760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87dbbd-d495-40d3-9445-6c4f1f444ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:48.613760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87dbbd-d495-40d3-9445-6c4f1f444ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:48.631545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 796/1608] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:05:48 2022] PUT /identity/v3/projects/091b4f2f90bb45faaac46e59e35dd08b/users/59c033bb26aa457eae960dbd1aee7b81/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:05:48.633446 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70c211-a59a-4d6c-abf9-eb794097f52b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:48.633990 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70c211-a59a-4d6c-abf9-eb794097f52b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:48.634513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70c211-a59a-4d6c-abf9-eb794097f52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:48.647032 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-dc87dbbd-d495-40d3-9445-6c4f1f444ee1 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:48.649407 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-dc87dbbd-d495-40d3-9445-6c4f1f444ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:48.671971 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:48.689169 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4f70c211-a59a-4d6c-abf9-eb794097f52b None None] MFA Rules not processed for user `8ce65ea6e70145af9ef012219f753b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:48.690978 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4f70c211-a59a-4d6c-abf9-eb794097f52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:48.815482 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 813/1609] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:48.816992 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde6efe-c5ac-4505-8c11-a1e9893b90cd None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:48.817293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde6efe-c5ac-4505-8c11-a1e9893b90cd None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:48.817572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde6efe-c5ac-4505-8c11-a1e9893b90cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:48.823672 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 797/1610] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:48.827035 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbb285-2475-458f-9b28-72801faaf5c8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:48.829509 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbb285-2475-458f-9b28-72801faaf5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:48.830095 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbb285-2475-458f-9b28-72801faaf5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:48.855626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-3bde6efe-c5ac-4505-8c11-a1e9893b90cd None None] MFA Rules not processed for user `ee65fa3e191545d08780f3423a078484`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:48.857884 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3bde6efe-c5ac-4505-8c11-a1e9893b90cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:48.878199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3ddbb285-2475-458f-9b28-72801faaf5c8 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:48.879540 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3ddbb285-2475-458f-9b28-72801faaf5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:48.907068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 798/1611] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:48.907895 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbb285-2475-458f-9b28-72801faaf5c8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:48.934609 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbb285-2475-458f-9b28-72801faaf5c8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:48.944470 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c049a-d26f-43bb-91d8-30d5ad6cbe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:48.945159 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c049a-d26f-43bb-91d8-30d5ad6cbe57 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:48.945437 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c049a-d26f-43bb-91d8-30d5ad6cbe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:48.945749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c049a-d26f-43bb-91d8-30d5ad6cbe57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:48.946457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c049a-d26f-43bb-91d8-30d5ad6cbe57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:48.948411 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c049a-d26f-43bb-91d8-30d5ad6cbe57 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:48.989381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 799/1612] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:05:48 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:48.990927 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dae14-096e-41f2-9d38-3f9a2fb2315c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:48.991210 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dae14-096e-41f2-9d38-3f9a2fb2315c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:48.991490 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dae14-096e-41f2-9d38-3f9a2fb2315c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:49.051543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 814/1613] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:49.051543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde6efe-c5ac-4505-8c11-a1e9893b90cd None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:49.063489 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-585dae14-096e-41f2-9d38-3f9a2fb2315c None None] MFA Rules not processed for user `59c033bb26aa457eae960dbd1aee7b81`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:49.065446 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-585dae14-096e-41f2-9d38-3f9a2fb2315c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:49.232161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 800/1614] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:49.233727 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c65d96-af3d-45b4-9f8e-82df237488e8 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:49.236447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c65d96-af3d-45b4-9f8e-82df237488e8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:49.236447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c65d96-af3d-45b4-9f8e-82df237488e8 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:49.240089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 801/1615] 10.222.0.49 () {54 vars in 961 bytes} [Wed May 18 17:05:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:05:49.245627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c65d96-af3d-45b4-9f8e-82df237488e8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:49.262924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde6efe-c5ac-4505-8c11-a1e9893b90cd None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:49.301473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:49.409442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c65d96-af3d-45b4-9f8e-82df237488e8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:49.422683 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157d642-34d7-4939-abdd-ebb582d5c05a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:49.424108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157d642-34d7-4939-abdd-ebb582d5c05a service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:49.424668 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157d642-34d7-4939-abdd-ebb582d5c05a service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:49.425506 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157d642-34d7-4939-abdd-ebb582d5c05a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:49.451798 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2664f3-7bfb-40c9-81b6-3f018fdc093e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:49.455208 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2664f3-7bfb-40c9-81b6-3f018fdc093e service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:49.457863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2664f3-7bfb-40c9-81b6-3f018fdc093e service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:49.458483 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2664f3-7bfb-40c9-81b6-3f018fdc093e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:49.519499 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:49.740246 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157d642-34d7-4939-abdd-ebb582d5c05a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:49.741772 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157d642-34d7-4939-abdd-ebb582d5c05a service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:49.769069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 802/1616] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:05:49.770439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157d642-34d7-4939-abdd-ebb582d5c05a service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:49.770838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2664f3-7bfb-40c9-81b6-3f018fdc093e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:49.775553 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2664f3-7bfb-40c9-81b6-3f018fdc093e service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:49.797176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157d642-34d7-4939-abdd-ebb582d5c05a service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:49.802364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 815/1617] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:05:49.804702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2664f3-7bfb-40c9-81b6-3f018fdc093e service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:49.820626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc96674-f206-447e-8cd1-6d4641d56728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:49.821698 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc96674-f206-447e-8cd1-6d4641d56728 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:49.822028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc96674-f206-447e-8cd1-6d4641d56728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:49.822310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc96674-f206-447e-8cd1-6d4641d56728 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:49.823141 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc96674-f206-447e-8cd1-6d4641d56728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:49.826069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc96674-f206-447e-8cd1-6d4641d56728 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:49.868163 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 803/1618] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:05:49 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:49.869319 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169790c8-ad55-48a5-9b40-9da0de93098f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:49.869619 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169790c8-ad55-48a5-9b40-9da0de93098f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:49.869930 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169790c8-ad55-48a5-9b40-9da0de93098f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:49.964254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-169790c8-ad55-48a5-9b40-9da0de93098f None None] MFA Rules not processed for user `c9e3c0ef5ed943d183b064f383fc01f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:49.965568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-169790c8-ad55-48a5-9b40-9da0de93098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:50.051407 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2664f3-7bfb-40c9-81b6-3f018fdc093e service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:50.070606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5b726-28df-4240-985e-cdb955669f29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:50.078519 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5b726-28df-4240-985e-cdb955669f29 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:50.079254 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5b726-28df-4240-985e-cdb955669f29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:50.080343 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5b726-28df-4240-985e-cdb955669f29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:50.128357 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 804/1619] 10.222.0.49 () {58 vars in 1058 bytes} [Wed May 18 17:05:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:50.131697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4619d5f-2247-4d99-9c66-6a839b0c5474 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:50.131970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4619d5f-2247-4d99-9c66-6a839b0c5474 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:50.132925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4619d5f-2247-4d99-9c66-6a839b0c5474 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:50.136713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 805/1620] 10.222.0.49 () {54 vars in 961 bytes} [Wed May 18 17:05:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:05:50.141191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4619d5f-2247-4d99-9c66-6a839b0c5474 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:50.177142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4619d5f-2247-4d99-9c66-6a839b0c5474 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:50.190287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade65d96-9a1c-48da-8162-a02918103be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:50.192101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade65d96-9a1c-48da-8162-a02918103be6 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:50.192408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade65d96-9a1c-48da-8162-a02918103be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:50.192750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade65d96-9a1c-48da-8162-a02918103be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:50.193834 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade65d96-9a1c-48da-8162-a02918103be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:50.196328 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade65d96-9a1c-48da-8162-a02918103be6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:50.228299 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 806/1621] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:50.230416 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade65d96-9a1c-48da-8162-a02918103be6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:50.244043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5b726-28df-4240-985e-cdb955669f29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:50.247537 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5b726-28df-4240-985e-cdb955669f29 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:50.266165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade65d96-9a1c-48da-8162-a02918103be6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:50.267455 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 816/1622] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:05:49 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:05:50.269486 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec0b2a-1f43-4558-b7d6-23551b5eb032 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:50.269979 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec0b2a-1f43-4558-b7d6-23551b5eb032 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:50.270491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec0b2a-1f43-4558-b7d6-23551b5eb032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:50.281908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248788c-a1f7-4ebf-b1d0-3ab03b7578c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:50.284055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248788c-a1f7-4ebf-b1d0-3ab03b7578c0 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:50.284398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248788c-a1f7-4ebf-b1d0-3ab03b7578c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:50.284690 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248788c-a1f7-4ebf-b1d0-3ab03b7578c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:50.298049 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-17ec0b2a-1f43-4558-b7d6-23551b5eb032 None None] MFA Rules not processed for user `c9e3c0ef5ed943d183b064f383fc01f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:50.300460 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-17ec0b2a-1f43-4558-b7d6-23551b5eb032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:50.332425 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 817/1623] 10.222.0.49 () {58 vars in 1058 bytes} [Wed May 18 17:05:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:50.333356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec0b2a-1f43-4558-b7d6-23551b5eb032 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:50.360508 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec0b2a-1f43-4558-b7d6-23551b5eb032 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:50.394656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:50.401844 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9faf0-c021-4708-89bd-a960f7404c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:50.404491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9faf0-c021-4708-89bd-a960f7404c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:50.405234 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9faf0-c021-4708-89bd-a960f7404c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:50.407092 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9faf0-c021-4708-89bd-a960f7404c81 admin admin] PATH_INFO: `/v3/projects/b0ae1e5cbee0468593fef691fdf3da5f/users/57fdbbb2f89c46008bc761670580a105/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:50.446038 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9faf0-c021-4708-89bd-a960f7404c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ae1e5cbee0468593fef691fdf3da5f, user_id=57fdbbb2f89c46008bc761670580a105, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:50.453650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9faf0-c021-4708-89bd-a960f7404c81 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:50.461191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248788c-a1f7-4ebf-b1d0-3ab03b7578c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:50.467205 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248788c-a1f7-4ebf-b1d0-3ab03b7578c0 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:50.494830 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 807/1624] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:05:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:05:50.495805 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248788c-a1f7-4ebf-b1d0-3ab03b7578c0 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:50.505857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 818/1625] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:05:50 2022] PUT /identity/v3/projects/b0ae1e5cbee0468593fef691fdf3da5f/users/57fdbbb2f89c46008bc761670580a105/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:05:50.510640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9faf0-c021-4708-89bd-a960f7404c81 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:50.525624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248788c-a1f7-4ebf-b1d0-3ab03b7578c0 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:50.697573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315bd6d-335a-407e-993f-a029627bb4f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:50.698668 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315bd6d-335a-407e-993f-a029627bb4f2 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:50.699225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315bd6d-335a-407e-993f-a029627bb4f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:50.699980 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315bd6d-335a-407e-993f-a029627bb4f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:50.751376 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:50.834769 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9faf0-c021-4708-89bd-a960f7404c81 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:50.850618 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d585345-62b0-47e1-9107-394e6a1d5e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:50.851324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d585345-62b0-47e1-9107-394e6a1d5e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:50.854220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d585345-62b0-47e1-9107-394e6a1d5e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:50.854682 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d585345-62b0-47e1-9107-394e6a1d5e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:50.858193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d585345-62b0-47e1-9107-394e6a1d5e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:50.862321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d585345-62b0-47e1-9107-394e6a1d5e16 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:50.873816 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315bd6d-335a-407e-993f-a029627bb4f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:50.875462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315bd6d-335a-407e-993f-a029627bb4f2 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:50.894912 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 819/1626] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:50.901251 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d585345-62b0-47e1-9107-394e6a1d5e16 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:50.925866 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 808/1627] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:05:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:05:50.926876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d585345-62b0-47e1-9107-394e6a1d5e16 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:50.942296 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a171a8-ddc6-482e-b103-b8a17e0c6972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:50.943305 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a171a8-ddc6-482e-b103-b8a17e0c6972 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:50.943605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a171a8-ddc6-482e-b103-b8a17e0c6972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:50.943883 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a171a8-ddc6-482e-b103-b8a17e0c6972 admin admin] PATH_INFO: `/v3/projects/b0ae1e5cbee0468593fef691fdf3da5f/users/57fdbbb2f89c46008bc761670580a105/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:50.954631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a171a8-ddc6-482e-b103-b8a17e0c6972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ae1e5cbee0468593fef691fdf3da5f, user_id=57fdbbb2f89c46008bc761670580a105, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:50.968261 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a171a8-ddc6-482e-b103-b8a17e0c6972 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:51.011892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 820/1628] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:05:50 2022] PUT /identity/v3/projects/b0ae1e5cbee0468593fef691fdf3da5f/users/57fdbbb2f89c46008bc761670580a105/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:05:51.012061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037553a-dcc8-40c3-9e50-989dc8f69113 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:51.012852 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037553a-dcc8-40c3-9e50-989dc8f69113 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:51.013298 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037553a-dcc8-40c3-9e50-989dc8f69113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:51.101239 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c037553a-dcc8-40c3-9e50-989dc8f69113 None None] MFA Rules not processed for user `57fdbbb2f89c46008bc761670580a105`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:51.112648 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c037553a-dcc8-40c3-9e50-989dc8f69113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:51.143628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc5ee8-3f72-4820-b062-9ab7621564f5 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:51.144593 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc5ee8-3f72-4820-b062-9ab7621564f5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:51.145067 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc5ee8-3f72-4820-b062-9ab7621564f5 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:51.147582 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 821/1629] 10.222.0.49 () {54 vars in 912 bytes} [Wed May 18 17:05:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:05:51.163419 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584e969-d840-4dda-bc63-b64a3d55217e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:51.163984 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584e969-d840-4dda-bc63-b64a3d55217e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:51.164518 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584e969-d840-4dda-bc63-b64a3d55217e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:51.214562 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-1584e969-d840-4dda-bc63-b64a3d55217e None None] MFA Rules not processed for user `c9e3c0ef5ed943d183b064f383fc01f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:51.219416 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1584e969-d840-4dda-bc63-b64a3d55217e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:51.288564 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:51.317006 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 809/1630] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:51 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:51.334313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037553a-dcc8-40c3-9e50-989dc8f69113 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:51.510744 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 822/1631] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 18 17:05:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:51.548261 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037553a-dcc8-40c3-9e50-989dc8f69113 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:51.555673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41faf9fe-1121-412b-930c-45b55d4c1c38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:51.557674 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41faf9fe-1121-412b-930c-45b55d4c1c38 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:51.558085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41faf9fe-1121-412b-930c-45b55d4c1c38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:51.558521 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41faf9fe-1121-412b-930c-45b55d4c1c38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:51.582831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41faf9fe-1121-412b-930c-45b55d4c1c38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:51.585907 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41faf9fe-1121-412b-930c-45b55d4c1c38 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:51.609747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 810/1632] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:05:51 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:05:51.635479 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584e969-d840-4dda-bc63-b64a3d55217e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:51.657597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baba2c-e9b3-473a-94b7-6b779f9a9df7 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:51.658241 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baba2c-e9b3-473a-94b7-6b779f9a9df7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:51.658747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baba2c-e9b3-473a-94b7-6b779f9a9df7 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:51.671329 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 811/1633] 10.222.0.49 () {54 vars in 912 bytes} [Wed May 18 17:05:51 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:05:51.679216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda246b-f0e0-4e00-8a8d-053712175d97 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:51.679690 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda246b-f0e0-4e00-8a8d-053712175d97 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:51.680145 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda246b-f0e0-4e00-8a8d-053712175d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:51.695045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584e969-d840-4dda-bc63-b64a3d55217e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:51.712298 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3eccbf-845c-419b-8666-8cd547e78e23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:51.713910 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eccbf-845c-419b-8666-8cd547e78e23 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:51.714190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eccbf-845c-419b-8666-8cd547e78e23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:51.714702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eccbf-845c-419b-8666-8cd547e78e23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:51.808449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8eda246b-f0e0-4e00-8a8d-053712175d97 None None] MFA Rules not processed for user `c9e3c0ef5ed943d183b064f383fc01f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:51.811046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8eda246b-f0e0-4e00-8a8d-053712175d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:51.813047 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3eccbf-845c-419b-8666-8cd547e78e23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:51.816097 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3eccbf-845c-419b-8666-8cd547e78e23 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:51.909774 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 812/1634] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 18 17:05:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:51.915733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda246b-f0e0-4e00-8a8d-053712175d97 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:51.936884 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 823/1635] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:05:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:05:51.967003 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda246b-f0e0-4e00-8a8d-053712175d97 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:51.985420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3eccbf-845c-419b-8666-8cd547e78e23 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:52.023236 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3eccbf-845c-419b-8666-8cd547e78e23 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:52.025693 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a566eb-6f84-434e-9c8e-dd43adad8302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:52.026828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a566eb-6f84-434e-9c8e-dd43adad8302 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:52.027331 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a566eb-6f84-434e-9c8e-dd43adad8302 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:52.028012 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a566eb-6f84-434e-9c8e-dd43adad8302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:52.057534 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7f6dd-71d7-4ba1-bdfc-ad65d451b32a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:52.062137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f6dd-71d7-4ba1-bdfc-ad65d451b32a service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:52.062447 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f6dd-71d7-4ba1-bdfc-ad65d451b32a service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:52.064456 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f6dd-71d7-4ba1-bdfc-ad65d451b32a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:52.133548 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7f6dd-71d7-4ba1-bdfc-ad65d451b32a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:52.149321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7f6dd-71d7-4ba1-bdfc-ad65d451b32a service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:52.185504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 824/1636] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:05:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:05:52.225674 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a566eb-6f84-434e-9c8e-dd43adad8302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:52.227192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a566eb-6f84-434e-9c8e-dd43adad8302 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:52.242716 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 813/1637] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:05:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:05:52.885451 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7f6dd-71d7-4ba1-bdfc-ad65d451b32a service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:53.155228 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7f6dd-71d7-4ba1-bdfc-ad65d451b32a service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:53.162161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94607eba-6a41-4c2c-abf6-2fe0a0d5fa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:53.163155 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94607eba-6a41-4c2c-abf6-2fe0a0d5fa5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:53.163440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94607eba-6a41-4c2c-abf6-2fe0a0d5fa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:53.163719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94607eba-6a41-4c2c-abf6-2fe0a0d5fa5c admin admin] PATH_INFO: `/v3/users/8ce65ea6e70145af9ef012219f753b53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:53.169796 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94607eba-6a41-4c2c-abf6-2fe0a0d5fa5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ce65ea6e70145af9ef012219f753b53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:53.171035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: WARNING py.warnings [None req-94607eba-6a41-4c2c-abf6-2fe0a0d5fa5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 17:05:53.171035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: warnings.warn(msg) May 18 17:05:53.171035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: May 18 17:05:53.172414 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94607eba-6a41-4c2c-abf6-2fe0a0d5fa5c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:53.213747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98fa1d-ef3b-4fa3-a6e8-7c0790f595b0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:53.215558 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98fa1d-ef3b-4fa3-a6e8-7c0790f595b0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:53.216193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98fa1d-ef3b-4fa3-a6e8-7c0790f595b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:53.277894 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:53.287405 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4e98fa1d-ef3b-4fa3-a6e8-7c0790f595b0 None None] MFA Rules not processed for user `69ca0baaf3854917bf6fc02883b0b949`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:53.296494 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4e98fa1d-ef3b-4fa3-a6e8-7c0790f595b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:53.325289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-94607eba-6a41-4c2c-abf6-2fe0a0d5fa5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ce65ea6e70145af9ef012219f753b53'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:05:53.377159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-94607eba-6a41-4c2c-abf6-2fe0a0d5fa5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ce65ea6e70145af9ef012219f753b53'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:05:53.430872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-94607eba-6a41-4c2c-abf6-2fe0a0d5fa5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ce65ea6e70145af9ef012219f753b53'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:05:53.431671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-94607eba-6a41-4c2c-abf6-2fe0a0d5fa5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ce65ea6e70145af9ef012219f753b53'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:05:53.438107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-94607eba-6a41-4c2c-abf6-2fe0a0d5fa5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ce65ea6e70145af9ef012219f753b53'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:05:53.458268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 825/1638] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:05:52 2022] DELETE /identity/v3/users/8ce65ea6e70145af9ef012219f753b53 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:05:53.463201 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad82c6-6a08-4a22-a809-fbfb65149e9f None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:53.463456 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad82c6-6a08-4a22-a809-fbfb65149e9f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:53.463737 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad82c6-6a08-4a22-a809-fbfb65149e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:53.511016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2cad82c6-6a08-4a22-a809-fbfb65149e9f None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:53.513429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2cad82c6-6a08-4a22-a809-fbfb65149e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:53.532091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 814/1639] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:53.548407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548f142-f55e-4ee5-80dd-75a22fd00664 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:53.548842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548f142-f55e-4ee5-80dd-75a22fd00664 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:53.549486 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548f142-f55e-4ee5-80dd-75a22fd00664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:53.613736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4548f142-f55e-4ee5-80dd-75a22fd00664 None None] MFA Rules not processed for user `69ca0baaf3854917bf6fc02883b0b949`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:53.622774 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4548f142-f55e-4ee5-80dd-75a22fd00664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:53.652762 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 826/1640] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:53.697919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:53.769753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad82c6-6a08-4a22-a809-fbfb65149e9f None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:53.773844 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2cad82c6-6a08-4a22-a809-fbfb65149e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:53.780614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 815/1641] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:53.794540 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548f142-f55e-4ee5-80dd-75a22fd00664 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:53.796545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4548f142-f55e-4ee5-80dd-75a22fd00664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:53.995890 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad82c6-6a08-4a22-a809-fbfb65149e9f None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:54.014271 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17f8e8-21ac-46aa-aa95-4df0150beb4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:54.015243 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17f8e8-21ac-46aa-aa95-4df0150beb4b service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:54.015535 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17f8e8-21ac-46aa-aa95-4df0150beb4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:54.015815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17f8e8-21ac-46aa-aa95-4df0150beb4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:54.083677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17f8e8-21ac-46aa-aa95-4df0150beb4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:54.085167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17f8e8-21ac-46aa-aa95-4df0150beb4b service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:54.117075 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 827/1642] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:05:54.136417 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548f142-f55e-4ee5-80dd-75a22fd00664 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:54.159156 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aecc191-d705-4342-83d6-52e5fd79127b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:54.160281 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecc191-d705-4342-83d6-52e5fd79127b service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:54.166626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecc191-d705-4342-83d6-52e5fd79127b service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:54.167062 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecc191-d705-4342-83d6-52e5fd79127b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:54.215166 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aecc191-d705-4342-83d6-52e5fd79127b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:54.222924 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aecc191-d705-4342-83d6-52e5fd79127b service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:54.249325 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 816/1643] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:05:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:05:55.606937 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cb876-5683-4ef7-83a0-c30f8b156590 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:55.607965 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cb876-5683-4ef7-83a0-c30f8b156590 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:55.608247 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cb876-5683-4ef7-83a0-c30f8b156590 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:55.610646 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 828/1644] 10.222.0.49 () {54 vars in 912 bytes} [Wed May 18 17:05:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:05:55.617704 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919be369-98b1-4047-aba9-01c6890176f1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:55.618166 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919be369-98b1-4047-aba9-01c6890176f1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:55.618605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919be369-98b1-4047-aba9-01c6890176f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:55.714978 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-919be369-98b1-4047-aba9-01c6890176f1 None None] MFA Rules not processed for user `d35f21c5cc7c433882eb5fbe9a8072f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:55.719235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-919be369-98b1-4047-aba9-01c6890176f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:55.737724 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 817/1645] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 18 17:05:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:55.788719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cb876-5683-4ef7-83a0-c30f8b156590 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:55.794404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-897cb876-5683-4ef7-83a0-c30f8b156590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:55.841090 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cb876-5683-4ef7-83a0-c30f8b156590 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:55.858100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bbae2-6708-4810-bb00-7f44b3edd8b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:55.858840 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bbae2-6708-4810-bb00-7f44b3edd8b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:55.859134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bbae2-6708-4810-bb00-7f44b3edd8b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:55.859419 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bbae2-6708-4810-bb00-7f44b3edd8b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:55.916872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bbae2-6708-4810-bb00-7f44b3edd8b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:55.932663 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2bbae2-6708-4810-bb00-7f44b3edd8b0 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:55.982276 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 829/1646] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:05:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:05:56.078528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919be369-98b1-4047-aba9-01c6890176f1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:56.081066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-919be369-98b1-4047-aba9-01c6890176f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:56.118330 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919be369-98b1-4047-aba9-01c6890176f1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:56.134528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a23fd-acbb-4148-81e1-425dbf0b211a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:56.135873 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a23fd-acbb-4148-81e1-425dbf0b211a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:56.135873 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a23fd-acbb-4148-81e1-425dbf0b211a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:56.136038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a23fd-acbb-4148-81e1-425dbf0b211a admin admin] PATH_INFO: `/v3/projects/0b3e1f13b2444681a0a32ac3810b7876` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:56.142769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a23fd-acbb-4148-81e1-425dbf0b211a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3e1f13b2444681a0a32ac3810b7876)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:56.144264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: WARNING py.warnings [None req-264a23fd-acbb-4148-81e1-425dbf0b211a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 18 17:05:56.144264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: warnings.warn(msg) May 18 17:05:56.144264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: May 18 17:05:56.145303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a23fd-acbb-4148-81e1-425dbf0b211a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:56.314590 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-264a23fd-acbb-4148-81e1-425dbf0b211a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3e1f13b2444681a0a32ac3810b7876', 'request_id': 'req-264a23fd-acbb-4148-81e1-425dbf0b211a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:05:56.328669 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-264a23fd-acbb-4148-81e1-425dbf0b211a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3e1f13b2444681a0a32ac3810b7876', 'request_id': 'req-264a23fd-acbb-4148-81e1-425dbf0b211a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:05:56.365441 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-264a23fd-acbb-4148-81e1-425dbf0b211a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3e1f13b2444681a0a32ac3810b7876', 'request_id': 'req-264a23fd-acbb-4148-81e1-425dbf0b211a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:05:56.404404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-264a23fd-acbb-4148-81e1-425dbf0b211a admin admin] The token cache is being invalidate because project 0b3e1f13b2444681a0a32ac3810b7876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:05:56.404712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-264a23fd-acbb-4148-81e1-425dbf0b211a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:05:56.405551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-264a23fd-acbb-4148-81e1-425dbf0b211a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:05:56.408112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 818/1647] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:05:56 2022] DELETE /identity/v3/projects/0b3e1f13b2444681a0a32ac3810b7876 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:05:56.413773 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885459-2f42-46c9-a388-e5d1e77aae6d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:56.414633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885459-2f42-46c9-a388-e5d1e77aae6d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:56.415127 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03885459-2f42-46c9-a388-e5d1e77aae6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:56.443655 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-03885459-2f42-46c9-a388-e5d1e77aae6d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:56.445733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-03885459-2f42-46c9-a388-e5d1e77aae6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:56.509323 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:56.593958 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 830/1648] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:56.595224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b98d62-d185-4b90-898c-f499c3044267 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:56.595697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b98d62-d185-4b90-898c-f499c3044267 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:56.596434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b98d62-d185-4b90-898c-f499c3044267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:56.644846 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-18b98d62-d185-4b90-898c-f499c3044267 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:56.648772 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-18b98d62-d185-4b90-898c-f499c3044267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:56.664769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 819/1649] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:56.670729 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03885459-2f42-46c9-a388-e5d1e77aae6d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:56.695428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03885459-2f42-46c9-a388-e5d1e77aae6d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:56.734821 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145328d-8282-4870-af7a-6d33e7bbe6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:56.735513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145328d-8282-4870-af7a-6d33e7bbe6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:56.736099 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145328d-8282-4870-af7a-6d33e7bbe6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:56.736633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145328d-8282-4870-af7a-6d33e7bbe6b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:56.737908 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145328d-8282-4870-af7a-6d33e7bbe6b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:05:56.738411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145328d-8282-4870-af7a-6d33e7bbe6b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:56.742630 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145328d-8282-4870-af7a-6d33e7bbe6b0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:56.777030 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 831/1650] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:05:56.782375 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b98d62-d185-4b90-898c-f499c3044267 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:56.800170 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b98d62-d185-4b90-898c-f499c3044267 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:56.819699 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d245628-dd3c-4fc8-b00a-131b97d3dfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:56.820389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d245628-dd3c-4fc8-b00a-131b97d3dfb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:56.820673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d245628-dd3c-4fc8-b00a-131b97d3dfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:56.820950 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d245628-dd3c-4fc8-b00a-131b97d3dfb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:56.822565 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d245628-dd3c-4fc8-b00a-131b97d3dfb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:56.824550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d245628-dd3c-4fc8-b00a-131b97d3dfb2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:56.842989 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:56.893717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145328d-8282-4870-af7a-6d33e7bbe6b0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:56.895145 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 820/1651] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:05:56 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:56.907693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145328d-8282-4870-af7a-6d33e7bbe6b0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:57.039137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819d953-c271-4a19-8e62-cbc11b9ea143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:57.040951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819d953-c271-4a19-8e62-cbc11b9ea143 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:57.041430 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819d953-c271-4a19-8e62-cbc11b9ea143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:57.041885 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819d953-c271-4a19-8e62-cbc11b9ea143 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:57.044243 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819d953-c271-4a19-8e62-cbc11b9ea143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:57.047379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c819d953-c271-4a19-8e62-cbc11b9ea143 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:57.098045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 832/1652] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:05:56 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:05:57.102387 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d245628-dd3c-4fc8-b00a-131b97d3dfb2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:57.117399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d245628-dd3c-4fc8-b00a-131b97d3dfb2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:57.124302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102c91a-01d4-465b-a8f0-6976f739c27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:57.125602 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102c91a-01d4-465b-a8f0-6976f739c27b admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:57.126089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102c91a-01d4-465b-a8f0-6976f739c27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:57.126555 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102c91a-01d4-465b-a8f0-6976f739c27b admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:57.129540 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102c91a-01d4-465b-a8f0-6976f739c27b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:57.131649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102c91a-01d4-465b-a8f0-6976f739c27b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:57.155305 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 821/1653] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:57.160417 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819d953-c271-4a19-8e62-cbc11b9ea143 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:57.174510 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819d953-c271-4a19-8e62-cbc11b9ea143 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:57.187718 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f0982-bb73-419f-9a16-6bd9d20df15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:57.188723 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f0982-bb73-419f-9a16-6bd9d20df15a admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:57.191540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f0982-bb73-419f-9a16-6bd9d20df15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:57.192123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f0982-bb73-419f-9a16-6bd9d20df15a admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:57.193113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f0982-bb73-419f-9a16-6bd9d20df15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:57.195277 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f0982-bb73-419f-9a16-6bd9d20df15a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:57.234887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102c91a-01d4-465b-a8f0-6976f739c27b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:57.253689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102c91a-01d4-465b-a8f0-6976f739c27b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:57.254471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 833/1654] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:57.281959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83423a6b-5ad7-456b-b403-421ef74fb238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:57.283314 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83423a6b-5ad7-456b-b403-421ef74fb238 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:57.283833 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83423a6b-5ad7-456b-b403-421ef74fb238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:57.284319 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83423a6b-5ad7-456b-b403-421ef74fb238 admin admin] PATH_INFO: `/v3/projects/31a4c1f456fd4b689c6c7fad2cbdaadf/users/705e598070ce47c8bd6c10f999394d77/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:57.305261 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83423a6b-5ad7-456b-b403-421ef74fb238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a4c1f456fd4b689c6c7fad2cbdaadf, user_id=705e598070ce47c8bd6c10f999394d77, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:57.311255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83423a6b-5ad7-456b-b403-421ef74fb238 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:57.344439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 822/1655] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:05:57 2022] PUT /identity/v3/projects/31a4c1f456fd4b689c6c7fad2cbdaadf/users/705e598070ce47c8bd6c10f999394d77/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:05:57.361748 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee57df6-0c8f-4c44-8d36-0a051a1f49f5 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:57.362057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee57df6-0c8f-4c44-8d36-0a051a1f49f5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:57.362347 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee57df6-0c8f-4c44-8d36-0a051a1f49f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:57.423679 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-aee57df6-0c8f-4c44-8d36-0a051a1f49f5 None None] MFA Rules not processed for user `705e598070ce47c8bd6c10f999394d77`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:57.425878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-aee57df6-0c8f-4c44-8d36-0a051a1f49f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:57.507057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c0354-3b24-4685-886a-b3b2f9fbe871 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:57.507351 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c0354-3b24-4685-886a-b3b2f9fbe871 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:57.507637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c0354-3b24-4685-886a-b3b2f9fbe871 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:57.509296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 823/1656] 10.222.0.49 () {54 vars in 960 bytes} [Wed May 18 17:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:05:57.516019 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588a446-ccdb-4229-b4af-3cb0433a9b66 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:57.516543 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588a446-ccdb-4229-b4af-3cb0433a9b66 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:57.516825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588a446-ccdb-4229-b4af-3cb0433a9b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:57.585472 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2588a446-ccdb-4229-b4af-3cb0433a9b66 None None] MFA Rules not processed for user `bebc8414d01a40c8ab34afa9b1312a59`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:57.591444 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2588a446-ccdb-4229-b4af-3cb0433a9b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:57.732138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 834/1657] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:57.733161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee57df6-0c8f-4c44-8d36-0a051a1f49f5 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:57.742302 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-aee57df6-0c8f-4c44-8d36-0a051a1f49f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:57.808127 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:57.837397 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 824/1658] 10.222.0.49 () {58 vars in 1057 bytes} [Wed May 18 17:05:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:57.840078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588a446-ccdb-4229-b4af-3cb0433a9b66 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:57.889466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee57df6-0c8f-4c44-8d36-0a051a1f49f5 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:57.906731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f12d55-8364-4216-98a3-fd1319d0d32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:57.907652 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f12d55-8364-4216-98a3-fd1319d0d32a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:57.907939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f12d55-8364-4216-98a3-fd1319d0d32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:57.908220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f12d55-8364-4216-98a3-fd1319d0d32a admin admin] PATH_INFO: `/v3/users/59c033bb26aa457eae960dbd1aee7b81` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:57.910477 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f12d55-8364-4216-98a3-fd1319d0d32a admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c033bb26aa457eae960dbd1aee7b81)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:57.912507 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f12d55-8364-4216-98a3-fd1319d0d32a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:57.998884 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588a446-ccdb-4229-b4af-3cb0433a9b66 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:58.003867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b3f12d55-8364-4216-98a3-fd1319d0d32a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c033bb26aa457eae960dbd1aee7b81'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:05:58.008838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380a892-c443-4fbe-8f56-e0edc4717227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:58.009593 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a892-c443-4fbe-8f56-e0edc4717227 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:58.009900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a892-c443-4fbe-8f56-e0edc4717227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:58.010172 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a892-c443-4fbe-8f56-e0edc4717227 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:58.010880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380a892-c443-4fbe-8f56-e0edc4717227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:58.013621 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380a892-c443-4fbe-8f56-e0edc4717227 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:58.014062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b3f12d55-8364-4216-98a3-fd1319d0d32a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c033bb26aa457eae960dbd1aee7b81'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:05:58.049356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b3f12d55-8364-4216-98a3-fd1319d0d32a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c033bb26aa457eae960dbd1aee7b81'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:05:58.050397 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b3f12d55-8364-4216-98a3-fd1319d0d32a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c033bb26aa457eae960dbd1aee7b81'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:05:58.051778 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b3f12d55-8364-4216-98a3-fd1319d0d32a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c033bb26aa457eae960dbd1aee7b81'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:05:58.073647 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 825/1659] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:05:57 2022] POST /identity/v3/projects => generated 371 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:58.077766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380a892-c443-4fbe-8f56-e0edc4717227 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:58.085338 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3380a892-c443-4fbe-8f56-e0edc4717227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:58.093930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 835/1660] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:05:57 2022] DELETE /identity/v3/users/59c033bb26aa457eae960dbd1aee7b81 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:05:58.096159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f12d55-8364-4216-98a3-fd1319d0d32a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:58.100229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b3f12d55-8364-4216-98a3-fd1319d0d32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:58.174134 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:58.238736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380a892-c443-4fbe-8f56-e0edc4717227 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:58.243336 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f12d55-8364-4216-98a3-fd1319d0d32a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:58.250791 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886084d-6637-40a1-8dbd-77eaab812a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:58.251873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886084d-6637-40a1-8dbd-77eaab812a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:58.252378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886084d-6637-40a1-8dbd-77eaab812a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:58.252898 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886084d-6637-40a1-8dbd-77eaab812a0a admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:58.254035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886084d-6637-40a1-8dbd-77eaab812a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:58.256500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886084d-6637-40a1-8dbd-77eaab812a0a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:58.297861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 836/1661] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:05:58 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:05:58.303987 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a5038-31ee-4484-8a66-ad0a45708e62 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:58.306700 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a5038-31ee-4484-8a66-ad0a45708e62 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:58.308431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a5038-31ee-4484-8a66-ad0a45708e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:58.335660 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729baea4-5088-4c9f-8d99-69a75ac509c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bebc8414d01a40c8ab34afa9b1312a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:58.336363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729baea4-5088-4c9f-8d99-69a75ac509c5 service placement] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:58.339208 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729baea4-5088-4c9f-8d99-69a75ac509c5 service placement] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:58.339208 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729baea4-5088-4c9f-8d99-69a75ac509c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:58.345364 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-729baea4-5088-4c9f-8d99-69a75ac509c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:58.361330 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729baea4-5088-4c9f-8d99-69a75ac509c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:58.363191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729baea4-5088-4c9f-8d99-69a75ac509c5 service placement] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:58.380098 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-310a5038-31ee-4484-8a66-ad0a45708e62 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:58.385134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-310a5038-31ee-4484-8a66-ad0a45708e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:58.386623 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 826/1662] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:05:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:05:58.395816 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729baea4-5088-4c9f-8d99-69a75ac509c5 service placement] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:58.412285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 837/1663] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:58.424515 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729baea4-5088-4c9f-8d99-69a75ac509c5 service placement] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:58.441291 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e27bc-f901-48c4-8581-7428f9d74f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:58.442015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e27bc-f901-48c4-8581-7428f9d74f8f admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:58.442312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e27bc-f901-48c4-8581-7428f9d74f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:58.442597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e27bc-f901-48c4-8581-7428f9d74f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:58.443387 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e27bc-f901-48c4-8581-7428f9d74f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:58.445164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e27bc-f901-48c4-8581-7428f9d74f8f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:58.452390 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a5038-31ee-4484-8a66-ad0a45708e62 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:58.454984 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-310a5038-31ee-4484-8a66-ad0a45708e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:58.477286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 827/1664] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:05:58.482230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e27bc-f901-48c4-8581-7428f9d74f8f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:58.503148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e27bc-f901-48c4-8581-7428f9d74f8f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:58.519687 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efade7bf-b9ff-4bfc-8d8e-150e1ba44e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:58.520653 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efade7bf-b9ff-4bfc-8d8e-150e1ba44e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:58.520937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efade7bf-b9ff-4bfc-8d8e-150e1ba44e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:58.523615 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efade7bf-b9ff-4bfc-8d8e-150e1ba44e37 admin admin] PATH_INFO: `/v3/projects/c69c6fb2df7e4a33b360c07f8f80ea3b/users/fbd6309a803248e8ad3a9050eb771774/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:58.550869 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:58.556943 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efade7bf-b9ff-4bfc-8d8e-150e1ba44e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69c6fb2df7e4a33b360c07f8f80ea3b, user_id=fbd6309a803248e8ad3a9050eb771774, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:58.562758 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efade7bf-b9ff-4bfc-8d8e-150e1ba44e37 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:58.591162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 828/1665] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:05:58 2022] PUT /identity/v3/projects/c69c6fb2df7e4a33b360c07f8f80ea3b/users/fbd6309a803248e8ad3a9050eb771774/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:05:58.594512 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efade7bf-b9ff-4bfc-8d8e-150e1ba44e37 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:58.619734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a5038-31ee-4484-8a66-ad0a45708e62 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:58.678368 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efade7bf-b9ff-4bfc-8d8e-150e1ba44e37 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:58.689964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959213c7-f27a-4ba9-950d-00ca8758eb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:58.689964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959213c7-f27a-4ba9-950d-00ca8758eb72 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:58.690336 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959213c7-f27a-4ba9-950d-00ca8758eb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:58.690656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959213c7-f27a-4ba9-950d-00ca8758eb72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:58.691410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959213c7-f27a-4ba9-950d-00ca8758eb72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:58.696422 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959213c7-f27a-4ba9-950d-00ca8758eb72 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:58.710995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 829/1666] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:05:58.714982 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959213c7-f27a-4ba9-950d-00ca8758eb72 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:58.742318 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959213c7-f27a-4ba9-950d-00ca8758eb72 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:58.749430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2185e7-d9ba-4930-9f27-983606c761e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:58.750693 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2185e7-d9ba-4930-9f27-983606c761e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:58.751080 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2185e7-d9ba-4930-9f27-983606c761e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:58.751460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2185e7-d9ba-4930-9f27-983606c761e0 admin admin] PATH_INFO: `/v3/projects/c69c6fb2df7e4a33b360c07f8f80ea3b/users/fbd6309a803248e8ad3a9050eb771774/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:58.755869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2185e7-d9ba-4930-9f27-983606c761e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69c6fb2df7e4a33b360c07f8f80ea3b, user_id=fbd6309a803248e8ad3a9050eb771774, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:58.764336 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2469b-d116-43c6-9c67-6b2ed8e1e77b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:58.766200 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2469b-d116-43c6-9c67-6b2ed8e1e77b service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:58.766838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2469b-d116-43c6-9c67-6b2ed8e1e77b service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:58.767288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2469b-d116-43c6-9c67-6b2ed8e1e77b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:58.773833 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2185e7-d9ba-4930-9f27-983606c761e0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:58.783977 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2469b-d116-43c6-9c67-6b2ed8e1e77b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:58.785528 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2469b-d116-43c6-9c67-6b2ed8e1e77b service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:58.807603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 838/1667] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:05:58.821423 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 830/1668] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:05:58 2022] PUT /identity/v3/projects/c69c6fb2df7e4a33b360c07f8f80ea3b/users/fbd6309a803248e8ad3a9050eb771774/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:05:58.833349 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc03af5-e3e5-4542-b196-de44f8a0fe24 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:58.833678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc03af5-e3e5-4542-b196-de44f8a0fe24 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:58.833967 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc03af5-e3e5-4542-b196-de44f8a0fe24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:58.898273 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5bc03af5-e3e5-4542-b196-de44f8a0fe24 None None] MFA Rules not processed for user `fbd6309a803248e8ad3a9050eb771774`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:05:58.899708 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5bc03af5-e3e5-4542-b196-de44f8a0fe24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:59.145234 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 839/1669] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:05:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:05:59.156252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2185e7-d9ba-4930-9f27-983606c761e0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:05:59.160238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ea2185e7-d9ba-4930-9f27-983606c761e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:05:59.204101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:59.272184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2185e7-d9ba-4930-9f27-983606c761e0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:05:59.281609 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e33fc-d0ed-44c9-b97d-1c5f43bf266c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:05:59.283575 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e33fc-d0ed-44c9-b97d-1c5f43bf266c service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:05:59.284098 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e33fc-d0ed-44c9-b97d-1c5f43bf266c service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:05:59.286136 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e33fc-d0ed-44c9-b97d-1c5f43bf266c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:05:59.306532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e33fc-d0ed-44c9-b97d-1c5f43bf266c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:05:59.308542 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e33fc-d0ed-44c9-b97d-1c5f43bf266c service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:05:59.329704 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 831/1670] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:05:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:00.131739 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc03af5-e3e5-4542-b196-de44f8a0fe24 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:00.306325 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc03af5-e3e5-4542-b196-de44f8a0fe24 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:00.318453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20db1c3-d5da-4316-8c6a-6fc25b7ca763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:00.320858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20db1c3-d5da-4316-8c6a-6fc25b7ca763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:00.321675 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20db1c3-d5da-4316-8c6a-6fc25b7ca763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:00.322862 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20db1c3-d5da-4316-8c6a-6fc25b7ca763 admin admin] PATH_INFO: `/v3/users/705e598070ce47c8bd6c10f999394d77` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:00.326711 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20db1c3-d5da-4316-8c6a-6fc25b7ca763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=705e598070ce47c8bd6c10f999394d77)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:00.329180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20db1c3-d5da-4316-8c6a-6fc25b7ca763 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:00.360642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:00.497457 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b20db1c3-d5da-4316-8c6a-6fc25b7ca763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '705e598070ce47c8bd6c10f999394d77'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:00.524609 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b20db1c3-d5da-4316-8c6a-6fc25b7ca763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '705e598070ce47c8bd6c10f999394d77'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:00.572315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b20db1c3-d5da-4316-8c6a-6fc25b7ca763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '705e598070ce47c8bd6c10f999394d77'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:00.573941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b20db1c3-d5da-4316-8c6a-6fc25b7ca763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '705e598070ce47c8bd6c10f999394d77'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:00.577224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b20db1c3-d5da-4316-8c6a-6fc25b7ca763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '705e598070ce47c8bd6c10f999394d77'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:00.586573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e33fc-d0ed-44c9-b97d-1c5f43bf266c service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:00.588698 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-435e33fc-d0ed-44c9-b97d-1c5f43bf266c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:00.623835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 840/1671] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:00 2022] DELETE /identity/v3/users/705e598070ce47c8bd6c10f999394d77 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:00.629419 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f9459-4bc0-41d6-8732-9cc7230a10c0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:00.632200 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e33fc-d0ed-44c9-b97d-1c5f43bf266c service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:00.634005 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f9459-4bc0-41d6-8732-9cc7230a10c0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:00.635184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f9459-4bc0-41d6-8732-9cc7230a10c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:00.690594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-411f9459-4bc0-41d6-8732-9cc7230a10c0 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:00.691807 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-411f9459-4bc0-41d6-8732-9cc7230a10c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:00.787398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46f6fb-40f0-4980-8be4-bf1f2dc4db57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:00.788690 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46f6fb-40f0-4980-8be4-bf1f2dc4db57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:00.789159 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46f6fb-40f0-4980-8be4-bf1f2dc4db57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:00.789605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46f6fb-40f0-4980-8be4-bf1f2dc4db57 admin admin] PATH_INFO: `/v3/projects/091b4f2f90bb45faaac46e59e35dd08b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:00.791313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46f6fb-40f0-4980-8be4-bf1f2dc4db57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=091b4f2f90bb45faaac46e59e35dd08b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:00.799793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46f6fb-40f0-4980-8be4-bf1f2dc4db57 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:00.822177 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 841/1672] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:00.833086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f9459-4bc0-41d6-8732-9cc7230a10c0 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:00.836251 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-411f9459-4bc0-41d6-8732-9cc7230a10c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:00.933453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ce46f6fb-40f0-4980-8be4-bf1f2dc4db57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '091b4f2f90bb45faaac46e59e35dd08b', 'request_id': 'req-ce46f6fb-40f0-4980-8be4-bf1f2dc4db57'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:00.955755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ce46f6fb-40f0-4980-8be4-bf1f2dc4db57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '091b4f2f90bb45faaac46e59e35dd08b', 'request_id': 'req-ce46f6fb-40f0-4980-8be4-bf1f2dc4db57'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:00.961754 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ce46f6fb-40f0-4980-8be4-bf1f2dc4db57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '091b4f2f90bb45faaac46e59e35dd08b', 'request_id': 'req-ce46f6fb-40f0-4980-8be4-bf1f2dc4db57'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:00.986734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ce46f6fb-40f0-4980-8be4-bf1f2dc4db57 admin admin] The token cache is being invalidate because project 091b4f2f90bb45faaac46e59e35dd08b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:00.987185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ce46f6fb-40f0-4980-8be4-bf1f2dc4db57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:00.994597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ce46f6fb-40f0-4980-8be4-bf1f2dc4db57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:00.995888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 832/1673] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:00 2022] DELETE /identity/v3/projects/091b4f2f90bb45faaac46e59e35dd08b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:06:01.001630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fbea7-bc43-424f-a50a-0ef0e8cc70e5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:01.001955 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fbea7-bc43-424f-a50a-0ef0e8cc70e5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:01.002762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fbea7-bc43-424f-a50a-0ef0e8cc70e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:01.035269 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f9459-4bc0-41d6-8732-9cc7230a10c0 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:01.047813 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7e3fbea7-bc43-424f-a50a-0ef0e8cc70e5 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:01.049338 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7e3fbea7-bc43-424f-a50a-0ef0e8cc70e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:01.150918 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:01.151328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbb8c6-d6c9-40c7-a60b-80286523a802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:01.152576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbb8c6-d6c9-40c7-a60b-80286523a802 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:01.154317 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbb8c6-d6c9-40c7-a60b-80286523a802 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:01.154778 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbb8c6-d6c9-40c7-a60b-80286523a802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:01.158406 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-33bbb8c6-d6c9-40c7-a60b-80286523a802 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:01.174765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:01.189955 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 833/1674] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:01.191671 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905e871-73e8-44d2-8681-96d73e947003 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:01.192149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905e871-73e8-44d2-8681-96d73e947003 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:01.192664 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905e871-73e8-44d2-8681-96d73e947003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:01.226852 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3905e871-73e8-44d2-8681-96d73e947003 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:01.230451 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3905e871-73e8-44d2-8681-96d73e947003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:01.258912 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 834/1675] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:01.272323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905e871-73e8-44d2-8681-96d73e947003 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:01.296124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905e871-73e8-44d2-8681-96d73e947003 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:01.314439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bcb44-1737-49a1-b3b8-a7ba7c5c2506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:01.315251 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bcb44-1737-49a1-b3b8-a7ba7c5c2506 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:01.316567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bcb44-1737-49a1-b3b8-a7ba7c5c2506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:01.317041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bcb44-1737-49a1-b3b8-a7ba7c5c2506 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:01.318007 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bcb44-1737-49a1-b3b8-a7ba7c5c2506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:06:01.318396 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bcb44-1737-49a1-b3b8-a7ba7c5c2506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:01.320480 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bcb44-1737-49a1-b3b8-a7ba7c5c2506 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:01.336353 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 835/1676] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:06:01.342130 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bcb44-1737-49a1-b3b8-a7ba7c5c2506 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:01.366723 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbb8c6-d6c9-40c7-a60b-80286523a802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:01.368248 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bcb44-1737-49a1-b3b8-a7ba7c5c2506 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:01.369879 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbb8c6-d6c9-40c7-a60b-80286523a802 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:01.375152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba2022-64b9-41b9-838f-8118c5f43749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:01.375561 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba2022-64b9-41b9-838f-8118c5f43749 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:01.375844 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba2022-64b9-41b9-838f-8118c5f43749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:01.376118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba2022-64b9-41b9-838f-8118c5f43749 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:01.376888 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba2022-64b9-41b9-838f-8118c5f43749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:01.379047 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba2022-64b9-41b9-838f-8118c5f43749 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:01.404324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 842/1677] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:01.433316 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 836/1678] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:01 2022] POST /identity/v3/projects => generated 355 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:01.438615 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbb8c6-d6c9-40c7-a60b-80286523a802 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:01.453582 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbb8c6-d6c9-40c7-a60b-80286523a802 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:01.624393 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf1917-7347-490e-ae96-3fcfbb91d992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:01.625111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf1917-7347-490e-ae96-3fcfbb91d992 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:01.625394 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf1917-7347-490e-ae96-3fcfbb91d992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:01.625867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf1917-7347-490e-ae96-3fcfbb91d992 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:01.626587 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf1917-7347-490e-ae96-3fcfbb91d992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:01.629130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf1917-7347-490e-ae96-3fcfbb91d992 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:01.711147 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 843/1679] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:01 2022] POST /identity/v3/users => generated 278 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:01.712404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba2022-64b9-41b9-838f-8118c5f43749 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:01.742157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba2022-64b9-41b9-838f-8118c5f43749 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:01.756526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30aabd-c72b-4115-9ca2-be1bddcf09a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:01.772659 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30aabd-c72b-4115-9ca2-be1bddcf09a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:01.772947 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30aabd-c72b-4115-9ca2-be1bddcf09a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:01.773216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30aabd-c72b-4115-9ca2-be1bddcf09a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:01.776665 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30aabd-c72b-4115-9ca2-be1bddcf09a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:01.782389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30aabd-c72b-4115-9ca2-be1bddcf09a4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:01.797384 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66677e4d-b53c-44ec-b07e-ee94b6cc0e07 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:01.797982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66677e4d-b53c-44ec-b07e-ee94b6cc0e07 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:01.798529 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66677e4d-b53c-44ec-b07e-ee94b6cc0e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:01.824662 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 837/1680] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:01.828555 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30aabd-c72b-4115-9ca2-be1bddcf09a4 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:01.865113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-66677e4d-b53c-44ec-b07e-ee94b6cc0e07 None None] MFA Rules not processed for user `01881ccdf756480b8fcc1ac599fdf905`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:01.866772 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-66677e4d-b53c-44ec-b07e-ee94b6cc0e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:01.871328 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30aabd-c72b-4115-9ca2-be1bddcf09a4 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:01.904951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5d739-75a6-4aff-aa4f-32dad48b6e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:01.909255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5d739-75a6-4aff-aa4f-32dad48b6e2e admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:01.909715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5d739-75a6-4aff-aa4f-32dad48b6e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:01.911022 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5d739-75a6-4aff-aa4f-32dad48b6e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:01.911948 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5d739-75a6-4aff-aa4f-32dad48b6e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:01.920107 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5d739-75a6-4aff-aa4f-32dad48b6e2e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:01.947193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 838/1681] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:01.948359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5d739-75a6-4aff-aa4f-32dad48b6e2e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:01.960537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5d739-75a6-4aff-aa4f-32dad48b6e2e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:01.968266 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749ea65-01c2-487e-ac2b-f04e1cbb16d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:01.969513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749ea65-01c2-487e-ac2b-f04e1cbb16d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:01.969969 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749ea65-01c2-487e-ac2b-f04e1cbb16d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:01.970477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749ea65-01c2-487e-ac2b-f04e1cbb16d7 admin admin] PATH_INFO: `/v3/projects/358ce588a4a5407e86bf59f775cadc04/users/fbd2c807068742dd96cd60089b570246/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:01.990328 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749ea65-01c2-487e-ac2b-f04e1cbb16d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=358ce588a4a5407e86bf59f775cadc04, user_id=fbd2c807068742dd96cd60089b570246, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:02.009158 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749ea65-01c2-487e-ac2b-f04e1cbb16d7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:02.031563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 844/1682] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:02.048858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66677e4d-b53c-44ec-b07e-ee94b6cc0e07 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:02.050802 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-66677e4d-b53c-44ec-b07e-ee94b6cc0e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:02.053435 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 839/1683] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:01 2022] PUT /identity/v3/projects/358ce588a4a5407e86bf59f775cadc04/users/fbd2c807068742dd96cd60089b570246/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:02.057750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2793fc-fe99-48af-a8f2-f40c205941f8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:02.057750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2793fc-fe99-48af-a8f2-f40c205941f8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:02.057750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2793fc-fe99-48af-a8f2-f40c205941f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:02.120793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:02.131493 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1f2793fc-fe99-48af-a8f2-f40c205941f8 None None] MFA Rules not processed for user `fbd2c807068742dd96cd60089b570246`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:02.135339 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1f2793fc-fe99-48af-a8f2-f40c205941f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:02.263305 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66677e4d-b53c-44ec-b07e-ee94b6cc0e07 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:02.326398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 840/1684] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:02 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:02.327824 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2793fc-fe99-48af-a8f2-f40c205941f8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:02.329650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1f2793fc-fe99-48af-a8f2-f40c205941f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:02.432294 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b09f70-ef56-4139-a939-d2859795cb9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:02.432977 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b09f70-ef56-4139-a939-d2859795cb9d service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:02.435539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b09f70-ef56-4139-a939-d2859795cb9d service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:02.435817 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b09f70-ef56-4139-a939-d2859795cb9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:02.455844 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:02.520128 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2793fc-fe99-48af-a8f2-f40c205941f8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:02.545545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9b27b-00fd-4180-b618-762af5862c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:02.550061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9b27b-00fd-4180-b618-762af5862c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:02.550345 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9b27b-00fd-4180-b618-762af5862c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:02.553543 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9b27b-00fd-4180-b618-762af5862c7b admin admin] PATH_INFO: `/v3/projects/31a4c1f456fd4b689c6c7fad2cbdaadf` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:02.558399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9b27b-00fd-4180-b618-762af5862c7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=31a4c1f456fd4b689c6c7fad2cbdaadf)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:02.560912 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9b27b-00fd-4180-b618-762af5862c7b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:02.587513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b09f70-ef56-4139-a939-d2859795cb9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:02.589845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b09f70-ef56-4139-a939-d2859795cb9d service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:02.613955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 845/1685] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:02.615602 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b09f70-ef56-4139-a939-d2859795cb9d service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:02.656924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b09f70-ef56-4139-a939-d2859795cb9d service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:02.686874 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f6b9b27b-00fd-4180-b618-762af5862c7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31a4c1f456fd4b689c6c7fad2cbdaadf', 'request_id': 'req-f6b9b27b-00fd-4180-b618-762af5862c7b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:02.707992 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f6b9b27b-00fd-4180-b618-762af5862c7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31a4c1f456fd4b689c6c7fad2cbdaadf', 'request_id': 'req-f6b9b27b-00fd-4180-b618-762af5862c7b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:02.756547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f6b9b27b-00fd-4180-b618-762af5862c7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31a4c1f456fd4b689c6c7fad2cbdaadf', 'request_id': 'req-f6b9b27b-00fd-4180-b618-762af5862c7b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:02.790819 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f6b9b27b-00fd-4180-b618-762af5862c7b admin admin] The token cache is being invalidate because project 31a4c1f456fd4b689c6c7fad2cbdaadf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:02.791147 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f6b9b27b-00fd-4180-b618-762af5862c7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:02.792571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f6b9b27b-00fd-4180-b618-762af5862c7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:02.800905 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 841/1686] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:02 2022] DELETE /identity/v3/projects/31a4c1f456fd4b689c6c7fad2cbdaadf => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:02.812944 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9b27b-00fd-4180-b618-762af5862c7b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:02.814317 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f6b9b27b-00fd-4180-b618-762af5862c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:02.875996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:02.899815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0fedf-492b-428d-9e3a-7117aadd930a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:02.900515 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0fedf-492b-428d-9e3a-7117aadd930a admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:02.901071 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0fedf-492b-428d-9e3a-7117aadd930a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:02.901347 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0fedf-492b-428d-9e3a-7117aadd930a admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:02.902093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0fedf-492b-428d-9e3a-7117aadd930a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:02.910064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0fedf-492b-428d-9e3a-7117aadd930a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:02.947247 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 846/1687] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:02 2022] POST /identity/v3/projects => generated 355 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:02.951971 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0fedf-492b-428d-9e3a-7117aadd930a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:02.954513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cbe0fedf-492b-428d-9e3a-7117aadd930a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:03.066176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9b27b-00fd-4180-b618-762af5862c7b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:03.155221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0fedf-492b-428d-9e3a-7117aadd930a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:03.187152 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc461cc-592c-46c1-820c-5fa03ef7e976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:03.188087 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc461cc-592c-46c1-820c-5fa03ef7e976 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:03.188795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc461cc-592c-46c1-820c-5fa03ef7e976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:03.189318 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc461cc-592c-46c1-820c-5fa03ef7e976 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:03.190520 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc461cc-592c-46c1-820c-5fa03ef7e976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:03.199399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbeea46-ed4d-470a-b962-5cd52facc0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:03.200530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbeea46-ed4d-470a-b962-5cd52facc0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:03.200812 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbeea46-ed4d-470a-b962-5cd52facc0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:03.201085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbeea46-ed4d-470a-b962-5cd52facc0e5 admin admin] PATH_INFO: `/v3/users/fbd6309a803248e8ad3a9050eb771774` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:03.210652 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbeea46-ed4d-470a-b962-5cd52facc0e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd6309a803248e8ad3a9050eb771774)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:03.211585 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc461cc-592c-46c1-820c-5fa03ef7e976 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:03.213551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbeea46-ed4d-470a-b962-5cd52facc0e5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:03.269526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:03.280852 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 847/1688] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:02 2022] POST /identity/v3/users => generated 284 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:06:03.287756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc461cc-592c-46c1-820c-5fa03ef7e976 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:03.327076 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc461cc-592c-46c1-820c-5fa03ef7e976 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:03.347907 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befb5e4-a356-413e-a9df-11071c73bfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:03.347907 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befb5e4-a356-413e-a9df-11071c73bfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:03.347907 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befb5e4-a356-413e-a9df-11071c73bfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:03.347907 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befb5e4-a356-413e-a9df-11071c73bfb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:03.351251 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befb5e4-a356-413e-a9df-11071c73bfb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:03.355289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befb5e4-a356-413e-a9df-11071c73bfb9 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:03.397330 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5bbeea46-ed4d-470a-b962-5cd52facc0e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd6309a803248e8ad3a9050eb771774'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:03.400234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5bbeea46-ed4d-470a-b962-5cd52facc0e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd6309a803248e8ad3a9050eb771774'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:03.414426 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 848/1689] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:03.419831 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befb5e4-a356-413e-a9df-11071c73bfb9 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:03.430953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5bbeea46-ed4d-470a-b962-5cd52facc0e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd6309a803248e8ad3a9050eb771774'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:03.448871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5bbeea46-ed4d-470a-b962-5cd52facc0e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd6309a803248e8ad3a9050eb771774'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:03.459336 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befb5e4-a356-413e-a9df-11071c73bfb9 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:03.474552 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83b4c6-5502-46d7-a883-7125275ef411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:03.478689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83b4c6-5502-46d7-a883-7125275ef411 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:03.479065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83b4c6-5502-46d7-a883-7125275ef411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:03.479448 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83b4c6-5502-46d7-a883-7125275ef411 admin admin] PATH_INFO: `/v3/projects/7e21ff757e0e4f34856d0c0dd5695ec3/users/7f35a2a8df9743f0bdec813368682770/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:03.495624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5bbeea46-ed4d-470a-b962-5cd52facc0e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd6309a803248e8ad3a9050eb771774'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:03.510468 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83b4c6-5502-46d7-a883-7125275ef411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e21ff757e0e4f34856d0c0dd5695ec3, user_id=7f35a2a8df9743f0bdec813368682770, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:03.516005 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83b4c6-5502-46d7-a883-7125275ef411 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:03.521321 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 842/1690] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:02 2022] DELETE /identity/v3/users/fbd6309a803248e8ad3a9050eb771774 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:03.542982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 849/1691] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:03 2022] PUT /identity/v3/projects/7e21ff757e0e4f34856d0c0dd5695ec3/users/7f35a2a8df9743f0bdec813368682770/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:03.548489 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbeea46-ed4d-470a-b962-5cd52facc0e5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:03.554916 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5bbeea46-ed4d-470a-b962-5cd52facc0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:03.631388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e5a3e-dab0-4948-bf90-b024e504cd5b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:03.631759 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e5a3e-dab0-4948-bf90-b024e504cd5b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:03.633210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e5a3e-dab0-4948-bf90-b024e504cd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:03.734826 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d36e5a3e-dab0-4948-bf90-b024e504cd5b None None] MFA Rules not processed for user `5e28c0ca22d143eebe6fc93f85442a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:03.745394 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d36e5a3e-dab0-4948-bf90-b024e504cd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:03.757765 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbeea46-ed4d-470a-b962-5cd52facc0e5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:03.900935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b434c0-611a-4538-80e9-68b051a7a924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:03.903734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b434c0-611a-4538-80e9-68b051a7a924 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:03.903937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b434c0-611a-4538-80e9-68b051a7a924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:03.904243 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b434c0-611a-4538-80e9-68b051a7a924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:03.907309 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b434c0-611a-4538-80e9-68b051a7a924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:03.909583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b434c0-611a-4538-80e9-68b051a7a924 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:03.950519 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 843/1692] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:03.955422 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b434c0-611a-4538-80e9-68b051a7a924 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:03.991274 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 850/1693] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:03.991906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b434c0-611a-4538-80e9-68b051a7a924 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:03.995938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5402e-380b-49c4-9ac7-876b6abb5c35 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:03.995938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5402e-380b-49c4-9ac7-876b6abb5c35 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:03.995938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5402e-380b-49c4-9ac7-876b6abb5c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:04.016705 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0b5db-7f02-4d9e-8ecf-a3c4a7e1f488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:04.018196 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0b5db-7f02-4d9e-8ecf-a3c4a7e1f488 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:04.018697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0b5db-7f02-4d9e-8ecf-a3c4a7e1f488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:04.019186 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0b5db-7f02-4d9e-8ecf-a3c4a7e1f488 admin admin] PATH_INFO: `/v3/projects/7e21ff757e0e4f34856d0c0dd5695ec3/users/7f35a2a8df9743f0bdec813368682770/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:04.027251 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0b5db-7f02-4d9e-8ecf-a3c4a7e1f488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e21ff757e0e4f34856d0c0dd5695ec3, user_id=7f35a2a8df9743f0bdec813368682770, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:04.039689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0b5db-7f02-4d9e-8ecf-a3c4a7e1f488 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:04.053647 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-8bf5402e-380b-49c4-9ac7-876b6abb5c35 None None] MFA Rules not processed for user `5e28c0ca22d143eebe6fc93f85442a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:04.056515 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8bf5402e-380b-49c4-9ac7-876b6abb5c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:04.083410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 851/1694] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:04.093276 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5402e-380b-49c4-9ac7-876b6abb5c35 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:04.094784 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8bf5402e-380b-49c4-9ac7-876b6abb5c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:04.114287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 844/1695] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:03 2022] PUT /identity/v3/projects/7e21ff757e0e4f34856d0c0dd5695ec3/users/7f35a2a8df9743f0bdec813368682770/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:04.128192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5825d7-1cce-4d7b-a197-a7ba37cd506a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:04.128545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5825d7-1cce-4d7b-a197-a7ba37cd506a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:04.128921 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5825d7-1cce-4d7b-a197-a7ba37cd506a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:04.154539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:04.228104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-df5825d7-1cce-4d7b-a197-a7ba37cd506a None None] MFA Rules not processed for user `7f35a2a8df9743f0bdec813368682770`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:04.230339 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-df5825d7-1cce-4d7b-a197-a7ba37cd506a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:04.284314 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:04.316617 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5402e-380b-49c4-9ac7-876b6abb5c35 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:04.479749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 845/1696] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:04 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:06:04.491690 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5825d7-1cce-4d7b-a197-a7ba37cd506a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:04.499891 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-df5825d7-1cce-4d7b-a197-a7ba37cd506a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:04.597622 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155044b-657a-45b0-900a-66c165a561ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:04.598017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155044b-657a-45b0-900a-66c165a561ea service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:04.598267 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155044b-657a-45b0-900a-66c165a561ea service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:04.599158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155044b-657a-45b0-900a-66c165a561ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:04.740429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5825d7-1cce-4d7b-a197-a7ba37cd506a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:04.752656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ecdd4-fd32-4ee1-830c-b94e7dea0014 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:04.753957 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ecdd4-fd32-4ee1-830c-b94e7dea0014 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:04.754424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ecdd4-fd32-4ee1-830c-b94e7dea0014 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:04.754714 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ecdd4-fd32-4ee1-830c-b94e7dea0014 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:04.773735 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155044b-657a-45b0-900a-66c165a561ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:04.781855 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155044b-657a-45b0-900a-66c165a561ea service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:04.784217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ecdd4-fd32-4ee1-830c-b94e7dea0014 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:04.789077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ecdd4-fd32-4ee1-830c-b94e7dea0014 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:04.814288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 846/1697] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:04 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:04.827989 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 852/1698] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:05.006493 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f6a42-94ff-48f6-843f-6eb37e1b3fca None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:05.006797 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f6a42-94ff-48f6-843f-6eb37e1b3fca None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:05.007071 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f6a42-94ff-48f6-843f-6eb37e1b3fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:05.039882 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-969f6a42-94ff-48f6-843f-6eb37e1b3fca None None] MFA Rules not processed for user `9692d55c8c924544a1bff62054731ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:05.041686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-969f6a42-94ff-48f6-843f-6eb37e1b3fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:05.105563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155044b-657a-45b0-900a-66c165a561ea service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:05.125736 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155044b-657a-45b0-900a-66c165a561ea service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:05.141339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5282dba-3fb7-48b4-8652-373532f7ed0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:05.145776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5282dba-3fb7-48b4-8652-373532f7ed0a service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:05.148103 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5282dba-3fb7-48b4-8652-373532f7ed0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:05.148439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5282dba-3fb7-48b4-8652-373532f7ed0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:05.155025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c5282dba-3fb7-48b4-8652-373532f7ed0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:05.212378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 847/1699] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 18 17:06:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:05.364935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:05.410024 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5282dba-3fb7-48b4-8652-373532f7ed0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:05.413515 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5282dba-3fb7-48b4-8652-373532f7ed0a service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:05.441072 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 853/1700] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:05 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:05.562335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f6a42-94ff-48f6-843f-6eb37e1b3fca None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:05.563617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-969f6a42-94ff-48f6-843f-6eb37e1b3fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:05.805552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f6a42-94ff-48f6-843f-6eb37e1b3fca None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:05.818678 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf018cad-dec0-408c-a3b6-0e03b3fefdd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b712c7f5fce54fe2a89d63863f3845f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:05.819360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf018cad-dec0-408c-a3b6-0e03b3fefdd6 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:05.819788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf018cad-dec0-408c-a3b6-0e03b3fefdd6 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:05.820073 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf018cad-dec0-408c-a3b6-0e03b3fefdd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:05.835503 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:05.840102 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf018cad-dec0-408c-a3b6-0e03b3fefdd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:05.841984 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf018cad-dec0-408c-a3b6-0e03b3fefdd6 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:05.874165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 848/1701] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 18 17:06:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 17:06:05.911659 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5282dba-3fb7-48b4-8652-373532f7ed0a service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:05.915044 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c5282dba-3fb7-48b4-8652-373532f7ed0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:06.225983 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5282dba-3fb7-48b4-8652-373532f7ed0a service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:06.245849 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cca9cc-f191-4929-870c-665feea866af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:06.251719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cca9cc-f191-4929-870c-665feea866af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:06.252667 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cca9cc-f191-4929-870c-665feea866af admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:06.254149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cca9cc-f191-4929-870c-665feea866af admin admin] PATH_INFO: `/v3/projects/c69c6fb2df7e4a33b360c07f8f80ea3b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:06.257741 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cca9cc-f191-4929-870c-665feea866af admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69c6fb2df7e4a33b360c07f8f80ea3b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:06.264651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cca9cc-f191-4929-870c-665feea866af admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:06.506547 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b4cca9cc-f191-4929-870c-665feea866af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69c6fb2df7e4a33b360c07f8f80ea3b', 'request_id': 'req-b4cca9cc-f191-4929-870c-665feea866af'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:06.543027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b4cca9cc-f191-4929-870c-665feea866af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69c6fb2df7e4a33b360c07f8f80ea3b', 'request_id': 'req-b4cca9cc-f191-4929-870c-665feea866af'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:06.553921 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b4cca9cc-f191-4929-870c-665feea866af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69c6fb2df7e4a33b360c07f8f80ea3b', 'request_id': 'req-b4cca9cc-f191-4929-870c-665feea866af'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:06.593618 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b4cca9cc-f191-4929-870c-665feea866af admin admin] The token cache is being invalidate because project c69c6fb2df7e4a33b360c07f8f80ea3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:06.594105 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b4cca9cc-f191-4929-870c-665feea866af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:06.596897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b4cca9cc-f191-4929-870c-665feea866af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:06.607120 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 854/1702] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:05 2022] DELETE /identity/v3/projects/c69c6fb2df7e4a33b360c07f8f80ea3b => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:06.608486 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17088e-0ed4-4d4f-b40a-c40d1857642a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:06.609093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17088e-0ed4-4d4f-b40a-c40d1857642a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:06.609759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17088e-0ed4-4d4f-b40a-c40d1857642a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:06.673459 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ec17088e-0ed4-4d4f-b40a-c40d1857642a None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:06.700325 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61781ac6-6b81-4160-b5ee-0be13e5bfb43 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:06.700325 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61781ac6-6b81-4160-b5ee-0be13e5bfb43 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:06.700993 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61781ac6-6b81-4160-b5ee-0be13e5bfb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:06.716787 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ec17088e-0ed4-4d4f-b40a-c40d1857642a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:06.827275 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-61781ac6-6b81-4160-b5ee-0be13e5bfb43 None None] MFA Rules not processed for user `9b596d7285294117b826f459a39872c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:06.835265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-61781ac6-6b81-4160-b5ee-0be13e5bfb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:06.988063 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 849/1703] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:06.997447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5230e8-690f-49c9-bffd-bbfc69303d7a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:06.998000 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5230e8-690f-49c9-bffd-bbfc69303d7a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:06.998435 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5230e8-690f-49c9-bffd-bbfc69303d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:07.060973 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0a5230e8-690f-49c9-bffd-bbfc69303d7a None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:07.062935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0a5230e8-690f-49c9-bffd-bbfc69303d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:07.078403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 850/1704] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:06:07.082680 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5230e8-690f-49c9-bffd-bbfc69303d7a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:07.109482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5230e8-690f-49c9-bffd-bbfc69303d7a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:07.139072 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d9aa3-5919-4e11-97bf-772814c7d4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:07.139072 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d9aa3-5919-4e11-97bf-772814c7d4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:07.139072 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d9aa3-5919-4e11-97bf-772814c7d4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:07.139072 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d9aa3-5919-4e11-97bf-772814c7d4c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:07.139495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d9aa3-5919-4e11-97bf-772814c7d4c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:06:07.139495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d9aa3-5919-4e11-97bf-772814c7d4c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:07.139495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d9aa3-5919-4e11-97bf-772814c7d4c9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:07.140669 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 855/1705] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:07.178398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 851/1706] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 17:06:07.180734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61781ac6-6b81-4160-b5ee-0be13e5bfb43 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:07.203272 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61781ac6-6b81-4160-b5ee-0be13e5bfb43 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:07.243825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea977bd-0a14-4937-b4d9-5a90e80b71bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:07.247404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea977bd-0a14-4937-b4d9-5a90e80b71bc admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:07.247928 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea977bd-0a14-4937-b4d9-5a90e80b71bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:07.250872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea977bd-0a14-4937-b4d9-5a90e80b71bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:07.251870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea977bd-0a14-4937-b4d9-5a90e80b71bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:07.272845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea977bd-0a14-4937-b4d9-5a90e80b71bc admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:07.315008 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:07.479074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d9aa3-5919-4e11-97bf-772814c7d4c9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:07.479969 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 856/1707] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:07 2022] POST /identity/v3/projects => generated 387 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:07.539416 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d9aa3-5919-4e11-97bf-772814c7d4c9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:07.756215 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea977bd-0a14-4937-b4d9-5a90e80b71bc admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:07.759600 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7ea977bd-0a14-4937-b4d9-5a90e80b71bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:08.025623 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1409b2e-43f0-44af-9aa8-dcd1c040f83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:08.026405 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1409b2e-43f0-44af-9aa8-dcd1c040f83e admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:08.026695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1409b2e-43f0-44af-9aa8-dcd1c040f83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:08.027412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1409b2e-43f0-44af-9aa8-dcd1c040f83e admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:08.034140 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1409b2e-43f0-44af-9aa8-dcd1c040f83e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:08.036188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1409b2e-43f0-44af-9aa8-dcd1c040f83e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:08.123109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea977bd-0a14-4937-b4d9-5a90e80b71bc admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:08.125247 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 852/1708] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:07 2022] POST /identity/v3/users => generated 294 bytes in 647 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:08.130532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1409b2e-43f0-44af-9aa8-dcd1c040f83e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:08.156862 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5b08e-a248-4e06-a66b-c7c1fa44c984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:08.157578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5b08e-a248-4e06-a66b-c7c1fa44c984 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:08.157879 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5b08e-a248-4e06-a66b-c7c1fa44c984 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:08.158165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5b08e-a248-4e06-a66b-c7c1fa44c984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:08.171439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1409b2e-43f0-44af-9aa8-dcd1c040f83e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:08.191384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cb797-fde1-4f10-ae19-b9611a50606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:08.194461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cb797-fde1-4f10-ae19-b9611a50606f admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:08.194751 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cb797-fde1-4f10-ae19-b9611a50606f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:08.202515 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cb797-fde1-4f10-ae19-b9611a50606f admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:08.203498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cb797-fde1-4f10-ae19-b9611a50606f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:08.205548 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8cb797-fde1-4f10-ae19-b9611a50606f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:08.263603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 853/1709] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:08.264971 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cb797-fde1-4f10-ae19-b9611a50606f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:08.296194 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cb797-fde1-4f10-ae19-b9611a50606f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:08.346716 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4436d1-12bb-4c6a-9063-20cc2a45db31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:08.347416 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4436d1-12bb-4c6a-9063-20cc2a45db31 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:08.347881 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4436d1-12bb-4c6a-9063-20cc2a45db31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:08.348314 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4436d1-12bb-4c6a-9063-20cc2a45db31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:08.349283 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4436d1-12bb-4c6a-9063-20cc2a45db31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:08.373406 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4436d1-12bb-4c6a-9063-20cc2a45db31 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:08.428793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 854/1710] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:08.433042 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4436d1-12bb-4c6a-9063-20cc2a45db31 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:08.461474 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4436d1-12bb-4c6a-9063-20cc2a45db31 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:08.484324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5b08e-a248-4e06-a66b-c7c1fa44c984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:08.489891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5b08e-a248-4e06-a66b-c7c1fa44c984 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:08.502795 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444ac8c-5eb0-48e4-ae18-12e46161b3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:08.504012 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444ac8c-5eb0-48e4-ae18-12e46161b3be admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:08.506970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444ac8c-5eb0-48e4-ae18-12e46161b3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:08.507484 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444ac8c-5eb0-48e4-ae18-12e46161b3be admin admin] PATH_INFO: `/v3/projects/cf37a526905b47e2b0e5151573615f1d/users/816b4afb05e248d88cf814d2788259e1/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:08.536457 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 857/1711] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 776 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:06:08.568158 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444ac8c-5eb0-48e4-ae18-12e46161b3be admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf37a526905b47e2b0e5151573615f1d, user_id=816b4afb05e248d88cf814d2788259e1, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:08.571369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444ac8c-5eb0-48e4-ae18-12e46161b3be admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:08.652095 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 855/1712] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:08 2022] PUT /identity/v3/projects/cf37a526905b47e2b0e5151573615f1d/users/816b4afb05e248d88cf814d2788259e1/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:06:08.683690 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a27a1-ac25-42b7-a408-94867de729ac None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:08.684553 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a27a1-ac25-42b7-a408-94867de729ac None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:08.684837 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a27a1-ac25-42b7-a408-94867de729ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:08.687280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfce67-c838-4239-9a31-d2248098843e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:08.687717 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfce67-c838-4239-9a31-d2248098843e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:08.688663 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfce67-c838-4239-9a31-d2248098843e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:08.791320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d8cfce67-c838-4239-9a31-d2248098843e None None] MFA Rules not processed for user `5e28c0ca22d143eebe6fc93f85442a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:08.803057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d8cfce67-c838-4239-9a31-d2248098843e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:08.815372 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-417a27a1-ac25-42b7-a408-94867de729ac None None] MFA Rules not processed for user `816b4afb05e248d88cf814d2788259e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:08.818027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-417a27a1-ac25-42b7-a408-94867de729ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:08.879017 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:09.075540 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 856/1713] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:09.143116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 858/1714] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:09.147743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfce67-c838-4239-9a31-d2248098843e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:09.551470 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfce67-c838-4239-9a31-d2248098843e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:09.583993 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b79c0d-3e0e-4b91-92a8-dad8045a41c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:09.585679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b79c0d-3e0e-4b91-92a8-dad8045a41c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:09.592136 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b79c0d-3e0e-4b91-92a8-dad8045a41c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:09.595898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b79c0d-3e0e-4b91-92a8-dad8045a41c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:09.604993 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b79c0d-3e0e-4b91-92a8-dad8045a41c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:09.616339 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b79c0d-3e0e-4b91-92a8-dad8045a41c6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:09.750935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 857/1715] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:09 2022] POST /identity/v3/projects => generated 385 bytes in 603 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:09.757530 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a27a1-ac25-42b7-a408-94867de729ac None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:09.787498 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a27a1-ac25-42b7-a408-94867de729ac None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:09.885007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:10.230694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3efaf-0906-44fc-9728-9d47255fe803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:10.235377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3efaf-0906-44fc-9728-9d47255fe803 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:10.241034 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3efaf-0906-44fc-9728-9d47255fe803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:10.243366 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3efaf-0906-44fc-9728-9d47255fe803 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:10.247992 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3efaf-0906-44fc-9728-9d47255fe803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:10.260891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3efaf-0906-44fc-9728-9d47255fe803 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:10.352094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b79c0d-3e0e-4b91-92a8-dad8045a41c6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:10.353368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 859/1716] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:09 2022] POST /identity/v3/users => generated 299 bytes in 597 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:10.372166 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b79c0d-3e0e-4b91-92a8-dad8045a41c6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:10.403634 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a8137-4caa-4b96-a52d-9a276ae2e9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:10.405023 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a8137-4caa-4b96-a52d-9a276ae2e9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:10.405458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a8137-4caa-4b96-a52d-9a276ae2e9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:10.406047 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a8137-4caa-4b96-a52d-9a276ae2e9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:10.409828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a8137-4caa-4b96-a52d-9a276ae2e9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:10.411623 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a8137-4caa-4b96-a52d-9a276ae2e9d2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:10.894544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 858/1717] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 543 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:06:10.895373 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3efaf-0906-44fc-9728-9d47255fe803 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:10.921405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3efaf-0906-44fc-9728-9d47255fe803 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:10.946363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae868a-a65a-48d0-81f6-0c9159b07834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:10.947342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae868a-a65a-48d0-81f6-0c9159b07834 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:10.947670 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae868a-a65a-48d0-81f6-0c9159b07834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:10.947947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae868a-a65a-48d0-81f6-0c9159b07834 admin admin] PATH_INFO: `/v3/projects/bc18863efa2740f8bc51faf02da13d8a/users/b6f7a9301c514ec8af7aa339f588942e/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:10.963652 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e0fe2-814a-49fd-8b7c-c51417c92537 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:10.964495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e0fe2-814a-49fd-8b7c-c51417c92537 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:10.964778 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e0fe2-814a-49fd-8b7c-c51417c92537 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:10.966811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 859/1718] 10.222.0.49 () {54 vars in 912 bytes} [Wed May 18 17:06:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:06:10.983607 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486443ca-4689-4682-8af9-344ffeb1e1ac None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:10.983912 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486443ca-4689-4682-8af9-344ffeb1e1ac None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:10.984175 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486443ca-4689-4682-8af9-344ffeb1e1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:11.047270 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae868a-a65a-48d0-81f6-0c9159b07834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc18863efa2740f8bc51faf02da13d8a, user_id=b6f7a9301c514ec8af7aa339f588942e, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:11.079031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-486443ca-4689-4682-8af9-344ffeb1e1ac None None] MFA Rules not processed for user `d35f21c5cc7c433882eb5fbe9a8072f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:11.080524 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae868a-a65a-48d0-81f6-0c9159b07834 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:11.086091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-486443ca-4689-4682-8af9-344ffeb1e1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:11.124881 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 860/1719] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:10 2022] PUT /identity/v3/projects/bc18863efa2740f8bc51faf02da13d8a/users/b6f7a9301c514ec8af7aa339f588942e/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:11.127073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae868a-a65a-48d0-81f6-0c9159b07834 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:11.313197 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 860/1720] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 18 17:06:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:11.428105 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486443ca-4689-4682-8af9-344ffeb1e1ac None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:11.429533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-486443ca-4689-4682-8af9-344ffeb1e1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:11.440289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae868a-a65a-48d0-81f6-0c9159b07834 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:11.454249 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486443ca-4689-4682-8af9-344ffeb1e1ac None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:11.457737 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca29ff-802c-446f-9516-8da180d2f492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:11.458448 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca29ff-802c-446f-9516-8da180d2f492 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:11.458737 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca29ff-802c-446f-9516-8da180d2f492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:11.459016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca29ff-802c-446f-9516-8da180d2f492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:11.459770 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca29ff-802c-446f-9516-8da180d2f492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:11.461434 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca29ff-802c-446f-9516-8da180d2f492 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:11.507195 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 861/1721] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:11.511565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca29ff-802c-446f-9516-8da180d2f492 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:11.535519 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca29ff-802c-446f-9516-8da180d2f492 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:11.567742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfabc7f-7935-4053-8e63-bd89a4c60cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:11.576976 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfabc7f-7935-4053-8e63-bd89a4c60cae admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:11.577158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfabc7f-7935-4053-8e63-bd89a4c60cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:11.577452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfabc7f-7935-4053-8e63-bd89a4c60cae admin admin] PATH_INFO: `/v3/projects/bc18863efa2740f8bc51faf02da13d8a/users/b6f7a9301c514ec8af7aa339f588942e/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:11.581376 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfabc7f-7935-4053-8e63-bd89a4c60cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc18863efa2740f8bc51faf02da13d8a, user_id=b6f7a9301c514ec8af7aa339f588942e, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:11.585705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfabc7f-7935-4053-8e63-bd89a4c60cae admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:11.604995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 862/1722] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:11 2022] PUT /identity/v3/projects/bc18863efa2740f8bc51faf02da13d8a/users/b6f7a9301c514ec8af7aa339f588942e/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:11.617799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:11.630567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb852cd-f0e4-43a9-932b-985fad024f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:11.631964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb852cd-f0e4-43a9-932b-985fad024f43 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:11.632696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb852cd-f0e4-43a9-932b-985fad024f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:11.633057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb852cd-f0e4-43a9-932b-985fad024f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:11.639625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20584e-e8a1-46a0-b0b4-782ebdeeb87f None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:11.639924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20584e-e8a1-46a0-b0b4-782ebdeeb87f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:11.642841 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20584e-e8a1-46a0-b0b4-782ebdeeb87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:11.657110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb852cd-f0e4-43a9-932b-985fad024f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:11.658630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb852cd-f0e4-43a9-932b-985fad024f43 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:11.688258 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 861/1723] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:11.770041 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4e20584e-e8a1-46a0-b0b4-782ebdeeb87f None None] MFA Rules not processed for user `b6f7a9301c514ec8af7aa339f588942e`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:11.770041 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4e20584e-e8a1-46a0-b0b4-782ebdeeb87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:11.919126 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:12.004565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 863/1724] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:12.030079 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb852cd-f0e4-43a9-932b-985fad024f43 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:12.032000 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bdb852cd-f0e4-43a9-932b-985fad024f43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:12.103561 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694ca6c-42a5-484d-a11e-df6adfb8c827 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:12.104400 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694ca6c-42a5-484d-a11e-df6adfb8c827 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:12.105266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694ca6c-42a5-484d-a11e-df6adfb8c827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:12.234019 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2694ca6c-42a5-484d-a11e-df6adfb8c827 None None] MFA Rules not processed for user `d35f21c5cc7c433882eb5fbe9a8072f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:12.237305 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2694ca6c-42a5-484d-a11e-df6adfb8c827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:12.270137 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb852cd-f0e4-43a9-932b-985fad024f43 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:12.399650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 864/1725] 10.222.0.73 () {58 vars in 1015 bytes} [Wed May 18 17:06:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:12.431448 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779e6fb-bd42-47a6-9a9a-763b6b864629 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:12.433749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779e6fb-bd42-47a6-9a9a-763b6b864629 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:12.434237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779e6fb-bd42-47a6-9a9a-763b6b864629 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:12.434645 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779e6fb-bd42-47a6-9a9a-763b6b864629 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:12.462104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779e6fb-bd42-47a6-9a9a-763b6b864629 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:12.465600 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779e6fb-bd42-47a6-9a9a-763b6b864629 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:12.501308 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 862/1726] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:12.656301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694ca6c-42a5-484d-a11e-df6adfb8c827 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:12.700010 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694ca6c-42a5-484d-a11e-df6adfb8c827 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:12.707161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779e6fb-bd42-47a6-9a9a-763b6b864629 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:12.746587 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a8e43-472d-44c6-8ba5-2ea1060c252f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:12.751621 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a8e43-472d-44c6-8ba5-2ea1060c252f service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:12.751924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a8e43-472d-44c6-8ba5-2ea1060c252f service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:12.752173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a8e43-472d-44c6-8ba5-2ea1060c252f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:12.798730 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a8e43-472d-44c6-8ba5-2ea1060c252f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:12.812666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a8e43-472d-44c6-8ba5-2ea1060c252f service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:12.844608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 865/1727] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:12.927288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779e6fb-bd42-47a6-9a9a-763b6b864629 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:12.970543 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5294d9-bef7-451e-8825-3055a0d6feb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:12.975124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5294d9-bef7-451e-8825-3055a0d6feb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:12.975564 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5294d9-bef7-451e-8825-3055a0d6feb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:12.976461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5294d9-bef7-451e-8825-3055a0d6feb4 admin admin] PATH_INFO: `/v3/users/816b4afb05e248d88cf814d2788259e1` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:12.982225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5294d9-bef7-451e-8825-3055a0d6feb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=816b4afb05e248d88cf814d2788259e1)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:12.985976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5294d9-bef7-451e-8825-3055a0d6feb4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:13.123014 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8e5294d9-bef7-451e-8825-3055a0d6feb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816b4afb05e248d88cf814d2788259e1'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:13.124162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8e5294d9-bef7-451e-8825-3055a0d6feb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816b4afb05e248d88cf814d2788259e1'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:13.147646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:13.153182 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8e5294d9-bef7-451e-8825-3055a0d6feb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816b4afb05e248d88cf814d2788259e1'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:13.178125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8e5294d9-bef7-451e-8825-3055a0d6feb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816b4afb05e248d88cf814d2788259e1'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:13.197274 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8e5294d9-bef7-451e-8825-3055a0d6feb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816b4afb05e248d88cf814d2788259e1'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:13.210392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 863/1728] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:12 2022] DELETE /identity/v3/users/816b4afb05e248d88cf814d2788259e1 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:13.215216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87156e84-085c-4a19-ad30-bbb50689d41e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:13.217267 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87156e84-085c-4a19-ad30-bbb50689d41e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:13.217790 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87156e84-085c-4a19-ad30-bbb50689d41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:13.266861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-87156e84-085c-4a19-ad30-bbb50689d41e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:13.270002 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-87156e84-085c-4a19-ad30-bbb50689d41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:13.650405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 866/1729] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:06:13.811071 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5294d9-bef7-451e-8825-3055a0d6feb4 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:13.815073 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8e5294d9-bef7-451e-8825-3055a0d6feb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:14.080903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5294d9-bef7-451e-8825-3055a0d6feb4 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:14.103046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386ef41-9cbd-4386-8960-ababe1b08eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:14.104326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386ef41-9cbd-4386-8960-ababe1b08eba service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:14.104943 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386ef41-9cbd-4386-8960-ababe1b08eba service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:14.105536 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386ef41-9cbd-4386-8960-ababe1b08eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:14.171864 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386ef41-9cbd-4386-8960-ababe1b08eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:14.173563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386ef41-9cbd-4386-8960-ababe1b08eba service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:14.220487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 864/1730] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:15.372578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6ce09-790c-4102-ad85-2e83241fe957 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:15.373503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6ce09-790c-4102-ad85-2e83241fe957 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:15.373982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6ce09-790c-4102-ad85-2e83241fe957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:15.454724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9ae6ce09-790c-4102-ad85-2e83241fe957 None None] MFA Rules not processed for user `01881ccdf756480b8fcc1ac599fdf905`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:15.459426 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9ae6ce09-790c-4102-ad85-2e83241fe957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:15.625117 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 867/1731] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:16.015802 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf33e1-86ce-49c1-a4dc-39553781d8c3 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:16.016390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf33e1-86ce-49c1-a4dc-39553781d8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:16.016832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf33e1-86ce-49c1-a4dc-39553781d8c3 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:16.020017 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 865/1732] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 18 17:06:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:06:16.069880 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5e0a5-8bf9-412c-af66-b299545ef14c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:16.070322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5e0a5-8bf9-412c-af66-b299545ef14c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:16.088388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5e0a5-8bf9-412c-af66-b299545ef14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:16.144042 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ead5e0a5-8bf9-412c-af66-b299545ef14c None None] MFA Rules not processed for user `c9e3c0ef5ed943d183b064f383fc01f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:16.145423 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ead5e0a5-8bf9-412c-af66-b299545ef14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:16.257399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:16.400451 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 868/1733] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 18 17:06:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:17.320097 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf33e1-86ce-49c1-a4dc-39553781d8c3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:17.322678 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3aaf33e1-86ce-49c1-a4dc-39553781d8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:17.419334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf33e1-86ce-49c1-a4dc-39553781d8c3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:17.435712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d56117-a349-4e2b-b829-50ff48808b86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:17.436752 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d56117-a349-4e2b-b829-50ff48808b86 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:17.437234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d56117-a349-4e2b-b829-50ff48808b86 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:17.437822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d56117-a349-4e2b-b829-50ff48808b86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:17.454755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d56117-a349-4e2b-b829-50ff48808b86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:17.456418 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d56117-a349-4e2b-b829-50ff48808b86 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:17.497098 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 866/1734] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:17.722375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5e0a5-8bf9-412c-af66-b299545ef14c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:17.724800 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ead5e0a5-8bf9-412c-af66-b299545ef14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:17.778230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5e0a5-8bf9-412c-af66-b299545ef14c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:17.797971 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103de9d-15db-4527-bf67-3e6a7fa668d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:17.799908 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103de9d-15db-4527-bf67-3e6a7fa668d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:17.800733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103de9d-15db-4527-bf67-3e6a7fa668d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:17.801524 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103de9d-15db-4527-bf67-3e6a7fa668d6 admin admin] PATH_INFO: `/v3/users/ee65fa3e191545d08780f3423a078484` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:17.827039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103de9d-15db-4527-bf67-3e6a7fa668d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee65fa3e191545d08780f3423a078484)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:17.830250 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103de9d-15db-4527-bf67-3e6a7fa668d6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:18.033491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f103de9d-15db-4527-bf67-3e6a7fa668d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee65fa3e191545d08780f3423a078484'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:18.043640 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d56117-a349-4e2b-b829-50ff48808b86 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:18.046469 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d5d56117-a349-4e2b-b829-50ff48808b86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:18.057559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f103de9d-15db-4527-bf67-3e6a7fa668d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee65fa3e191545d08780f3423a078484'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:18.110990 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f103de9d-15db-4527-bf67-3e6a7fa668d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee65fa3e191545d08780f3423a078484'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:18.111942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f103de9d-15db-4527-bf67-3e6a7fa668d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee65fa3e191545d08780f3423a078484'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:18.112745 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f103de9d-15db-4527-bf67-3e6a7fa668d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee65fa3e191545d08780f3423a078484'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:18.116553 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d56117-a349-4e2b-b829-50ff48808b86 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:18.126870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2e5f4-02f3-43ae-ba73-2ca00a6d4007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:18.132594 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2e5f4-02f3-43ae-ba73-2ca00a6d4007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:18.134004 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2e5f4-02f3-43ae-ba73-2ca00a6d4007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:18.138021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2e5f4-02f3-43ae-ba73-2ca00a6d4007 admin admin] PATH_INFO: `/v3/projects/cf37a526905b47e2b0e5151573615f1d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:18.142457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2e5f4-02f3-43ae-ba73-2ca00a6d4007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf37a526905b47e2b0e5151573615f1d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:18.145529 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 869/1735] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:17 2022] DELETE /identity/v3/users/ee65fa3e191545d08780f3423a078484 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:18.146270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2e5f4-02f3-43ae-ba73-2ca00a6d4007 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:18.150367 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f134e-da5c-4213-ab5d-470be8f36ddf None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:18.151029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f134e-da5c-4213-ab5d-470be8f36ddf None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:18.151522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f134e-da5c-4213-ab5d-470be8f36ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:18.243575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-de9f134e-da5c-4213-ab5d-470be8f36ddf None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:18.248382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-de9f134e-da5c-4213-ab5d-470be8f36ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:18.417264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-14d2e5f4-02f3-43ae-ba73-2ca00a6d4007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf37a526905b47e2b0e5151573615f1d', 'request_id': 'req-14d2e5f4-02f3-43ae-ba73-2ca00a6d4007'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:18.442955 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-14d2e5f4-02f3-43ae-ba73-2ca00a6d4007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf37a526905b47e2b0e5151573615f1d', 'request_id': 'req-14d2e5f4-02f3-43ae-ba73-2ca00a6d4007'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:18.492453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-14d2e5f4-02f3-43ae-ba73-2ca00a6d4007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf37a526905b47e2b0e5151573615f1d', 'request_id': 'req-14d2e5f4-02f3-43ae-ba73-2ca00a6d4007'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:18.526704 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-14d2e5f4-02f3-43ae-ba73-2ca00a6d4007 admin admin] The token cache is being invalidate because project cf37a526905b47e2b0e5151573615f1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:18.526811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-14d2e5f4-02f3-43ae-ba73-2ca00a6d4007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:18.529455 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-14d2e5f4-02f3-43ae-ba73-2ca00a6d4007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:18.540202 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 867/1736] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:18 2022] DELETE /identity/v3/projects/cf37a526905b47e2b0e5151573615f1d => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:18.545013 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2e5f4-02f3-43ae-ba73-2ca00a6d4007 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:18.548356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-14d2e5f4-02f3-43ae-ba73-2ca00a6d4007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:18.567332 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 870/1737] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:06:18.570123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b0c67-3308-44b0-996e-15f2617d4440 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:18.570421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b0c67-3308-44b0-996e-15f2617d4440 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:18.570710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b0c67-3308-44b0-996e-15f2617d4440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:18.642817 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-3d6b0c67-3308-44b0-996e-15f2617d4440 None None] MFA Rules not processed for user `9b596d7285294117b826f459a39872c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:18.644389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3d6b0c67-3308-44b0-996e-15f2617d4440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:18.736271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:18.821497 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2e5f4-02f3-43ae-ba73-2ca00a6d4007 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:18.849708 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167efc3-47da-40bc-97f2-9bd848f19b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:18.850611 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167efc3-47da-40bc-97f2-9bd848f19b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:18.850890 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167efc3-47da-40bc-97f2-9bd848f19b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:18.851166 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167efc3-47da-40bc-97f2-9bd848f19b40 admin admin] PATH_INFO: `/v3/users/b6f7a9301c514ec8af7aa339f588942e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:18.858667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167efc3-47da-40bc-97f2-9bd848f19b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f7a9301c514ec8af7aa339f588942e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:18.860662 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167efc3-47da-40bc-97f2-9bd848f19b40 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:18.862522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:18.953266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 871/1738] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:18.955872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b0c67-3308-44b0-996e-15f2617d4440 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:18.960099 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3d6b0c67-3308-44b0-996e-15f2617d4440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:19.034686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a167efc3-47da-40bc-97f2-9bd848f19b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f7a9301c514ec8af7aa339f588942e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:19.047517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a167efc3-47da-40bc-97f2-9bd848f19b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f7a9301c514ec8af7aa339f588942e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:19.084489 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a167efc3-47da-40bc-97f2-9bd848f19b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f7a9301c514ec8af7aa339f588942e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:19.107234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a167efc3-47da-40bc-97f2-9bd848f19b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f7a9301c514ec8af7aa339f588942e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:19.163381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a167efc3-47da-40bc-97f2-9bd848f19b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f7a9301c514ec8af7aa339f588942e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:19.176557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 868/1739] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:18 2022] DELETE /identity/v3/users/b6f7a9301c514ec8af7aa339f588942e => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:19.213538 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b0c67-3308-44b0-996e-15f2617d4440 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:19.370117 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b47d52-18b2-4e77-849b-965f84a35695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:19.372453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b47d52-18b2-4e77-849b-965f84a35695 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:19.372819 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b47d52-18b2-4e77-849b-965f84a35695 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:19.373109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b47d52-18b2-4e77-849b-965f84a35695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:19.380233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-67b47d52-18b2-4e77-849b-965f84a35695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:19.631248 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b47d52-18b2-4e77-849b-965f84a35695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:19.641528 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b47d52-18b2-4e77-849b-965f84a35695 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:19.672071 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 872/1740] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:20.759312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167efc3-47da-40bc-97f2-9bd848f19b40 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:20.763040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a167efc3-47da-40bc-97f2-9bd848f19b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:20.839029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167efc3-47da-40bc-97f2-9bd848f19b40 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:20.928711 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614134a-16b3-45ef-a79f-f0a4585d1f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:20.930191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614134a-16b3-45ef-a79f-f0a4585d1f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:20.930718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614134a-16b3-45ef-a79f-f0a4585d1f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:20.934560 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614134a-16b3-45ef-a79f-f0a4585d1f8e admin admin] PATH_INFO: `/v3/projects/bc18863efa2740f8bc51faf02da13d8a` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:20.947080 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614134a-16b3-45ef-a79f-f0a4585d1f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc18863efa2740f8bc51faf02da13d8a)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:20.950723 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614134a-16b3-45ef-a79f-f0a4585d1f8e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:21.271157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4614134a-16b3-45ef-a79f-f0a4585d1f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc18863efa2740f8bc51faf02da13d8a', 'request_id': 'req-4614134a-16b3-45ef-a79f-f0a4585d1f8e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:21.306184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4614134a-16b3-45ef-a79f-f0a4585d1f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc18863efa2740f8bc51faf02da13d8a', 'request_id': 'req-4614134a-16b3-45ef-a79f-f0a4585d1f8e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:21.335547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4614134a-16b3-45ef-a79f-f0a4585d1f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc18863efa2740f8bc51faf02da13d8a', 'request_id': 'req-4614134a-16b3-45ef-a79f-f0a4585d1f8e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:21.394683 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4614134a-16b3-45ef-a79f-f0a4585d1f8e admin admin] The token cache is being invalidate because project bc18863efa2740f8bc51faf02da13d8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:21.396909 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4614134a-16b3-45ef-a79f-f0a4585d1f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:21.399240 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4614134a-16b3-45ef-a79f-f0a4585d1f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:21.418657 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 869/1741] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:20 2022] DELETE /identity/v3/projects/bc18863efa2740f8bc51faf02da13d8a => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:21.420548 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc08c39-430e-45ca-8515-86276fd8c15a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:21.421069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc08c39-430e-45ca-8515-86276fd8c15a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:21.421380 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc08c39-430e-45ca-8515-86276fd8c15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:21.498951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5dc08c39-430e-45ca-8515-86276fd8c15a None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:21.506274 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5dc08c39-430e-45ca-8515-86276fd8c15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:21.808626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:21.892751 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074ef2b-d017-4d16-8fd3-479007aee86b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:21.893878 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074ef2b-d017-4d16-8fd3-479007aee86b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:21.894516 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074ef2b-d017-4d16-8fd3-479007aee86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:21.912134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 873/1742] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:21.931129 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d074ef2b-d017-4d16-8fd3-479007aee86b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:21.934131 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d074ef2b-d017-4d16-8fd3-479007aee86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:21.946243 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 870/1743] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:21.951847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc08c39-430e-45ca-8515-86276fd8c15a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:21.964837 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc08c39-430e-45ca-8515-86276fd8c15a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:21.998656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a819de4-75f5-4820-a047-5b195f55382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:21.998656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a819de4-75f5-4820-a047-5b195f55382c admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:21.998656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a819de4-75f5-4820-a047-5b195f55382c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:21.998656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a819de4-75f5-4820-a047-5b195f55382c admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:21.999332 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a819de4-75f5-4820-a047-5b195f55382c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:06:21.999894 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a819de4-75f5-4820-a047-5b195f55382c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:22.002030 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a819de4-75f5-4820-a047-5b195f55382c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:22.059600 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074ef2b-d017-4d16-8fd3-479007aee86b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:22.070093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 874/1744] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:06:22.072319 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074ef2b-d017-4d16-8fd3-479007aee86b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:22.110349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb88168-5bf6-4496-94d1-cca3307247bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:22.111046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb88168-5bf6-4496-94d1-cca3307247bc admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:22.111333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb88168-5bf6-4496-94d1-cca3307247bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:22.111611 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb88168-5bf6-4496-94d1-cca3307247bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:22.112338 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb88168-5bf6-4496-94d1-cca3307247bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:22.114321 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb88168-5bf6-4496-94d1-cca3307247bc admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:22.203964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 871/1745] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:22 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:22.208852 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a819de4-75f5-4820-a047-5b195f55382c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:22.257883 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a819de4-75f5-4820-a047-5b195f55382c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:22.559833 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53df072-8b08-4a5f-a68a-31ebcc58c37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:22.569131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53df072-8b08-4a5f-a68a-31ebcc58c37b admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:22.571216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53df072-8b08-4a5f-a68a-31ebcc58c37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:22.576852 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53df072-8b08-4a5f-a68a-31ebcc58c37b admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:22.585563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53df072-8b08-4a5f-a68a-31ebcc58c37b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:22.606501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53df072-8b08-4a5f-a68a-31ebcc58c37b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:22.748603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 875/1746] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:22 2022] POST /identity/v3/users => generated 291 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:22.750173 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb88168-5bf6-4496-94d1-cca3307247bc admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:22.784727 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb88168-5bf6-4496-94d1-cca3307247bc admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:22.814967 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c7db8-056f-4141-b000-bc97145b72a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:22.816162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c7db8-056f-4141-b000-bc97145b72a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:22.816674 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c7db8-056f-4141-b000-bc97145b72a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:22.817120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c7db8-056f-4141-b000-bc97145b72a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:22.818079 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c7db8-056f-4141-b000-bc97145b72a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:22.821609 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c7db8-056f-4141-b000-bc97145b72a7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:22.877824 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 872/1747] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:06:22.883815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53df072-8b08-4a5f-a68a-31ebcc58c37b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:22.931919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53df072-8b08-4a5f-a68a-31ebcc58c37b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:23.000013 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb90bca-10d7-4910-b2e2-417d94403241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:23.008849 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb90bca-10d7-4910-b2e2-417d94403241 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:23.009185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb90bca-10d7-4910-b2e2-417d94403241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:23.009469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb90bca-10d7-4910-b2e2-417d94403241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:23.016362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb90bca-10d7-4910-b2e2-417d94403241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:23.024377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb90bca-10d7-4910-b2e2-417d94403241 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:23.066948 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 876/1748] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:23.069579 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c7db8-056f-4141-b000-bc97145b72a7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:23.084230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:23.089226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c7db8-056f-4141-b000-bc97145b72a7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:23.122706 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8f8ee-2e20-4bc8-9de2-7621ca055b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:23.123691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8f8ee-2e20-4bc8-9de2-7621ca055b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:23.124122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8f8ee-2e20-4bc8-9de2-7621ca055b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:23.124408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8f8ee-2e20-4bc8-9de2-7621ca055b75 admin admin] PATH_INFO: `/v3/projects/f0b52054909d42ebbfb569c92a9dd372/users/5afc99b98ca6474ab5e27dd756ab0881/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:23.190182 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8f8ee-2e20-4bc8-9de2-7621ca055b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b52054909d42ebbfb569c92a9dd372, user_id=5afc99b98ca6474ab5e27dd756ab0881, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:23.213271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8f8ee-2e20-4bc8-9de2-7621ca055b75 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:23.268223 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 873/1749] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:23 2022] PUT /identity/v3/projects/f0b52054909d42ebbfb569c92a9dd372/users/5afc99b98ca6474ab5e27dd756ab0881/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:23.279892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed50dae-9514-4c14-93bc-8f70e3610bbf None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:23.280507 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed50dae-9514-4c14-93bc-8f70e3610bbf None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:23.280987 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed50dae-9514-4c14-93bc-8f70e3610bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:23.293615 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8f8ee-2e20-4bc8-9de2-7621ca055b75 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:23.295661 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b8c8f8ee-2e20-4bc8-9de2-7621ca055b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:23.403336 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-eed50dae-9514-4c14-93bc-8f70e3610bbf None None] MFA Rules not processed for user `5afc99b98ca6474ab5e27dd756ab0881`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:23.409134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-eed50dae-9514-4c14-93bc-8f70e3610bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:23.554570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8f8ee-2e20-4bc8-9de2-7621ca055b75 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:23.556730 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 877/1750] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:06:23.562143 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed50dae-9514-4c14-93bc-8f70e3610bbf None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:23.573609 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f9bbd-c3f5-46b0-9dec-4134e7cf876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:23.574961 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f9bbd-c3f5-46b0-9dec-4134e7cf876c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:23.575396 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f9bbd-c3f5-46b0-9dec-4134e7cf876c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:23.575852 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f9bbd-c3f5-46b0-9dec-4134e7cf876c admin admin] PATH_INFO: `/v3/projects/1d783438e69647c1bcb2e341add1d326` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:23.577822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f9bbd-c3f5-46b0-9dec-4134e7cf876c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d783438e69647c1bcb2e341add1d326)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:23.579791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f9bbd-c3f5-46b0-9dec-4134e7cf876c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:23.587802 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed50dae-9514-4c14-93bc-8f70e3610bbf None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:23.604359 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b18664-a2ee-4cba-84ed-b2b59b4f52d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:23.605242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b18664-a2ee-4cba-84ed-b2b59b4f52d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:23.606505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b18664-a2ee-4cba-84ed-b2b59b4f52d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:23.607298 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b18664-a2ee-4cba-84ed-b2b59b4f52d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:23.608132 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b18664-a2ee-4cba-84ed-b2b59b4f52d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:23.610401 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b18664-a2ee-4cba-84ed-b2b59b4f52d4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:23.656743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 878/1751] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:23 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:23.660862 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b18664-a2ee-4cba-84ed-b2b59b4f52d4 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:23.674025 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fb2f9bbd-c3f5-46b0-9dec-4134e7cf876c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d783438e69647c1bcb2e341add1d326', 'request_id': 'req-fb2f9bbd-c3f5-46b0-9dec-4134e7cf876c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:23.689234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fb2f9bbd-c3f5-46b0-9dec-4134e7cf876c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d783438e69647c1bcb2e341add1d326', 'request_id': 'req-fb2f9bbd-c3f5-46b0-9dec-4134e7cf876c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:23.698134 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fb2f9bbd-c3f5-46b0-9dec-4134e7cf876c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d783438e69647c1bcb2e341add1d326', 'request_id': 'req-fb2f9bbd-c3f5-46b0-9dec-4134e7cf876c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:23.711654 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fb2f9bbd-c3f5-46b0-9dec-4134e7cf876c admin admin] The token cache is being invalidate because project 1d783438e69647c1bcb2e341add1d326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:23.712327 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fb2f9bbd-c3f5-46b0-9dec-4134e7cf876c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:23.713498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fb2f9bbd-c3f5-46b0-9dec-4134e7cf876c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:23.717029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 874/1752] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:23 2022] DELETE /identity/v3/projects/1d783438e69647c1bcb2e341add1d326 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:23.721077 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:23.721530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb2496-0a17-43b6-bf56-ac1e49399938 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:23.722077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb2496-0a17-43b6-bf56-ac1e49399938 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:23.722599 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb2496-0a17-43b6-bf56-ac1e49399938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:23.755624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3bbb2496-0a17-43b6-bf56-ac1e49399938 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:23.759315 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3bbb2496-0a17-43b6-bf56-ac1e49399938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:23.808146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b18664-a2ee-4cba-84ed-b2b59b4f52d4 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:23.826310 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c369e0-b241-4efc-a6f4-b04403a5b1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:23.827651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c369e0-b241-4efc-a6f4-b04403a5b1ec admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:23.828163 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c369e0-b241-4efc-a6f4-b04403a5b1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:23.828672 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c369e0-b241-4efc-a6f4-b04403a5b1ec admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:23.832991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c369e0-b241-4efc-a6f4-b04403a5b1ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:23.848379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c369e0-b241-4efc-a6f4-b04403a5b1ec admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:23.880410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 875/1753] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:23.890087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6ebe9-4be0-44b3-9954-711c00b70248 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:23.890417 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6ebe9-4be0-44b3-9954-711c00b70248 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:23.890704 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6ebe9-4be0-44b3-9954-711c00b70248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:23.907869 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 879/1754] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:23 2022] POST /identity/v3/users => generated 298 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:06:23.915713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c369e0-b241-4efc-a6f4-b04403a5b1ec admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:23.917940 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-05c369e0-b241-4efc-a6f4-b04403a5b1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:23.927133 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-40b6ebe9-4be0-44b3-9954-711c00b70248 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:23.929274 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-40b6ebe9-4be0-44b3-9954-711c00b70248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:23.945860 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 876/1755] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:23.948282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc17234-3689-4ef8-9578-95ee982534d1 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:23.948282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc17234-3689-4ef8-9578-95ee982534d1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:23.954713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c369e0-b241-4efc-a6f4-b04403a5b1ec admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:23.957063 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc17234-3689-4ef8-9578-95ee982534d1 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:23.958840 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 877/1756] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 18 17:06:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:06:23.965787 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704531e4-3eca-4f7f-9918-28171349b3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:23.966588 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704531e4-3eca-4f7f-9918-28171349b3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:23.966846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704531e4-3eca-4f7f-9918-28171349b3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:23.967167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704531e4-3eca-4f7f-9918-28171349b3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:23.967894 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704531e4-3eca-4f7f-9918-28171349b3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:23.969944 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704531e4-3eca-4f7f-9918-28171349b3a7 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:23.971761 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc17234-3689-4ef8-9578-95ee982534d1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:23.991527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 880/1757] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:23.991527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af3d7b-de41-4246-9620-c056eccf7ad1 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:23.991527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af3d7b-de41-4246-9620-c056eccf7ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:23.991527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af3d7b-de41-4246-9620-c056eccf7ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:24.000136 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:24.016936 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d3af3d7b-de41-4246-9620-c056eccf7ad1 None None] MFA Rules not processed for user `c9e3c0ef5ed943d183b064f383fc01f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:24.016936 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d3af3d7b-de41-4246-9620-c056eccf7ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:24.025398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc17234-3689-4ef8-9578-95ee982534d1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:24.038699 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fd837-96ce-4669-bc81-00a6a7f1b66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:24.040463 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fd837-96ce-4669-bc81-00a6a7f1b66d admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:24.042055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fd837-96ce-4669-bc81-00a6a7f1b66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:24.043374 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fd837-96ce-4669-bc81-00a6a7f1b66d admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:24.046471 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fd837-96ce-4669-bc81-00a6a7f1b66d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:06:24.047906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fd837-96ce-4669-bc81-00a6a7f1b66d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:24.052150 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fd837-96ce-4669-bc81-00a6a7f1b66d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:24.106944 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 878/1758] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:06:24.124085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fd837-96ce-4669-bc81-00a6a7f1b66d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:24.141289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 881/1759] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 18 17:06:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:24.142344 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af3d7b-de41-4246-9620-c056eccf7ad1 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:24.163729 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af3d7b-de41-4246-9620-c056eccf7ad1 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:24.166818 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fd837-96ce-4669-bc81-00a6a7f1b66d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:24.176141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52255b2-8b5c-41ba-a967-816e635b4b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:24.177688 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52255b2-8b5c-41ba-a967-816e635b4b9f admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:24.177990 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70f905-a2d5-432c-bfe5-b6d4395b5c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:24.178112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52255b2-8b5c-41ba-a967-816e635b4b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:24.178298 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52255b2-8b5c-41ba-a967-816e635b4b9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:24.178909 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70f905-a2d5-432c-bfe5-b6d4395b5c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:24.179696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70f905-a2d5-432c-bfe5-b6d4395b5c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:24.179999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70f905-a2d5-432c-bfe5-b6d4395b5c48 admin admin] PATH_INFO: `/v3/projects/cffe850b57b64f2a9806354ed5f0fe0d/users/a6905f0372944670b644f081ae6f0703/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:24.187528 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52255b2-8b5c-41ba-a967-816e635b4b9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:24.190071 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52255b2-8b5c-41ba-a967-816e635b4b9f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:24.224085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70f905-a2d5-432c-bfe5-b6d4395b5c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cffe850b57b64f2a9806354ed5f0fe0d, user_id=a6905f0372944670b644f081ae6f0703, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:24.236371 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70f905-a2d5-432c-bfe5-b6d4395b5c48 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:24.255348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 882/1760] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:24 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:24.260460 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52255b2-8b5c-41ba-a967-816e635b4b9f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:24.261343 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 879/1761] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:24 2022] PUT /identity/v3/projects/cffe850b57b64f2a9806354ed5f0fe0d/users/a6905f0372944670b644f081ae6f0703/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:24.263918 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70f905-a2d5-432c-bfe5-b6d4395b5c48 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:24.264419 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a52255b2-8b5c-41ba-a967-816e635b4b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:24.372006 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70f905-a2d5-432c-bfe5-b6d4395b5c48 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:24.482659 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf224cb1-47f0-4804-aab2-d5b071a30adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:24.483365 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf224cb1-47f0-4804-aab2-d5b071a30adb admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:24.483648 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf224cb1-47f0-4804-aab2-d5b071a30adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:24.483930 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf224cb1-47f0-4804-aab2-d5b071a30adb admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:24.484645 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf224cb1-47f0-4804-aab2-d5b071a30adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:24.486984 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf224cb1-47f0-4804-aab2-d5b071a30adb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:24.494723 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52255b2-8b5c-41ba-a967-816e635b4b9f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:24.514930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879b220-cee4-4150-bbd8-452b1173454e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:24.516260 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879b220-cee4-4150-bbd8-452b1173454e service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:24.516899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879b220-cee4-4150-bbd8-452b1173454e service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:24.517423 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879b220-cee4-4150-bbd8-452b1173454e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:24.535392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:24.545746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 880/1762] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:24 2022] POST /identity/v3/users => generated 285 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:24.546947 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf224cb1-47f0-4804-aab2-d5b071a30adb admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:24.551582 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879b220-cee4-4150-bbd8-452b1173454e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:24.553119 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879b220-cee4-4150-bbd8-452b1173454e service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:24.564901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf224cb1-47f0-4804-aab2-d5b071a30adb admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:24.570403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0544b05-ca27-421a-b3ec-0d0b12d0e14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:24.571153 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0544b05-ca27-421a-b3ec-0d0b12d0e14d admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:24.571441 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0544b05-ca27-421a-b3ec-0d0b12d0e14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:24.573466 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0544b05-ca27-421a-b3ec-0d0b12d0e14d admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:24.574348 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0544b05-ca27-421a-b3ec-0d0b12d0e14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:24.576067 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0544b05-ca27-421a-b3ec-0d0b12d0e14d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:24.603266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 883/1763] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:24.604862 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 881/1764] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:24.607003 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0544b05-ca27-421a-b3ec-0d0b12d0e14d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:24.622789 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0544b05-ca27-421a-b3ec-0d0b12d0e14d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:24.625374 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879b220-cee4-4150-bbd8-452b1173454e service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:24.627719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f755682-ddaa-4286-953f-2094366cb1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:24.628428 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f755682-ddaa-4286-953f-2094366cb1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:24.628768 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f755682-ddaa-4286-953f-2094366cb1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:24.629111 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f755682-ddaa-4286-953f-2094366cb1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:24.629865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f755682-ddaa-4286-953f-2094366cb1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:24.632627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f755682-ddaa-4286-953f-2094366cb1b0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:24.658164 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879b220-cee4-4150-bbd8-452b1173454e service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:24.669561 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 882/1765] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:24.673610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f755682-ddaa-4286-953f-2094366cb1b0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:24.682578 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e6274-2254-45c3-ab88-651a17c0e0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:24.683660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e6274-2254-45c3-ab88-651a17c0e0ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:24.684027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e6274-2254-45c3-ab88-651a17c0e0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:24.684601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e6274-2254-45c3-ab88-651a17c0e0ff admin admin] PATH_INFO: `/v3/projects/cffe850b57b64f2a9806354ed5f0fe0d/users/a6905f0372944670b644f081ae6f0703/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:24.687587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f755682-ddaa-4286-953f-2094366cb1b0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:24.689516 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e6274-2254-45c3-ab88-651a17c0e0ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cffe850b57b64f2a9806354ed5f0fe0d, user_id=a6905f0372944670b644f081ae6f0703, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:24.697897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e6274-2254-45c3-ab88-651a17c0e0ff admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:24.700463 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154858c-3bbb-490f-962c-e12a602e9ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:24.701372 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154858c-3bbb-490f-962c-e12a602e9ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:24.701601 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154858c-3bbb-490f-962c-e12a602e9ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:24.702113 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154858c-3bbb-490f-962c-e12a602e9ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:24.703037 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154858c-3bbb-490f-962c-e12a602e9ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:24.708628 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154858c-3bbb-490f-962c-e12a602e9ed3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:24.724985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 884/1766] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:24 2022] PUT /identity/v3/projects/cffe850b57b64f2a9806354ed5f0fe0d/users/a6905f0372944670b644f081ae6f0703/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:24.730048 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 883/1767] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:24.734041 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e6274-2254-45c3-ab88-651a17c0e0ff admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:24.747401 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bce63-6444-45b5-9235-277db0530281 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:24.747793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bce63-6444-45b5-9235-277db0530281 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:24.748151 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bce63-6444-45b5-9235-277db0530281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:24.880338 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-bf5bce63-6444-45b5-9235-277db0530281 None None] MFA Rules not processed for user `a6905f0372944670b644f081ae6f0703`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:24.881586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bf5bce63-6444-45b5-9235-277db0530281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:24.991524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:25.085071 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e6274-2254-45c3-ab88-651a17c0e0ff admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:25.100491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2dc88-ed49-4e44-9bb5-6adf1687d947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:25.101484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2dc88-ed49-4e44-9bb5-6adf1687d947 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:25.101843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2dc88-ed49-4e44-9bb5-6adf1687d947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:25.102152 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2dc88-ed49-4e44-9bb5-6adf1687d947 admin admin] PATH_INFO: `/v3/projects/cd18f6d40b264124ad9077196e2e6420/users/629913adc964452a81fce96db323760f/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:25.125188 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2dc88-ed49-4e44-9bb5-6adf1687d947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd18f6d40b264124ad9077196e2e6420, user_id=629913adc964452a81fce96db323760f, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:25.130637 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2dc88-ed49-4e44-9bb5-6adf1687d947 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:25.178098 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 885/1768] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:24 2022] PUT /identity/v3/projects/cd18f6d40b264124ad9077196e2e6420/users/629913adc964452a81fce96db323760f/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:25.193705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c4dc5-a3b4-4ae3-806c-6ba754072624 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:25.195664 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c4dc5-a3b4-4ae3-806c-6ba754072624 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:25.195837 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c4dc5-a3b4-4ae3-806c-6ba754072624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:25.217951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 884/1769] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:25.277535 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-595c4dc5-a3b4-4ae3-806c-6ba754072624 None None] MFA Rules not processed for user `629913adc964452a81fce96db323760f`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:25.280562 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-595c4dc5-a3b4-4ae3-806c-6ba754072624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:25.391353 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bce63-6444-45b5-9235-277db0530281 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:25.393866 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bf5bce63-6444-45b5-9235-277db0530281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:25.479917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 886/1770] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:25.490508 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c4dc5-a3b4-4ae3-806c-6ba754072624 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:25.546823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bce63-6444-45b5-9235-277db0530281 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:25.578714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:25.596795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c4dc5-a3b4-4ae3-806c-6ba754072624 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:25.602672 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61664ed3-a872-474a-870d-e0ce910d5272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:25.603949 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61664ed3-a872-474a-870d-e0ce910d5272 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:25.604829 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61664ed3-a872-474a-870d-e0ce910d5272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:25.605453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61664ed3-a872-474a-870d-e0ce910d5272 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:25.606535 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61664ed3-a872-474a-870d-e0ce910d5272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:25.609089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61664ed3-a872-474a-870d-e0ce910d5272 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:25.649770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17da90-66ce-4956-9e62-8da1c10799b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:25.650856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17da90-66ce-4956-9e62-8da1c10799b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:25.651377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17da90-66ce-4956-9e62-8da1c10799b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:25.651881 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17da90-66ce-4956-9e62-8da1c10799b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:25.655226 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 887/1771] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:25 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:25.659965 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61664ed3-a872-474a-870d-e0ce910d5272 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:25.757808 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17da90-66ce-4956-9e62-8da1c10799b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:25.759274 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17da90-66ce-4956-9e62-8da1c10799b2 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:25.762774 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61664ed3-a872-474a-870d-e0ce910d5272 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:25.768162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b62297-b668-426b-a5ea-53f71e56ef55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:25.769259 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b62297-b668-426b-a5ea-53f71e56ef55 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:25.769671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b62297-b668-426b-a5ea-53f71e56ef55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:25.769971 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b62297-b668-426b-a5ea-53f71e56ef55 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:25.770678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b62297-b668-426b-a5ea-53f71e56ef55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:25.772468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 885/1772] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:06:25.772748 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b62297-b668-426b-a5ea-53f71e56ef55 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:25.807553 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 888/1773] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:25 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:25.818258 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17da90-66ce-4956-9e62-8da1c10799b2 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:25.842227 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17da90-66ce-4956-9e62-8da1c10799b2 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:25.848139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027eb07-fd9e-4794-87fa-7089a35348e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:25.849192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027eb07-fd9e-4794-87fa-7089a35348e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:25.849481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027eb07-fd9e-4794-87fa-7089a35348e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:25.849801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027eb07-fd9e-4794-87fa-7089a35348e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:25.850676 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027eb07-fd9e-4794-87fa-7089a35348e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:25.853311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027eb07-fd9e-4794-87fa-7089a35348e7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:25.876049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 886/1774] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:25.877567 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b62297-b668-426b-a5ea-53f71e56ef55 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:25.897403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b62297-b668-426b-a5ea-53f71e56ef55 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:25.906504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69fd05-44d7-49bf-8f1d-f32abb99b1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:25.907534 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69fd05-44d7-49bf-8f1d-f32abb99b1a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:25.907821 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69fd05-44d7-49bf-8f1d-f32abb99b1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:25.908196 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69fd05-44d7-49bf-8f1d-f32abb99b1a8 admin admin] PATH_INFO: `/v3/projects/25d99bd51de2439c916ffb5107af225e/users/682a0becab9c4969bf6d23364d2c32d7/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:25.950765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69fd05-44d7-49bf-8f1d-f32abb99b1a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d99bd51de2439c916ffb5107af225e, user_id=682a0becab9c4969bf6d23364d2c32d7, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:25.961310 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69fd05-44d7-49bf-8f1d-f32abb99b1a8 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:25.972830 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027eb07-fd9e-4794-87fa-7089a35348e7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:25.990724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 889/1775] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:25 2022] PUT /identity/v3/projects/25d99bd51de2439c916ffb5107af225e/users/682a0becab9c4969bf6d23364d2c32d7/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:26.003338 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:26.009325 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69fd05-44d7-49bf-8f1d-f32abb99b1a8 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:26.147655 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027eb07-fd9e-4794-87fa-7089a35348e7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:26.208962 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8fa73-fd0d-4ce7-bfb8-d4baad13ba00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:26.210090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8fa73-fd0d-4ce7-bfb8-d4baad13ba00 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:26.210616 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8fa73-fd0d-4ce7-bfb8-d4baad13ba00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:26.211110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8fa73-fd0d-4ce7-bfb8-d4baad13ba00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:26.213601 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bca8fa73-fd0d-4ce7-bfb8-d4baad13ba00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:26.243790 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69fd05-44d7-49bf-8f1d-f32abb99b1a8 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:26.250718 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7b34e-86c2-47d6-8c9c-bbfb12e01b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:26.251425 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7b34e-86c2-47d6-8c9c-bbfb12e01b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:26.251716 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7b34e-86c2-47d6-8c9c-bbfb12e01b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:26.252002 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7b34e-86c2-47d6-8c9c-bbfb12e01b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:26.252757 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7b34e-86c2-47d6-8c9c-bbfb12e01b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:26.254804 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7b34e-86c2-47d6-8c9c-bbfb12e01b15 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:26.267425 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 890/1776] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:26.273898 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7b34e-86c2-47d6-8c9c-bbfb12e01b15 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:26.287344 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7b34e-86c2-47d6-8c9c-bbfb12e01b15 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:26.306406 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8fa73-fd0d-4ce7-bfb8-d4baad13ba00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:26.308494 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8fa73-fd0d-4ce7-bfb8-d4baad13ba00 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:26.321894 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14116c13-d95e-4599-9f82-a1483518a8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:26.323161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14116c13-d95e-4599-9f82-a1483518a8bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:26.323734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14116c13-d95e-4599-9f82-a1483518a8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:26.324562 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14116c13-d95e-4599-9f82-a1483518a8bb admin admin] PATH_INFO: `/v3/projects/25d99bd51de2439c916ffb5107af225e/users/682a0becab9c4969bf6d23364d2c32d7/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:26.329312 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14116c13-d95e-4599-9f82-a1483518a8bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d99bd51de2439c916ffb5107af225e, user_id=682a0becab9c4969bf6d23364d2c32d7, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:26.334177 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14116c13-d95e-4599-9f82-a1483518a8bb admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:26.350593 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 887/1777] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:06:26.382287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 891/1778] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:26 2022] PUT /identity/v3/projects/25d99bd51de2439c916ffb5107af225e/users/682a0becab9c4969bf6d23364d2c32d7/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:26.396318 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2563fb9-8f65-4952-8f34-5233ce123eda None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:26.396608 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2563fb9-8f65-4952-8f34-5233ce123eda None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:26.396893 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2563fb9-8f65-4952-8f34-5233ce123eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:26.451464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b2563fb9-8f65-4952-8f34-5233ce123eda None None] MFA Rules not processed for user `682a0becab9c4969bf6d23364d2c32d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:26.453162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b2563fb9-8f65-4952-8f34-5233ce123eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:26.614719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 888/1779] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:26 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:26.681938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14116c13-d95e-4599-9f82-a1483518a8bb admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:26.685263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-14116c13-d95e-4599-9f82-a1483518a8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:26.756940 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:26.831469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14116c13-d95e-4599-9f82-a1483518a8bb admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:26.842594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c93fc-aa40-4049-ad65-fa71023e2f2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:26.843327 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c93fc-aa40-4049-ad65-fa71023e2f2c service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:26.843615 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c93fc-aa40-4049-ad65-fa71023e2f2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:26.843894 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c93fc-aa40-4049-ad65-fa71023e2f2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:26.858408 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c93fc-aa40-4049-ad65-fa71023e2f2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:26.859954 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c93fc-aa40-4049-ad65-fa71023e2f2c service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:26.888607 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 892/1780] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:26 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:27.084335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2563fb9-8f65-4952-8f34-5233ce123eda None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:27.096052 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2563fb9-8f65-4952-8f34-5233ce123eda None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:27.105553 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3028c9c-2888-4355-9d17-9aa383eddaa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:27.106624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3028c9c-2888-4355-9d17-9aa383eddaa1 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:27.107430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3028c9c-2888-4355-9d17-9aa383eddaa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:27.107732 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3028c9c-2888-4355-9d17-9aa383eddaa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:27.114490 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:27.181947 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3028c9c-2888-4355-9d17-9aa383eddaa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:27.184015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3028c9c-2888-4355-9d17-9aa383eddaa1 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:27.192942 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 889/1781] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:30.778010 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c93fc-aa40-4049-ad65-fa71023e2f2c service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:30.852377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c93fc-aa40-4049-ad65-fa71023e2f2c service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:30.857476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa5df1-3cb2-40b6-9b72-d7ae32d23dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:30.858411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa5df1-3cb2-40b6-9b72-d7ae32d23dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:30.858700 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa5df1-3cb2-40b6-9b72-d7ae32d23dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:30.858979 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa5df1-3cb2-40b6-9b72-d7ae32d23dd1 admin admin] PATH_INFO: `/v3/users/629913adc964452a81fce96db323760f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:30.860235 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa5df1-3cb2-40b6-9b72-d7ae32d23dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=629913adc964452a81fce96db323760f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:30.862281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa5df1-3cb2-40b6-9b72-d7ae32d23dd1 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:30.915643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-75aa5df1-3cb2-40b6-9b72-d7ae32d23dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '629913adc964452a81fce96db323760f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:30.923291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-75aa5df1-3cb2-40b6-9b72-d7ae32d23dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '629913adc964452a81fce96db323760f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:30.935875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-75aa5df1-3cb2-40b6-9b72-d7ae32d23dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '629913adc964452a81fce96db323760f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:30.936678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-75aa5df1-3cb2-40b6-9b72-d7ae32d23dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '629913adc964452a81fce96db323760f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:30.937356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-75aa5df1-3cb2-40b6-9b72-d7ae32d23dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '629913adc964452a81fce96db323760f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:30.950802 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 893/1782] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:30 2022] DELETE /identity/v3/users/629913adc964452a81fce96db323760f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:30.955686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20091746-6bff-4328-80a8-604e60807ebc None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:30.956183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20091746-6bff-4328-80a8-604e60807ebc None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:30.956270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20091746-6bff-4328-80a8-604e60807ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:30.974284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-20091746-6bff-4328-80a8-604e60807ebc None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:30.975511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-20091746-6bff-4328-80a8-604e60807ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:31.035379 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 890/1783] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:31.045047 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa5df1-3cb2-40b6-9b72-d7ae32d23dd1 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:31.046756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-75aa5df1-3cb2-40b6-9b72-d7ae32d23dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:31.113483 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:31.119884 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa5df1-3cb2-40b6-9b72-d7ae32d23dd1 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:31.127382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb1685-1d5e-4fa0-b19f-8078cac13059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:31.128871 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb1685-1d5e-4fa0-b19f-8078cac13059 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:31.130314 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb1685-1d5e-4fa0-b19f-8078cac13059 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:31.130824 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb1685-1d5e-4fa0-b19f-8078cac13059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:31.145328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb1685-1d5e-4fa0-b19f-8078cac13059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:31.147235 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb1685-1d5e-4fa0-b19f-8078cac13059 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:31.169062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 894/1784] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:31.815845 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20091746-6bff-4328-80a8-604e60807ebc None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:31.818032 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-20091746-6bff-4328-80a8-604e60807ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:31.833523 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20091746-6bff-4328-80a8-604e60807ebc None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:31.839310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b9469-c3e4-45fa-9899-12884b80d7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:31.840623 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b9469-c3e4-45fa-9899-12884b80d7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:31.840989 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b9469-c3e4-45fa-9899-12884b80d7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:31.841520 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b9469-c3e4-45fa-9899-12884b80d7d7 admin admin] PATH_INFO: `/v3/projects/cd18f6d40b264124ad9077196e2e6420` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:31.843052 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b9469-c3e4-45fa-9899-12884b80d7d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd18f6d40b264124ad9077196e2e6420)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:31.845189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b9469-c3e4-45fa-9899-12884b80d7d7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:31.897594 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-708b9469-c3e4-45fa-9899-12884b80d7d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd18f6d40b264124ad9077196e2e6420', 'request_id': 'req-708b9469-c3e4-45fa-9899-12884b80d7d7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:31.906123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-708b9469-c3e4-45fa-9899-12884b80d7d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd18f6d40b264124ad9077196e2e6420', 'request_id': 'req-708b9469-c3e4-45fa-9899-12884b80d7d7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:31.912612 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-708b9469-c3e4-45fa-9899-12884b80d7d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd18f6d40b264124ad9077196e2e6420', 'request_id': 'req-708b9469-c3e4-45fa-9899-12884b80d7d7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:31.923299 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-708b9469-c3e4-45fa-9899-12884b80d7d7 admin admin] The token cache is being invalidate because project cd18f6d40b264124ad9077196e2e6420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:31.923583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-708b9469-c3e4-45fa-9899-12884b80d7d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:31.924261 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-708b9469-c3e4-45fa-9899-12884b80d7d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:31.925870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 891/1785] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:31 2022] DELETE /identity/v3/projects/cd18f6d40b264124ad9077196e2e6420 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:31.930046 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb1685-1d5e-4fa0-b19f-8078cac13059 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:31.940670 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb1685-1d5e-4fa0-b19f-8078cac13059 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:32.000124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a4f29-03a3-450e-b6fc-6a63b8aa31af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:32.001224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a4f29-03a3-450e-b6fc-6a63b8aa31af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:32.001513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a4f29-03a3-450e-b6fc-6a63b8aa31af admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:32.001826 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a4f29-03a3-450e-b6fc-6a63b8aa31af admin admin] PATH_INFO: `/v3/users/682a0becab9c4969bf6d23364d2c32d7` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:32.003285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a4f29-03a3-450e-b6fc-6a63b8aa31af admin admin] RBAC: Authorizing `identity:delete_user(user_id=682a0becab9c4969bf6d23364d2c32d7)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:32.005289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a4f29-03a3-450e-b6fc-6a63b8aa31af admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:32.056120 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-570a4f29-03a3-450e-b6fc-6a63b8aa31af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '682a0becab9c4969bf6d23364d2c32d7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:32.065777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-570a4f29-03a3-450e-b6fc-6a63b8aa31af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '682a0becab9c4969bf6d23364d2c32d7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:32.079276 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-570a4f29-03a3-450e-b6fc-6a63b8aa31af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '682a0becab9c4969bf6d23364d2c32d7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:32.080008 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-570a4f29-03a3-450e-b6fc-6a63b8aa31af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '682a0becab9c4969bf6d23364d2c32d7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:32.080618 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-570a4f29-03a3-450e-b6fc-6a63b8aa31af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '682a0becab9c4969bf6d23364d2c32d7'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:32.095761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 895/1786] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:31 2022] DELETE /identity/v3/users/682a0becab9c4969bf6d23364d2c32d7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:06:32.415993 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b9469-c3e4-45fa-9899-12884b80d7d7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:32.417684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-708b9469-c3e4-45fa-9899-12884b80d7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:32.432332 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b9469-c3e4-45fa-9899-12884b80d7d7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:32.464280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:32.516552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f63e76-eafc-400a-b5f9-1721ecbd586f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:32.517509 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f63e76-eafc-400a-b5f9-1721ecbd586f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:32.517900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f63e76-eafc-400a-b5f9-1721ecbd586f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:32.518256 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f63e76-eafc-400a-b5f9-1721ecbd586f admin admin] PATH_INFO: `/v3/projects/25d99bd51de2439c916ffb5107af225e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:32.519709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f63e76-eafc-400a-b5f9-1721ecbd586f admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d99bd51de2439c916ffb5107af225e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:32.521834 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f63e76-eafc-400a-b5f9-1721ecbd586f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:32.581870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a8f63e76-eafc-400a-b5f9-1721ecbd586f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d99bd51de2439c916ffb5107af225e', 'request_id': 'req-a8f63e76-eafc-400a-b5f9-1721ecbd586f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:32.591437 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a8f63e76-eafc-400a-b5f9-1721ecbd586f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d99bd51de2439c916ffb5107af225e', 'request_id': 'req-a8f63e76-eafc-400a-b5f9-1721ecbd586f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:32.599167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a8f63e76-eafc-400a-b5f9-1721ecbd586f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d99bd51de2439c916ffb5107af225e', 'request_id': 'req-a8f63e76-eafc-400a-b5f9-1721ecbd586f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:32.610746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a8f63e76-eafc-400a-b5f9-1721ecbd586f admin admin] The token cache is being invalidate because project 25d99bd51de2439c916ffb5107af225e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:32.611033 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a8f63e76-eafc-400a-b5f9-1721ecbd586f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:32.611711 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a8f63e76-eafc-400a-b5f9-1721ecbd586f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:32.613569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 892/1787] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:32 2022] DELETE /identity/v3/projects/25d99bd51de2439c916ffb5107af225e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:06:32.619612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805cdf6-d711-4930-a066-4f3d0ee8734c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:32.619980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805cdf6-d711-4930-a066-4f3d0ee8734c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:32.620322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805cdf6-d711-4930-a066-4f3d0ee8734c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:32.642851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-1805cdf6-d711-4930-a066-4f3d0ee8734c None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:32.644414 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1805cdf6-d711-4930-a066-4f3d0ee8734c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:32.772872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 896/1788] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:32.781611 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aeb81-e927-4c73-a4f9-4811f958b991 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:32.781936 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aeb81-e927-4c73-a4f9-4811f958b991 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:32.782226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aeb81-e927-4c73-a4f9-4811f958b991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:32.812026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2a7aeb81-e927-4c73-a4f9-4811f958b991 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:32.814076 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2a7aeb81-e927-4c73-a4f9-4811f958b991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:32.826460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 893/1789] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:32.830761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805cdf6-d711-4930-a066-4f3d0ee8734c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:32.842771 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805cdf6-d711-4930-a066-4f3d0ee8734c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:32.847779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1178b-b9d8-4645-8fe7-58bc1e30a847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:32.848812 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1178b-b9d8-4645-8fe7-58bc1e30a847 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:32.849846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1178b-b9d8-4645-8fe7-58bc1e30a847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:32.849846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1178b-b9d8-4645-8fe7-58bc1e30a847 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:32.850464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1178b-b9d8-4645-8fe7-58bc1e30a847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:06:32.850888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1178b-b9d8-4645-8fe7-58bc1e30a847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:32.853178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1178b-b9d8-4645-8fe7-58bc1e30a847 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:32.860448 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:32.870134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 897/1790] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:06:32.876581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aeb81-e927-4c73-a4f9-4811f958b991 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:32.889483 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aeb81-e927-4c73-a4f9-4811f958b991 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:32.894401 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c82ce-f29e-4b90-946c-dc6e16e1d9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:32.895088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c82ce-f29e-4b90-946c-dc6e16e1d9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:32.895362 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c82ce-f29e-4b90-946c-dc6e16e1d9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:32.895632 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c82ce-f29e-4b90-946c-dc6e16e1d9d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:32.898579 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c82ce-f29e-4b90-946c-dc6e16e1d9d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:32.901064 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c82ce-f29e-4b90-946c-dc6e16e1d9d5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:32.933165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 894/1791] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:32 2022] POST /identity/v3/projects => generated 399 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:32.937675 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1178b-b9d8-4645-8fe7-58bc1e30a847 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:32.948477 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1178b-b9d8-4645-8fe7-58bc1e30a847 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:33.017914 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f633641-b269-4f3c-846e-cb09fd855de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:33.018713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f633641-b269-4f3c-846e-cb09fd855de3 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:33.019006 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f633641-b269-4f3c-846e-cb09fd855de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:33.019287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f633641-b269-4f3c-846e-cb09fd855de3 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:33.019988 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f633641-b269-4f3c-846e-cb09fd855de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:33.021996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f633641-b269-4f3c-846e-cb09fd855de3 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:33.049399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 898/1792] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:32 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:33.053427 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c82ce-f29e-4b90-946c-dc6e16e1d9d5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:33.065650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c82ce-f29e-4b90-946c-dc6e16e1d9d5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:33.071023 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d92173-9a03-4199-a6c5-0b35ffec13e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:33.071713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d92173-9a03-4199-a6c5-0b35ffec13e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:33.071997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d92173-9a03-4199-a6c5-0b35ffec13e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:33.072274 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d92173-9a03-4199-a6c5-0b35ffec13e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:33.073016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d92173-9a03-4199-a6c5-0b35ffec13e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:33.074718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d92173-9a03-4199-a6c5-0b35ffec13e5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:33.086478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 895/1793] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:33.091070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f633641-b269-4f3c-846e-cb09fd855de3 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:33.101919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f633641-b269-4f3c-846e-cb09fd855de3 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:33.107732 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b7002-67a4-4891-add2-dea94fb4b825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:33.108464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b7002-67a4-4891-add2-dea94fb4b825 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:33.108857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b7002-67a4-4891-add2-dea94fb4b825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:33.109143 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b7002-67a4-4891-add2-dea94fb4b825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:33.109928 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b7002-67a4-4891-add2-dea94fb4b825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:33.111709 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b7002-67a4-4891-add2-dea94fb4b825 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:33.126742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 899/1794] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:33.127983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d92173-9a03-4199-a6c5-0b35ffec13e5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:33.140089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d92173-9a03-4199-a6c5-0b35ffec13e5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:33.144854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42a55f-9663-4c8b-85da-97feec06c8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:33.145797 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42a55f-9663-4c8b-85da-97feec06c8ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:33.146086 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42a55f-9663-4c8b-85da-97feec06c8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:33.146362 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42a55f-9663-4c8b-85da-97feec06c8ff admin admin] PATH_INFO: `/v3/projects/b214e1a94e8640e79791d7c5eb865196/users/f0056fd08dbf41afab36dce7bde3b660/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:33.165366 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42a55f-9663-4c8b-85da-97feec06c8ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b214e1a94e8640e79791d7c5eb865196, user_id=f0056fd08dbf41afab36dce7bde3b660, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:33.168184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42a55f-9663-4c8b-85da-97feec06c8ff admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:33.187500 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 896/1795] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:33 2022] PUT /identity/v3/projects/b214e1a94e8640e79791d7c5eb865196/users/f0056fd08dbf41afab36dce7bde3b660/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:06:33.208148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f859b18-9c5e-46e3-af6a-fd7821ccf091 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:33.208681 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f859b18-9c5e-46e3-af6a-fd7821ccf091 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:33.209187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f859b18-9c5e-46e3-af6a-fd7821ccf091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:33.246449 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-1f859b18-9c5e-46e3-af6a-fd7821ccf091 None None] MFA Rules not processed for user `f0056fd08dbf41afab36dce7bde3b660`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:33.247877 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1f859b18-9c5e-46e3-af6a-fd7821ccf091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:33.316971 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 900/1796] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:33.321484 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42a55f-9663-4c8b-85da-97feec06c8ff admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:33.383963 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:33.392675 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42a55f-9663-4c8b-85da-97feec06c8ff admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:33.400148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c74aae-22c1-4496-b775-e28ef4a56983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:33.401135 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c74aae-22c1-4496-b775-e28ef4a56983 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:33.401474 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c74aae-22c1-4496-b775-e28ef4a56983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:33.401851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c74aae-22c1-4496-b775-e28ef4a56983 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:33.403020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c74aae-22c1-4496-b775-e28ef4a56983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:33.405255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c74aae-22c1-4496-b775-e28ef4a56983 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:33.432430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 897/1797] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:33 2022] POST /identity/v3/projects => generated 399 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:33.437095 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f859b18-9c5e-46e3-af6a-fd7821ccf091 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:33.452058 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f859b18-9c5e-46e3-af6a-fd7821ccf091 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:33.511248 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc50ef-d0c5-4b53-a0bd-cdbddb0c221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:33.512731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc50ef-d0c5-4b53-a0bd-cdbddb0c221d admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:33.512880 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc50ef-d0c5-4b53-a0bd-cdbddb0c221d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:33.513156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc50ef-d0c5-4b53-a0bd-cdbddb0c221d admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:33.513875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc50ef-d0c5-4b53-a0bd-cdbddb0c221d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:33.515807 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc50ef-d0c5-4b53-a0bd-cdbddb0c221d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:33.526622 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:33.542180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 901/1798] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:33 2022] POST /identity/v3/users => generated 306 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:33.546828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c74aae-22c1-4496-b775-e28ef4a56983 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:33.557357 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c74aae-22c1-4496-b775-e28ef4a56983 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:33.562091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd638880-9ecf-402c-8c4f-15fe6705ad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:33.562992 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd638880-9ecf-402c-8c4f-15fe6705ad53 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:33.563116 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd638880-9ecf-402c-8c4f-15fe6705ad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:33.563304 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd638880-9ecf-402c-8c4f-15fe6705ad53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:33.564046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd638880-9ecf-402c-8c4f-15fe6705ad53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:33.566078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd638880-9ecf-402c-8c4f-15fe6705ad53 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:33.578997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 898/1799] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:33.583324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc50ef-d0c5-4b53-a0bd-cdbddb0c221d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:33.595548 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc50ef-d0c5-4b53-a0bd-cdbddb0c221d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:33.600593 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e98f0d-11a4-44b4-acf7-246960c94e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:33.601522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e98f0d-11a4-44b4-acf7-246960c94e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:33.602352 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e98f0d-11a4-44b4-acf7-246960c94e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:33.602352 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e98f0d-11a4-44b4-acf7-246960c94e91 admin admin] PATH_INFO: `/v3/projects/ec2562f8a7db4178ac7e239acc86e8f4/users/e806d9c121d9465085f6519c7645760e/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:33.620720 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e98f0d-11a4-44b4-acf7-246960c94e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec2562f8a7db4178ac7e239acc86e8f4, user_id=e806d9c121d9465085f6519c7645760e, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:33.624280 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e98f0d-11a4-44b4-acf7-246960c94e91 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:33.639263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 902/1800] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:33 2022] PUT /identity/v3/projects/ec2562f8a7db4178ac7e239acc86e8f4/users/e806d9c121d9465085f6519c7645760e/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:33.645355 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd638880-9ecf-402c-8c4f-15fe6705ad53 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:33.658481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd638880-9ecf-402c-8c4f-15fe6705ad53 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:33.726434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f14fb8-86d5-41fb-b494-75447fe93c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:33.726596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f14fb8-86d5-41fb-b494-75447fe93c08 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:33.726755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f14fb8-86d5-41fb-b494-75447fe93c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:33.727027 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f14fb8-86d5-41fb-b494-75447fe93c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:33.727779 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f14fb8-86d5-41fb-b494-75447fe93c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:33.729445 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f14fb8-86d5-41fb-b494-75447fe93c08 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:33.741790 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 899/1801] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:33.746474 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e98f0d-11a4-44b4-acf7-246960c94e91 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:33.760762 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e98f0d-11a4-44b4-acf7-246960c94e91 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:33.767272 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e02de-b0d7-4fee-bd2f-94c2662d7842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:33.768187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e02de-b0d7-4fee-bd2f-94c2662d7842 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:33.768776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e02de-b0d7-4fee-bd2f-94c2662d7842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:33.769056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e02de-b0d7-4fee-bd2f-94c2662d7842 admin admin] PATH_INFO: `/v3/projects/ec2562f8a7db4178ac7e239acc86e8f4/users/e806d9c121d9465085f6519c7645760e/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:33.771256 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e02de-b0d7-4fee-bd2f-94c2662d7842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec2562f8a7db4178ac7e239acc86e8f4, user_id=e806d9c121d9465085f6519c7645760e, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:33.774662 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e02de-b0d7-4fee-bd2f-94c2662d7842 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:33.788460 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 903/1802] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:33 2022] PUT /identity/v3/projects/ec2562f8a7db4178ac7e239acc86e8f4/users/e806d9c121d9465085f6519c7645760e/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:33.800556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae15545-1cc4-4ab7-9684-d656ce83b080 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:33.801139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae15545-1cc4-4ab7-9684-d656ce83b080 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:33.801458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae15545-1cc4-4ab7-9684-d656ce83b080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:33.834215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-aae15545-1cc4-4ab7-9684-d656ce83b080 None None] MFA Rules not processed for user `e806d9c121d9465085f6519c7645760e`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:33.835491 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-aae15545-1cc4-4ab7-9684-d656ce83b080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:33.920154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 900/1803] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:33 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:33.931337 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e02de-b0d7-4fee-bd2f-94c2662d7842 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:33.933094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8e2e02de-b0d7-4fee-bd2f-94c2662d7842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:34.009556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e02de-b0d7-4fee-bd2f-94c2662d7842 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:34.016918 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc4db2-3384-4d27-b291-dcd47216cba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:34.017891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc4db2-3384-4d27-b291-dcd47216cba9 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:34.018368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc4db2-3384-4d27-b291-dcd47216cba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:34.019327 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc4db2-3384-4d27-b291-dcd47216cba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:34.034373 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc4db2-3384-4d27-b291-dcd47216cba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:34.036473 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc4db2-3384-4d27-b291-dcd47216cba9 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:34.052294 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 904/1804] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:33 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:34.172554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae15545-1cc4-4ab7-9684-d656ce83b080 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:34.186891 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae15545-1cc4-4ab7-9684-d656ce83b080 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:34.193722 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1094a-884c-4fae-8e3b-e3cfea8b0fd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:34.194958 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1094a-884c-4fae-8e3b-e3cfea8b0fd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:34.195543 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1094a-884c-4fae-8e3b-e3cfea8b0fd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:34.196122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1094a-884c-4fae-8e3b-e3cfea8b0fd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:34.288532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:34.305085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1094a-884c-4fae-8e3b-e3cfea8b0fd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:34.306908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1094a-884c-4fae-8e3b-e3cfea8b0fd9 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:34.318397 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 901/1805] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:37.982032 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc4db2-3384-4d27-b291-dcd47216cba9 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:37.984158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b4bc4db2-3384-4d27-b291-dcd47216cba9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:38.174363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc4db2-3384-4d27-b291-dcd47216cba9 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:38.181832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802dfcb-987b-422d-8f96-209fce0db684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:38.182745 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802dfcb-987b-422d-8f96-209fce0db684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:38.183038 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802dfcb-987b-422d-8f96-209fce0db684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:38.183847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802dfcb-987b-422d-8f96-209fce0db684 admin admin] PATH_INFO: `/v3/users/5afc99b98ca6474ab5e27dd756ab0881` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:38.185628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802dfcb-987b-422d-8f96-209fce0db684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5afc99b98ca6474ab5e27dd756ab0881)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:38.187707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802dfcb-987b-422d-8f96-209fce0db684 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:38.305406 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1802dfcb-987b-422d-8f96-209fce0db684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5afc99b98ca6474ab5e27dd756ab0881'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:38.317611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1802dfcb-987b-422d-8f96-209fce0db684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5afc99b98ca6474ab5e27dd756ab0881'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:38.325856 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:38.343192 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1802dfcb-987b-422d-8f96-209fce0db684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5afc99b98ca6474ab5e27dd756ab0881'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:38.345501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1802dfcb-987b-422d-8f96-209fce0db684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5afc99b98ca6474ab5e27dd756ab0881'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:38.347600 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1802dfcb-987b-422d-8f96-209fce0db684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5afc99b98ca6474ab5e27dd756ab0881'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:38.372041 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 905/1806] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:37 2022] DELETE /identity/v3/users/5afc99b98ca6474ab5e27dd756ab0881 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:38.375815 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454c32d-01c8-4757-b34e-3932dc97f0c1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:38.376621 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454c32d-01c8-4757-b34e-3932dc97f0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:38.377122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454c32d-01c8-4757-b34e-3932dc97f0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:38.432789 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7454c32d-01c8-4757-b34e-3932dc97f0c1 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:38.434900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7454c32d-01c8-4757-b34e-3932dc97f0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:38.709447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 902/1807] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:06:38.721257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802dfcb-987b-422d-8f96-209fce0db684 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:38.723840 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1802dfcb-987b-422d-8f96-209fce0db684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:38.740181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802dfcb-987b-422d-8f96-209fce0db684 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:38.744239 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454c32d-01c8-4757-b34e-3932dc97f0c1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:38.746382 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7454c32d-01c8-4757-b34e-3932dc97f0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:38.748710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d7e6b-f103-481e-ac20-cba76df2f6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:38.750354 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d7e6b-f103-481e-ac20-cba76df2f6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:38.750816 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d7e6b-f103-481e-ac20-cba76df2f6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:38.751494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d7e6b-f103-481e-ac20-cba76df2f6ce admin admin] PATH_INFO: `/v3/users/fbd2c807068742dd96cd60089b570246` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:38.755867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d7e6b-f103-481e-ac20-cba76df2f6ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd2c807068742dd96cd60089b570246)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:38.758725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d7e6b-f103-481e-ac20-cba76df2f6ce admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:38.889354 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-557d7e6b-f103-481e-ac20-cba76df2f6ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd2c807068742dd96cd60089b570246'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:38.911173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-557d7e6b-f103-481e-ac20-cba76df2f6ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd2c807068742dd96cd60089b570246'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:38.933876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-557d7e6b-f103-481e-ac20-cba76df2f6ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd2c807068742dd96cd60089b570246'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:38.934711 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-557d7e6b-f103-481e-ac20-cba76df2f6ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd2c807068742dd96cd60089b570246'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:38.935431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-557d7e6b-f103-481e-ac20-cba76df2f6ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd2c807068742dd96cd60089b570246'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:38.941445 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454c32d-01c8-4757-b34e-3932dc97f0c1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:38.953967 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3218c8-7def-4c37-9688-c52aeacf7ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:38.955394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3218c8-7def-4c37-9688-c52aeacf7ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:38.955694 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3218c8-7def-4c37-9688-c52aeacf7ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:38.956062 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3218c8-7def-4c37-9688-c52aeacf7ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:38.961176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-af3218c8-7def-4c37-9688-c52aeacf7ae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:38.979160 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3218c8-7def-4c37-9688-c52aeacf7ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:38.982382 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3218c8-7def-4c37-9688-c52aeacf7ae8 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:39.009258 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 903/1808] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:39.012154 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 906/1809] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:38 2022] DELETE /identity/v3/users/fbd2c807068742dd96cd60089b570246 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:39.017090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84546445-03ab-4f51-94d1-9d4735706b9c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:39.017399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84546445-03ab-4f51-94d1-9d4735706b9c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:39.018039 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84546445-03ab-4f51-94d1-9d4735706b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:39.062765 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-84546445-03ab-4f51-94d1-9d4735706b9c None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:39.064368 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-84546445-03ab-4f51-94d1-9d4735706b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:39.256626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 904/1810] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:39.265871 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d7e6b-f103-481e-ac20-cba76df2f6ce admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:39.267445 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-557d7e6b-f103-481e-ac20-cba76df2f6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:39.414160 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d7e6b-f103-481e-ac20-cba76df2f6ce admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:39.419858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e8f9e-09a1-40d9-8c35-ed0e644ffa01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:39.420537 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e8f9e-09a1-40d9-8c35-ed0e644ffa01 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:39.420937 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e8f9e-09a1-40d9-8c35-ed0e644ffa01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:39.421214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e8f9e-09a1-40d9-8c35-ed0e644ffa01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:39.434226 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e8f9e-09a1-40d9-8c35-ed0e644ffa01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:39.447860 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e8f9e-09a1-40d9-8c35-ed0e644ffa01 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:39.471111 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 907/1811] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:40.260040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84546445-03ab-4f51-94d1-9d4735706b9c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:40.262497 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-84546445-03ab-4f51-94d1-9d4735706b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:40.291308 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84546445-03ab-4f51-94d1-9d4735706b9c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:40.295776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e8f9e-09a1-40d9-8c35-ed0e644ffa01 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:40.297414 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-887e8f9e-09a1-40d9-8c35-ed0e644ffa01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:40.298046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee73fc-0846-48f3-af83-07811fd3c13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:40.299231 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee73fc-0846-48f3-af83-07811fd3c13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:40.299606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee73fc-0846-48f3-af83-07811fd3c13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:40.300359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee73fc-0846-48f3-af83-07811fd3c13b admin admin] PATH_INFO: `/v3/projects/358ce588a4a5407e86bf59f775cadc04` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:40.302476 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee73fc-0846-48f3-af83-07811fd3c13b admin admin] RBAC: Authorizing `identity:delete_project(project_id=358ce588a4a5407e86bf59f775cadc04)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:40.304726 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee73fc-0846-48f3-af83-07811fd3c13b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:40.325153 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e8f9e-09a1-40d9-8c35-ed0e644ffa01 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:40.359833 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d135f-97f0-49b4-b5d6-6f38bac04221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:40.361989 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d135f-97f0-49b4-b5d6-6f38bac04221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:40.362257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d135f-97f0-49b4-b5d6-6f38bac04221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:40.363469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d135f-97f0-49b4-b5d6-6f38bac04221 admin admin] PATH_INFO: `/v3/projects/f0b52054909d42ebbfb569c92a9dd372` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:40.365882 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d135f-97f0-49b4-b5d6-6f38bac04221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b52054909d42ebbfb569c92a9dd372)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:40.383188 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d135f-97f0-49b4-b5d6-6f38bac04221 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:40.383681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:40.436119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-92ee73fc-0846-48f3-af83-07811fd3c13b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358ce588a4a5407e86bf59f775cadc04', 'request_id': 'req-92ee73fc-0846-48f3-af83-07811fd3c13b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:40.448219 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-92ee73fc-0846-48f3-af83-07811fd3c13b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358ce588a4a5407e86bf59f775cadc04', 'request_id': 'req-92ee73fc-0846-48f3-af83-07811fd3c13b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:40.459799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-92ee73fc-0846-48f3-af83-07811fd3c13b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358ce588a4a5407e86bf59f775cadc04', 'request_id': 'req-92ee73fc-0846-48f3-af83-07811fd3c13b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:40.493868 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-92ee73fc-0846-48f3-af83-07811fd3c13b admin admin] The token cache is being invalidate because project 358ce588a4a5407e86bf59f775cadc04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:40.494635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-92ee73fc-0846-48f3-af83-07811fd3c13b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:40.495559 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-92ee73fc-0846-48f3-af83-07811fd3c13b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:40.503115 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 905/1812] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:40 2022] DELETE /identity/v3/projects/358ce588a4a5407e86bf59f775cadc04 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:40.504470 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee73fc-0846-48f3-af83-07811fd3c13b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:40.506691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-92ee73fc-0846-48f3-af83-07811fd3c13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:40.570667 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ac1d135f-97f0-49b4-b5d6-6f38bac04221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b52054909d42ebbfb569c92a9dd372', 'request_id': 'req-ac1d135f-97f0-49b4-b5d6-6f38bac04221'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:40.577151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:40.599023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ac1d135f-97f0-49b4-b5d6-6f38bac04221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b52054909d42ebbfb569c92a9dd372', 'request_id': 'req-ac1d135f-97f0-49b4-b5d6-6f38bac04221'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:40.625181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ac1d135f-97f0-49b4-b5d6-6f38bac04221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b52054909d42ebbfb569c92a9dd372', 'request_id': 'req-ac1d135f-97f0-49b4-b5d6-6f38bac04221'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:40.655789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ac1d135f-97f0-49b4-b5d6-6f38bac04221 admin admin] The token cache is being invalidate because project f0b52054909d42ebbfb569c92a9dd372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:40.656475 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ac1d135f-97f0-49b4-b5d6-6f38bac04221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:40.657981 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ac1d135f-97f0-49b4-b5d6-6f38bac04221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:40.660452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 908/1813] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:40 2022] DELETE /identity/v3/projects/f0b52054909d42ebbfb569c92a9dd372 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:40.669250 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d135f-97f0-49b4-b5d6-6f38bac04221 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:40.672267 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ac1d135f-97f0-49b4-b5d6-6f38bac04221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:40.820247 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee73fc-0846-48f3-af83-07811fd3c13b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:40.888363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d135f-97f0-49b4-b5d6-6f38bac04221 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:40.902431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688887e5-e28a-4c7e-b830-b671f5731613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:40.907678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688887e5-e28a-4c7e-b830-b671f5731613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:40.913979 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688887e5-e28a-4c7e-b830-b671f5731613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:40.913979 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688887e5-e28a-4c7e-b830-b671f5731613 admin admin] PATH_INFO: `/v3/users/a6905f0372944670b644f081ae6f0703` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:40.923401 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688887e5-e28a-4c7e-b830-b671f5731613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6905f0372944670b644f081ae6f0703)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:40.930523 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688887e5-e28a-4c7e-b830-b671f5731613 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:41.046889 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dec111-8787-4c95-881e-a72415c76f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:41.049175 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dec111-8787-4c95-881e-a72415c76f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:41.051793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dec111-8787-4c95-881e-a72415c76f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:41.053179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dec111-8787-4c95-881e-a72415c76f27 admin admin] PATH_INFO: `/v3/users/7f35a2a8df9743f0bdec813368682770` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:41.059808 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-688887e5-e28a-4c7e-b830-b671f5731613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6905f0372944670b644f081ae6f0703'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:41.073588 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-688887e5-e28a-4c7e-b830-b671f5731613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6905f0372944670b644f081ae6f0703'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:41.079598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dec111-8787-4c95-881e-a72415c76f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f35a2a8df9743f0bdec813368682770)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:41.090178 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dec111-8787-4c95-881e-a72415c76f27 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:41.097835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-688887e5-e28a-4c7e-b830-b671f5731613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6905f0372944670b644f081ae6f0703'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:41.098860 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-688887e5-e28a-4c7e-b830-b671f5731613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6905f0372944670b644f081ae6f0703'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:41.100550 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-688887e5-e28a-4c7e-b830-b671f5731613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6905f0372944670b644f081ae6f0703'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:41.125320 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 909/1814] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:40 2022] DELETE /identity/v3/users/a6905f0372944670b644f081ae6f0703 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:06:41.203272 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-27dec111-8787-4c95-881e-a72415c76f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f35a2a8df9743f0bdec813368682770'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:41.204136 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-27dec111-8787-4c95-881e-a72415c76f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f35a2a8df9743f0bdec813368682770'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:41.227100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-27dec111-8787-4c95-881e-a72415c76f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f35a2a8df9743f0bdec813368682770'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:41.237780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-27dec111-8787-4c95-881e-a72415c76f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f35a2a8df9743f0bdec813368682770'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:41.241518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:41.265373 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-27dec111-8787-4c95-881e-a72415c76f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f35a2a8df9743f0bdec813368682770'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:41.273404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 906/1815] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:40 2022] DELETE /identity/v3/users/7f35a2a8df9743f0bdec813368682770 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:41.646948 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688887e5-e28a-4c7e-b830-b671f5731613 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:41.648672 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-688887e5-e28a-4c7e-b830-b671f5731613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:41.743904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dec111-8787-4c95-881e-a72415c76f27 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:41.747775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-27dec111-8787-4c95-881e-a72415c76f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:41.783550 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:41.796203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688887e5-e28a-4c7e-b830-b671f5731613 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:41.911018 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f73bc-5266-4f20-af47-cf96ac15c919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:41.911946 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f73bc-5266-4f20-af47-cf96ac15c919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:41.912234 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f73bc-5266-4f20-af47-cf96ac15c919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:41.912507 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f73bc-5266-4f20-af47-cf96ac15c919 admin admin] PATH_INFO: `/v3/users/f0056fd08dbf41afab36dce7bde3b660` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:41.914646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dec111-8787-4c95-881e-a72415c76f27 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:41.916515 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f73bc-5266-4f20-af47-cf96ac15c919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0056fd08dbf41afab36dce7bde3b660)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:41.924275 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f73bc-5266-4f20-af47-cf96ac15c919 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:41.925081 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9cc23-c127-4bed-b139-5cbe78603363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:41.926361 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9cc23-c127-4bed-b139-5cbe78603363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:41.926931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9cc23-c127-4bed-b139-5cbe78603363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:41.927237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9cc23-c127-4bed-b139-5cbe78603363 admin admin] PATH_INFO: `/v3/projects/7e21ff757e0e4f34856d0c0dd5695ec3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:41.929546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9cc23-c127-4bed-b139-5cbe78603363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e21ff757e0e4f34856d0c0dd5695ec3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:41.933614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9cc23-c127-4bed-b139-5cbe78603363 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:42.017333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8d8f73bc-5266-4f20-af47-cf96ac15c919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0056fd08dbf41afab36dce7bde3b660'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:42.048488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0ed9cc23-c127-4bed-b139-5cbe78603363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e21ff757e0e4f34856d0c0dd5695ec3', 'request_id': 'req-0ed9cc23-c127-4bed-b139-5cbe78603363'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:42.070380 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8d8f73bc-5266-4f20-af47-cf96ac15c919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0056fd08dbf41afab36dce7bde3b660'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:42.078303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0ed9cc23-c127-4bed-b139-5cbe78603363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e21ff757e0e4f34856d0c0dd5695ec3', 'request_id': 'req-0ed9cc23-c127-4bed-b139-5cbe78603363'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:42.089283 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0ed9cc23-c127-4bed-b139-5cbe78603363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e21ff757e0e4f34856d0c0dd5695ec3', 'request_id': 'req-0ed9cc23-c127-4bed-b139-5cbe78603363'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:42.098049 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8d8f73bc-5266-4f20-af47-cf96ac15c919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0056fd08dbf41afab36dce7bde3b660'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:42.099393 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8d8f73bc-5266-4f20-af47-cf96ac15c919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0056fd08dbf41afab36dce7bde3b660'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:42.100774 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8d8f73bc-5266-4f20-af47-cf96ac15c919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0056fd08dbf41afab36dce7bde3b660'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:42.128813 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0ed9cc23-c127-4bed-b139-5cbe78603363 admin admin] The token cache is being invalidate because project 7e21ff757e0e4f34856d0c0dd5695ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:42.129052 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 910/1816] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:41 2022] DELETE /identity/v3/users/f0056fd08dbf41afab36dce7bde3b660 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:42.129440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0ed9cc23-c127-4bed-b139-5cbe78603363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:42.132167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f73bc-5266-4f20-af47-cf96ac15c919 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:42.132676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8d8f73bc-5266-4f20-af47-cf96ac15c919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:42.132979 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0ed9cc23-c127-4bed-b139-5cbe78603363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:42.139309 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 907/1817] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:41 2022] DELETE /identity/v3/projects/7e21ff757e0e4f34856d0c0dd5695ec3 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:42.144217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb24ea-66f6-4273-83dc-c45917dcfefc None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:42.144713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb24ea-66f6-4273-83dc-c45917dcfefc None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:42.145226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb24ea-66f6-4273-83dc-c45917dcfefc None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:42.148752 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 908/1818] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 18 17:06:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:06:42.151186 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387e55b-9b40-4e47-8c3a-88cd61f7f4a6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:42.151631 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387e55b-9b40-4e47-8c3a-88cd61f7f4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:42.152674 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387e55b-9b40-4e47-8c3a-88cd61f7f4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:42.197604 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a387e55b-9b40-4e47-8c3a-88cd61f7f4a6 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:42.201231 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a387e55b-9b40-4e47-8c3a-88cd61f7f4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:42.315524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 909/1819] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:42.317864 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29277d2f-5254-4430-810c-d3f29120f26e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:42.318528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29277d2f-5254-4430-810c-d3f29120f26e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:42.319068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29277d2f-5254-4430-810c-d3f29120f26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:42.327852 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f73bc-5266-4f20-af47-cf96ac15c919 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:42.337958 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39a63d-b650-4ed5-a81a-5ea9e2f96291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:42.341214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39a63d-b650-4ed5-a81a-5ea9e2f96291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:42.341914 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39a63d-b650-4ed5-a81a-5ea9e2f96291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:42.342556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39a63d-b650-4ed5-a81a-5ea9e2f96291 admin admin] PATH_INFO: `/v3/projects/cffe850b57b64f2a9806354ed5f0fe0d` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:42.343998 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-29277d2f-5254-4430-810c-d3f29120f26e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:42.345411 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-29277d2f-5254-4430-810c-d3f29120f26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:42.345573 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39a63d-b650-4ed5-a81a-5ea9e2f96291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cffe850b57b64f2a9806354ed5f0fe0d)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:42.350071 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39a63d-b650-4ed5-a81a-5ea9e2f96291 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:42.356723 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 910/1820] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:42.358489 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df7834-c189-49be-a122-f26414f1dc70 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:42.359160 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df7834-c189-49be-a122-f26414f1dc70 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:42.359642 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df7834-c189-49be-a122-f26414f1dc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:42.376104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:42.387238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a1df7834-c189-49be-a122-f26414f1dc70 None None] MFA Rules not processed for user `c9e3c0ef5ed943d183b064f383fc01f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:42.391465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a1df7834-c189-49be-a122-f26414f1dc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:42.432149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:42.512254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 911/1821] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 18 17:06:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:42.514101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df7834-c189-49be-a122-f26414f1dc70 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:42.517500 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a1df7834-c189-49be-a122-f26414f1dc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:42.530148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0f39a63d-b650-4ed5-a81a-5ea9e2f96291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cffe850b57b64f2a9806354ed5f0fe0d', 'request_id': 'req-0f39a63d-b650-4ed5-a81a-5ea9e2f96291'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:42.559219 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0f39a63d-b650-4ed5-a81a-5ea9e2f96291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cffe850b57b64f2a9806354ed5f0fe0d', 'request_id': 'req-0f39a63d-b650-4ed5-a81a-5ea9e2f96291'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:42.589143 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0f39a63d-b650-4ed5-a81a-5ea9e2f96291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cffe850b57b64f2a9806354ed5f0fe0d', 'request_id': 'req-0f39a63d-b650-4ed5-a81a-5ea9e2f96291'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:42.643382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0f39a63d-b650-4ed5-a81a-5ea9e2f96291 admin admin] The token cache is being invalidate because project cffe850b57b64f2a9806354ed5f0fe0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:42.643889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0f39a63d-b650-4ed5-a81a-5ea9e2f96291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:42.645019 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0f39a63d-b650-4ed5-a81a-5ea9e2f96291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:42.649444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 911/1822] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:42 2022] DELETE /identity/v3/projects/cffe850b57b64f2a9806354ed5f0fe0d => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:42.654850 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cfe98-95f6-4fe7-8aba-46d5bbe93bf4 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:42.655712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cfe98-95f6-4fe7-8aba-46d5bbe93bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:42.656174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df7834-c189-49be-a122-f26414f1dc70 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:42.657090 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cfe98-95f6-4fe7-8aba-46d5bbe93bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:42.715973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-8c9cfe98-95f6-4fe7-8aba-46d5bbe93bf4 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:42.717489 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8c9cfe98-95f6-4fe7-8aba-46d5bbe93bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:42.809028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82969678-8ca0-4698-84a2-dd7712bb13a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:42.809512 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969678-8ca0-4698-84a2-dd7712bb13a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:42.812070 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969678-8ca0-4698-84a2-dd7712bb13a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:42.812500 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969678-8ca0-4698-84a2-dd7712bb13a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:42.818730 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-82969678-8ca0-4698-84a2-dd7712bb13a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:42.901134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 912/1823] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:42.903364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72563c72-e0eb-40e4-9acd-78e103a5012c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:42.904020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72563c72-e0eb-40e4-9acd-78e103a5012c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:42.904353 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72563c72-e0eb-40e4-9acd-78e103a5012c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:42.956328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-72563c72-e0eb-40e4-9acd-78e103a5012c None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:42.959579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-72563c72-e0eb-40e4-9acd-78e103a5012c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:42.985870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 913/1824] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:42.987246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72563c72-e0eb-40e4-9acd-78e103a5012c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:42.989073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-72563c72-e0eb-40e4-9acd-78e103a5012c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:43.004237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82969678-8ca0-4698-84a2-dd7712bb13a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:43.005877 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82969678-8ca0-4698-84a2-dd7712bb13a1 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:43.021025 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 912/1825] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:43.022067 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82969678-8ca0-4698-84a2-dd7712bb13a1 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:43.029626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:43.038304 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82969678-8ca0-4698-84a2-dd7712bb13a1 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:43.045913 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58797ef8-beb7-465b-acc0-93f49a5c6be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:43.046621 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58797ef8-beb7-465b-acc0-93f49a5c6be7 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:43.046910 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58797ef8-beb7-465b-acc0-93f49a5c6be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:43.047245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58797ef8-beb7-465b-acc0-93f49a5c6be7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:43.048006 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58797ef8-beb7-465b-acc0-93f49a5c6be7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:06:43.048315 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58797ef8-beb7-465b-acc0-93f49a5c6be7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:43.052074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58797ef8-beb7-465b-acc0-93f49a5c6be7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:43.085180 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 913/1826] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:06:43.086986 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8cfbd-64d3-4402-8d8a-e698bde27ee4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:43.087572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8cfbd-64d3-4402-8d8a-e698bde27ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:43.088065 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8cfbd-64d3-4402-8d8a-e698bde27ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:43.119606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-cea8cfbd-64d3-4402-8d8a-e698bde27ee4 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:43.123138 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cea8cfbd-64d3-4402-8d8a-e698bde27ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:43.136776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 914/1827] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:43.138401 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8cfbd-64d3-4402-8d8a-e698bde27ee4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:43.155572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8cfbd-64d3-4402-8d8a-e698bde27ee4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:43.168642 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149097ce-466d-4f3f-b83b-bd769559d91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:43.170940 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149097ce-466d-4f3f-b83b-bd769559d91c admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:43.171946 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149097ce-466d-4f3f-b83b-bd769559d91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:43.172691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149097ce-466d-4f3f-b83b-bd769559d91c admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:43.174495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149097ce-466d-4f3f-b83b-bd769559d91c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:43.178219 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149097ce-466d-4f3f-b83b-bd769559d91c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:43.215017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72563c72-e0eb-40e4-9acd-78e103a5012c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:43.227812 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 915/1828] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:43 2022] POST /identity/v3/projects => generated 367 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:43.229478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149097ce-466d-4f3f-b83b-bd769559d91c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:43.230926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20be55a-698a-49ed-b66f-05f5e8b90af3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:43.231803 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20be55a-698a-49ed-b66f-05f5e8b90af3 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:43.232099 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20be55a-698a-49ed-b66f-05f5e8b90af3 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:43.233126 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20be55a-698a-49ed-b66f-05f5e8b90af3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:43.236415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a20be55a-698a-49ed-b66f-05f5e8b90af3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:43.269528 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20be55a-698a-49ed-b66f-05f5e8b90af3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:43.271759 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20be55a-698a-49ed-b66f-05f5e8b90af3 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:43.286341 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 914/1829] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:43.287826 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20be55a-698a-49ed-b66f-05f5e8b90af3 service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:43.307420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20be55a-698a-49ed-b66f-05f5e8b90af3 service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:43.331723 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149097ce-466d-4f3f-b83b-bd769559d91c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:43.344003 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13609ec2-0542-409e-bdc4-3824f1ef6461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:43.345408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13609ec2-0542-409e-bdc4-3824f1ef6461 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:43.346042 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13609ec2-0542-409e-bdc4-3824f1ef6461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:43.346544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13609ec2-0542-409e-bdc4-3824f1ef6461 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:43.347561 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13609ec2-0542-409e-bdc4-3824f1ef6461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:06:43.348088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13609ec2-0542-409e-bdc4-3824f1ef6461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:43.351339 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13609ec2-0542-409e-bdc4-3824f1ef6461 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:43.355288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:43.378241 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 916/1830] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:06:43.383672 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13609ec2-0542-409e-bdc4-3824f1ef6461 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:43.403449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13609ec2-0542-409e-bdc4-3824f1ef6461 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:43.403696 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd10069-bb46-46a7-98aa-4995d33ab702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:43.404609 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd10069-bb46-46a7-98aa-4995d33ab702 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:43.404938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd10069-bb46-46a7-98aa-4995d33ab702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:43.405315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd10069-bb46-46a7-98aa-4995d33ab702 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:43.406161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd10069-bb46-46a7-98aa-4995d33ab702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:43.408375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd10069-bb46-46a7-98aa-4995d33ab702 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:43.415170 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fd0a3-4f35-4efd-b9ed-325f2eb767a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:43.416380 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd0a3-4f35-4efd-b9ed-325f2eb767a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:43.416779 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd0a3-4f35-4efd-b9ed-325f2eb767a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:43.417165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd0a3-4f35-4efd-b9ed-325f2eb767a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:43.419855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fd0a3-4f35-4efd-b9ed-325f2eb767a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:43.423092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fd0a3-4f35-4efd-b9ed-325f2eb767a7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:43.443609 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 915/1831] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:43 2022] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:43.444806 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd10069-bb46-46a7-98aa-4995d33ab702 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:43.461593 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd10069-bb46-46a7-98aa-4995d33ab702 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:43.469199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840cacf-855e-4946-a873-f6ae77c0d369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:43.470180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840cacf-855e-4946-a873-f6ae77c0d369 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:43.470695 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840cacf-855e-4946-a873-f6ae77c0d369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:43.471123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840cacf-855e-4946-a873-f6ae77c0d369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:43.472035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840cacf-855e-4946-a873-f6ae77c0d369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:43.476683 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 917/1832] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:43 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:43.478094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840cacf-855e-4946-a873-f6ae77c0d369 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:43.481858 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fd0a3-4f35-4efd-b9ed-325f2eb767a7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:43.520977 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 916/1833] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:43.523094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840cacf-855e-4946-a873-f6ae77c0d369 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:43.537734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840cacf-855e-4946-a873-f6ae77c0d369 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:43.589090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fd0a3-4f35-4efd-b9ed-325f2eb767a7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:43.597323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714c047-a984-44a7-971a-04df895d1c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:43.598115 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714c047-a984-44a7-971a-04df895d1c71 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:43.598760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714c047-a984-44a7-971a-04df895d1c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:43.599228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714c047-a984-44a7-971a-04df895d1c71 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:43.601179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714c047-a984-44a7-971a-04df895d1c71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:43.603307 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714c047-a984-44a7-971a-04df895d1c71 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:43.639560 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 918/1834] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:43 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:43.643631 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714c047-a984-44a7-971a-04df895d1c71 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:43.648135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c973c7-5ea8-44f1-b218-bcf9bd7523e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:43.649238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c973c7-5ea8-44f1-b218-bcf9bd7523e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:43.650000 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c973c7-5ea8-44f1-b218-bcf9bd7523e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:43.652894 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c973c7-5ea8-44f1-b218-bcf9bd7523e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:43.654650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c973c7-5ea8-44f1-b218-bcf9bd7523e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:43.656886 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c973c7-5ea8-44f1-b218-bcf9bd7523e0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:43.657458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714c047-a984-44a7-971a-04df895d1c71 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:43.663751 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384b63b-bed4-4037-bc81-b189dd091023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:43.664544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384b63b-bed4-4037-bc81-b189dd091023 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:43.665078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384b63b-bed4-4037-bc81-b189dd091023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:43.665557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384b63b-bed4-4037-bc81-b189dd091023 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:43.667134 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384b63b-bed4-4037-bc81-b189dd091023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:43.668696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384b63b-bed4-4037-bc81-b189dd091023 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:43.675798 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 917/1835] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:43.683186 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c973c7-5ea8-44f1-b218-bcf9bd7523e0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:43.693356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 919/1836] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:06:43.694609 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384b63b-bed4-4037-bc81-b189dd091023 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:43.701972 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c973c7-5ea8-44f1-b218-bcf9bd7523e0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:43.708681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384b63b-bed4-4037-bc81-b189dd091023 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:43.710328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1026de-1152-4152-a053-3ce7ce797ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:43.711839 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1026de-1152-4152-a053-3ce7ce797ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:43.712305 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1026de-1152-4152-a053-3ce7ce797ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:43.712901 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1026de-1152-4152-a053-3ce7ce797ff2 admin admin] PATH_INFO: `/v3/projects/d4f7bccb3b4f421b8eb47d815684f9b1/users/5e5d160d931341cdb767fb03060f246d/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:43.717581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746c277-7372-48e5-af23-ebe5c08e2d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:43.719088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746c277-7372-48e5-af23-ebe5c08e2d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:43.719437 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746c277-7372-48e5-af23-ebe5c08e2d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:43.719868 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746c277-7372-48e5-af23-ebe5c08e2d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:43.721286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746c277-7372-48e5-af23-ebe5c08e2d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:43.726659 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746c277-7372-48e5-af23-ebe5c08e2d27 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:43.737919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1026de-1152-4152-a053-3ce7ce797ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f7bccb3b4f421b8eb47d815684f9b1, user_id=5e5d160d931341cdb767fb03060f246d, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:43.742292 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1026de-1152-4152-a053-3ce7ce797ff2 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:43.743176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 920/1837] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:43.749300 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746c277-7372-48e5-af23-ebe5c08e2d27 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:43.755537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:43.773451 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746c277-7372-48e5-af23-ebe5c08e2d27 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:43.775435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 918/1838] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:43 2022] PUT /identity/v3/projects/d4f7bccb3b4f421b8eb47d815684f9b1/users/5e5d160d931341cdb767fb03060f246d/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:43.786782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8245154-1b31-489d-824f-7511853c6797 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:43.787073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8245154-1b31-489d-824f-7511853c6797 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:43.787402 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8245154-1b31-489d-824f-7511853c6797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:43.891958 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d8245154-1b31-489d-824f-7511853c6797 None None] MFA Rules not processed for user `5e5d160d931341cdb767fb03060f246d`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:43.893228 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d8245154-1b31-489d-824f-7511853c6797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:43.972227 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538af4ae-dfca-4d9b-a200-1c755cc6e684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:43.974012 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538af4ae-dfca-4d9b-a200-1c755cc6e684 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:43.974916 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538af4ae-dfca-4d9b-a200-1c755cc6e684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:43.976332 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538af4ae-dfca-4d9b-a200-1c755cc6e684 admin admin] PATH_INFO: `/v3/projects/7b00b3f3fe1c41728d153bc8ca171761/users/2c4a6ecf8b7743d7987f88f646692c55/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:44.014890 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538af4ae-dfca-4d9b-a200-1c755cc6e684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b00b3f3fe1c41728d153bc8ca171761, user_id=2c4a6ecf8b7743d7987f88f646692c55, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:44.015906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538af4ae-dfca-4d9b-a200-1c755cc6e684 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:44.060815 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 921/1839] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:43 2022] PUT /identity/v3/projects/7b00b3f3fe1c41728d153bc8ca171761/users/2c4a6ecf8b7743d7987f88f646692c55/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:44.062024 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538af4ae-dfca-4d9b-a200-1c755cc6e684 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:44.066609 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-538af4ae-dfca-4d9b-a200-1c755cc6e684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:44.072703 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 919/1840] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:44.079210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249c1f2-7a34-4d32-9142-4406622298a3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:44.079210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249c1f2-7a34-4d32-9142-4406622298a3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:44.079210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249c1f2-7a34-4d32-9142-4406622298a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:44.127494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:44.138176 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f249c1f2-7a34-4d32-9142-4406622298a3 None None] MFA Rules not processed for user `2c4a6ecf8b7743d7987f88f646692c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:44.141092 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f249c1f2-7a34-4d32-9142-4406622298a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:44.276389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538af4ae-dfca-4d9b-a200-1c755cc6e684 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:44.283956 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddeab26-b16a-427c-97f9-b582f9491ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:44.284864 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddeab26-b16a-427c-97f9-b582f9491ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:44.285148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddeab26-b16a-427c-97f9-b582f9491ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:44.285433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddeab26-b16a-427c-97f9-b582f9491ca3 admin admin] PATH_INFO: `/v3/projects/b214e1a94e8640e79791d7c5eb865196` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:44.290298 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddeab26-b16a-427c-97f9-b582f9491ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b214e1a94e8640e79791d7c5eb865196)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:44.292297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddeab26-b16a-427c-97f9-b582f9491ca3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:44.380750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 920/1841] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:44.381981 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249c1f2-7a34-4d32-9142-4406622298a3 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:44.405701 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-bddeab26-b16a-427c-97f9-b582f9491ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b214e1a94e8640e79791d7c5eb865196', 'request_id': 'req-bddeab26-b16a-427c-97f9-b582f9491ca3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:44.415744 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249c1f2-7a34-4d32-9142-4406622298a3 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:44.425215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-bddeab26-b16a-427c-97f9-b582f9491ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b214e1a94e8640e79791d7c5eb865196', 'request_id': 'req-bddeab26-b16a-427c-97f9-b582f9491ca3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:44.434520 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-bddeab26-b16a-427c-97f9-b582f9491ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b214e1a94e8640e79791d7c5eb865196', 'request_id': 'req-bddeab26-b16a-427c-97f9-b582f9491ca3'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:44.470061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-bddeab26-b16a-427c-97f9-b582f9491ca3 admin admin] The token cache is being invalidate because project b214e1a94e8640e79791d7c5eb865196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:44.470476 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-bddeab26-b16a-427c-97f9-b582f9491ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:44.471262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-bddeab26-b16a-427c-97f9-b582f9491ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:44.473583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 922/1842] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:44 2022] DELETE /identity/v3/projects/b214e1a94e8640e79791d7c5eb865196 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:44.475126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddeab26-b16a-427c-97f9-b582f9491ca3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:44.477978 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bddeab26-b16a-427c-97f9-b582f9491ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:44.549183 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539d860-1574-4731-9920-9a1c7c67dab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:44.550342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539d860-1574-4731-9920-9a1c7c67dab3 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:44.550896 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539d860-1574-4731-9920-9a1c7c67dab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:44.551371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539d860-1574-4731-9920-9a1c7c67dab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:44.552350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539d860-1574-4731-9920-9a1c7c67dab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:44.563950 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539d860-1574-4731-9920-9a1c7c67dab3 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:44.569860 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:44.617343 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 921/1843] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:44 2022] POST /identity/v3/projects => generated 369 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:44.619665 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539d860-1574-4731-9920-9a1c7c67dab3 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:44.631737 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a539d860-1574-4731-9920-9a1c7c67dab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:44.757827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddeab26-b16a-427c-97f9-b582f9491ca3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:44.845415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539d860-1574-4731-9920-9a1c7c67dab3 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:44.853498 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c7d5f-a1fd-4465-9d3c-a4540fb850a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:44.856255 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c7d5f-a1fd-4465-9d3c-a4540fb850a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:44.856406 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c7d5f-a1fd-4465-9d3c-a4540fb850a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:44.857895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c7d5f-a1fd-4465-9d3c-a4540fb850a5 admin admin] PATH_INFO: `/v3/users/e806d9c121d9465085f6519c7645760e` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:44.860238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c7d5f-a1fd-4465-9d3c-a4540fb850a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e806d9c121d9465085f6519c7645760e)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:44.864652 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c7d5f-a1fd-4465-9d3c-a4540fb850a5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:44.890195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a970ef0-7de8-42cc-a0cc-fe25207c6aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:44.891205 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a970ef0-7de8-42cc-a0cc-fe25207c6aee admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:44.892192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a970ef0-7de8-42cc-a0cc-fe25207c6aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:44.892739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a970ef0-7de8-42cc-a0cc-fe25207c6aee admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:44.893856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a970ef0-7de8-42cc-a0cc-fe25207c6aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:44.906073 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a970ef0-7de8-42cc-a0cc-fe25207c6aee admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:44.954536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:44.978717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ee1c7d5f-a1fd-4465-9d3c-a4540fb850a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e806d9c121d9465085f6519c7645760e'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:44.985876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 923/1844] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:44 2022] POST /identity/v3/projects => generated 385 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:44.990614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ee1c7d5f-a1fd-4465-9d3c-a4540fb850a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e806d9c121d9465085f6519c7645760e'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:44.991280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a970ef0-7de8-42cc-a0cc-fe25207c6aee admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:44.999389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7a970ef0-7de8-42cc-a0cc-fe25207c6aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:45.007669 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ee1c7d5f-a1fd-4465-9d3c-a4540fb850a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e806d9c121d9465085f6519c7645760e'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:45.008474 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ee1c7d5f-a1fd-4465-9d3c-a4540fb850a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e806d9c121d9465085f6519c7645760e'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:45.009135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ee1c7d5f-a1fd-4465-9d3c-a4540fb850a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e806d9c121d9465085f6519c7645760e'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:45.028985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 922/1845] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:44 2022] DELETE /identity/v3/users/e806d9c121d9465085f6519c7645760e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:45.033504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c7d5f-a1fd-4465-9d3c-a4540fb850a5 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:45.035140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ee1c7d5f-a1fd-4465-9d3c-a4540fb850a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:45.195239 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c7d5f-a1fd-4465-9d3c-a4540fb850a5 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:45.207653 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a970ef0-7de8-42cc-a0cc-fe25207c6aee admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:45.218266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f82b7-627f-46b4-b67f-eb101dcf0e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:45.218533 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f82b7-627f-46b4-b67f-eb101dcf0e26 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:45.219170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f82b7-627f-46b4-b67f-eb101dcf0e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:45.221086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f82b7-627f-46b4-b67f-eb101dcf0e26 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:45.223602 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f82b7-627f-46b4-b67f-eb101dcf0e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:45.234391 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f82b7-627f-46b4-b67f-eb101dcf0e26 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:45.237231 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f20f79-eb86-4c6d-900f-9d13a9c2ae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:45.239240 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f20f79-eb86-4c6d-900f-9d13a9c2ae13 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:45.239240 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f20f79-eb86-4c6d-900f-9d13a9c2ae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:45.239914 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f20f79-eb86-4c6d-900f-9d13a9c2ae13 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:45.241415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f20f79-eb86-4c6d-900f-9d13a9c2ae13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:45.247847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f20f79-eb86-4c6d-900f-9d13a9c2ae13 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:45.299521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 923/1846] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:45 2022] POST /identity/v3/users => generated 299 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:45.306298 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f82b7-627f-46b4-b67f-eb101dcf0e26 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:45.313746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 924/1847] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:44 2022] POST /identity/v3/users => generated 291 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:45.315712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f20f79-eb86-4c6d-900f-9d13a9c2ae13 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:45.323237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a8f20f79-eb86-4c6d-900f-9d13a9c2ae13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:45.328119 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f82b7-627f-46b4-b67f-eb101dcf0e26 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:45.334117 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613e84d-9b76-498a-800e-35ff418974b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:45.334900 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613e84d-9b76-498a-800e-35ff418974b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:45.335265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613e84d-9b76-498a-800e-35ff418974b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:45.335620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613e84d-9b76-498a-800e-35ff418974b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:45.336471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613e84d-9b76-498a-800e-35ff418974b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:45.340163 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613e84d-9b76-498a-800e-35ff418974b6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:45.359688 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 924/1848] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:45.366704 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613e84d-9b76-498a-800e-35ff418974b6 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:45.373149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f20f79-eb86-4c6d-900f-9d13a9c2ae13 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:45.382854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175436e-c4f4-49b9-84d8-fc14fc782e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:45.384061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175436e-c4f4-49b9-84d8-fc14fc782e04 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:45.384653 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175436e-c4f4-49b9-84d8-fc14fc782e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:45.385227 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175436e-c4f4-49b9-84d8-fc14fc782e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:45.385833 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613e84d-9b76-498a-800e-35ff418974b6 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:45.387558 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175436e-c4f4-49b9-84d8-fc14fc782e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:45.390675 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175436e-c4f4-49b9-84d8-fc14fc782e04 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:45.392946 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a920acf-4f9c-4ae0-9482-757f1cae2221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:45.398208 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a920acf-4f9c-4ae0-9482-757f1cae2221 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:45.398607 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a920acf-4f9c-4ae0-9482-757f1cae2221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:45.398973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a920acf-4f9c-4ae0-9482-757f1cae2221 admin admin] PATH_INFO: `/v3/projects/0f3fef0053154af18f1c0891d6b5b555/users/51ed971c608049069375cc0231c1fbf1/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:45.418993 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 925/1849] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:45.423265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175436e-c4f4-49b9-84d8-fc14fc782e04 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:45.425826 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a920acf-4f9c-4ae0-9482-757f1cae2221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3fef0053154af18f1c0891d6b5b555, user_id=51ed971c608049069375cc0231c1fbf1, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:45.429350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a920acf-4f9c-4ae0-9482-757f1cae2221 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:45.462496 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 925/1850] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:45 2022] PUT /identity/v3/projects/0f3fef0053154af18f1c0891d6b5b555/users/51ed971c608049069375cc0231c1fbf1/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:45.473844 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a920acf-4f9c-4ae0-9482-757f1cae2221 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:45.474729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175436e-c4f4-49b9-84d8-fc14fc782e04 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:45.540796 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:45.657074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43edb15-fd7c-43ee-99df-3ab80772b863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:45.659103 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43edb15-fd7c-43ee-99df-3ab80772b863 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:45.659257 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43edb15-fd7c-43ee-99df-3ab80772b863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:45.665291 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43edb15-fd7c-43ee-99df-3ab80772b863 admin admin] PATH_INFO: `/v3/projects/ac750a1d7f1c4c8390b158d66c1bc698/users/32f16ad7a5c14a7dbff763b92d0603f9/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:45.690364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a920acf-4f9c-4ae0-9482-757f1cae2221 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:45.690971 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43edb15-fd7c-43ee-99df-3ab80772b863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac750a1d7f1c4c8390b158d66c1bc698, user_id=32f16ad7a5c14a7dbff763b92d0603f9, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:45.694473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43edb15-fd7c-43ee-99df-3ab80772b863 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:45.704065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3220cd-141a-4dc9-ad62-2551bd478c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:45.705474 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3220cd-141a-4dc9-ad62-2551bd478c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:45.706461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3220cd-141a-4dc9-ad62-2551bd478c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:45.706569 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3220cd-141a-4dc9-ad62-2551bd478c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:45.707915 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3220cd-141a-4dc9-ad62-2551bd478c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:45.711423 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3220cd-141a-4dc9-ad62-2551bd478c55 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:45.717427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:45.721677 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 926/1851] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:45 2022] PUT /identity/v3/projects/ac750a1d7f1c4c8390b158d66c1bc698/users/32f16ad7a5c14a7dbff763b92d0603f9/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:45.726576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43edb15-fd7c-43ee-99df-3ab80772b863 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:45.742012 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 926/1852] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:45.747397 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3220cd-141a-4dc9-ad62-2551bd478c55 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:45.760655 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3220cd-141a-4dc9-ad62-2551bd478c55 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:45.844908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43edb15-fd7c-43ee-99df-3ab80772b863 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:45.850980 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f70b9-d23a-4478-bc02-870e644a1354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:45.851883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f70b9-d23a-4478-bc02-870e644a1354 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:45.852317 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f70b9-d23a-4478-bc02-870e644a1354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:45.852746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f70b9-d23a-4478-bc02-870e644a1354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:45.853503 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f70b9-d23a-4478-bc02-870e644a1354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:45.855919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f70b9-d23a-4478-bc02-870e644a1354 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:45.874878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf52ccf-b7a9-423d-b5cb-c3c32ab79cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:45.875885 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 927/1853] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:06:45.876844 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f70b9-d23a-4478-bc02-870e644a1354 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:45.878855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b53f70b9-d23a-4478-bc02-870e644a1354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:45.879813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf52ccf-b7a9-423d-b5cb-c3c32ab79cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:45.887172 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf52ccf-b7a9-423d-b5cb-c3c32ab79cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:45.887617 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf52ccf-b7a9-423d-b5cb-c3c32ab79cf8 admin admin] PATH_INFO: `/v3/projects/0f3fef0053154af18f1c0891d6b5b555/users/51ed971c608049069375cc0231c1fbf1/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:45.889875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf52ccf-b7a9-423d-b5cb-c3c32ab79cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3fef0053154af18f1c0891d6b5b555, user_id=51ed971c608049069375cc0231c1fbf1, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:45.892593 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf52ccf-b7a9-423d-b5cb-c3c32ab79cf8 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:45.894089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f70b9-d23a-4478-bc02-870e644a1354 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:45.899496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0eca84-ab42-4b4d-aa3c-53f858291879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:45.900383 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0eca84-ab42-4b4d-aa3c-53f858291879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:45.900672 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0eca84-ab42-4b4d-aa3c-53f858291879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:45.900948 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0eca84-ab42-4b4d-aa3c-53f858291879 admin admin] PATH_INFO: `/v3/projects/ec2562f8a7db4178ac7e239acc86e8f4` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:45.903968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0eca84-ab42-4b4d-aa3c-53f858291879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec2562f8a7db4178ac7e239acc86e8f4)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:45.907201 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 927/1854] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:45 2022] PUT /identity/v3/projects/0f3fef0053154af18f1c0891d6b5b555/users/51ed971c608049069375cc0231c1fbf1/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:06:45.908021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf52ccf-b7a9-423d-b5cb-c3c32ab79cf8 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:45.909800 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0eca84-ab42-4b4d-aa3c-53f858291879 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:45.996441 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fe0eca84-ab42-4b4d-aa3c-53f858291879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec2562f8a7db4178ac7e239acc86e8f4', 'request_id': 'req-fe0eca84-ab42-4b4d-aa3c-53f858291879'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:46.012799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fe0eca84-ab42-4b4d-aa3c-53f858291879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec2562f8a7db4178ac7e239acc86e8f4', 'request_id': 'req-fe0eca84-ab42-4b4d-aa3c-53f858291879'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:46.020198 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf52ccf-b7a9-423d-b5cb-c3c32ab79cf8 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:46.027775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fe0eca84-ab42-4b4d-aa3c-53f858291879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec2562f8a7db4178ac7e239acc86e8f4', 'request_id': 'req-fe0eca84-ab42-4b4d-aa3c-53f858291879'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:46.046530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fe0eca84-ab42-4b4d-aa3c-53f858291879 admin admin] The token cache is being invalidate because project ec2562f8a7db4178ac7e239acc86e8f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:46.047254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fe0eca84-ab42-4b4d-aa3c-53f858291879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:46.048867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fe0eca84-ab42-4b4d-aa3c-53f858291879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:46.051372 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 928/1855] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:45 2022] DELETE /identity/v3/projects/ec2562f8a7db4178ac7e239acc86e8f4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:46.052791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c570a-1007-4cf1-bb6b-5750a9810d65 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:46.053184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c570a-1007-4cf1-bb6b-5750a9810d65 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:46.053596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c570a-1007-4cf1-bb6b-5750a9810d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:46.107489 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6c3c570a-1007-4cf1-bb6b-5750a9810d65 None None] MFA Rules not processed for user `51ed971c608049069375cc0231c1fbf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:46.107489 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6c3c570a-1007-4cf1-bb6b-5750a9810d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:46.108271 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2c65e-803a-4b43-9220-3a1def096b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:46.109195 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2c65e-803a-4b43-9220-3a1def096b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:46.109517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2c65e-803a-4b43-9220-3a1def096b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:46.109828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2c65e-803a-4b43-9220-3a1def096b3e admin admin] PATH_INFO: `/v3/projects/ac750a1d7f1c4c8390b158d66c1bc698/users/32f16ad7a5c14a7dbff763b92d0603f9/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:46.112081 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2c65e-803a-4b43-9220-3a1def096b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac750a1d7f1c4c8390b158d66c1bc698, user_id=32f16ad7a5c14a7dbff763b92d0603f9, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:46.114822 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2c65e-803a-4b43-9220-3a1def096b3e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:46.126913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 928/1856] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:45 2022] PUT /identity/v3/projects/ac750a1d7f1c4c8390b158d66c1bc698/users/32f16ad7a5c14a7dbff763b92d0603f9/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:46.128428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b13fa-ef54-4a2e-b9c2-3d73895f9020 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:46.128758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b13fa-ef54-4a2e-b9c2-3d73895f9020 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:46.129109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b13fa-ef54-4a2e-b9c2-3d73895f9020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:46.134505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:46.149334 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ca2b13fa-ef54-4a2e-b9c2-3d73895f9020 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:46.150600 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ca2b13fa-ef54-4a2e-b9c2-3d73895f9020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:46.186911 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:46.214375 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 929/1857] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:46.214375 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020f402-e1bf-43b4-91cd-b09ef4cb00f9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:46.214375 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020f402-e1bf-43b4-91cd-b09ef4cb00f9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:46.214375 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020f402-e1bf-43b4-91cd-b09ef4cb00f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:46.233389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 929/1858] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:46.234266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b13fa-ef54-4a2e-b9c2-3d73895f9020 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:46.235694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ca2b13fa-ef54-4a2e-b9c2-3d73895f9020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:46.249526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f020f402-e1bf-43b4-91cd-b09ef4cb00f9 None None] MFA Rules not processed for user `32f16ad7a5c14a7dbff763b92d0603f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:46.250790 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f020f402-e1bf-43b4-91cd-b09ef4cb00f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:46.294470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b13fa-ef54-4a2e-b9c2-3d73895f9020 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:46.298311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5b968-db04-4711-9f67-faf1951910c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:46.298963 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5b968-db04-4711-9f67-faf1951910c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:46.299252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5b968-db04-4711-9f67-faf1951910c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:46.299775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5b968-db04-4711-9f67-faf1951910c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:46.321548 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 930/1859] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:46 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:46.322864 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9fa50-81ca-4014-8dfe-b836863ab4af None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:46.323152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9fa50-81ca-4014-8dfe-b836863ab4af None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:46.323426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9fa50-81ca-4014-8dfe-b836863ab4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:46.343400 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0fb9fa50-81ca-4014-8dfe-b836863ab4af None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:46.344619 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0fb9fa50-81ca-4014-8dfe-b836863ab4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:46.352763 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 931/1860] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:46.353648 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9fa50-81ca-4014-8dfe-b836863ab4af None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:46.359200 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0fb9fa50-81ca-4014-8dfe-b836863ab4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:46.371721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5b968-db04-4711-9f67-faf1951910c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:46.372303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9fa50-81ca-4014-8dfe-b836863ab4af None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:46.373236 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5b968-db04-4711-9f67-faf1951910c3 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:46.381604 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c986ee-f211-4214-b12d-06fbe18ab85f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:46.382534 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c986ee-f211-4214-b12d-06fbe18ab85f service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:46.382972 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c986ee-f211-4214-b12d-06fbe18ab85f service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:46.383349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c986ee-f211-4214-b12d-06fbe18ab85f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:46.384715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 930/1861] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:46.385715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5b968-db04-4711-9f67-faf1951910c3 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:46.397382 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c986ee-f211-4214-b12d-06fbe18ab85f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:46.399227 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5b968-db04-4711-9f67-faf1951910c3 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:46.400569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c986ee-f211-4214-b12d-06fbe18ab85f service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:46.407028 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbaf4e-085f-42f7-8999-578c26a6b0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:46.407948 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbaf4e-085f-42f7-8999-578c26a6b0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:46.408524 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbaf4e-085f-42f7-8999-578c26a6b0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:46.409069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbaf4e-085f-42f7-8999-578c26a6b0b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:46.409919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbaf4e-085f-42f7-8999-578c26a6b0b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:06:46.410232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbaf4e-085f-42f7-8999-578c26a6b0b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:46.412043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbaf4e-085f-42f7-8999-578c26a6b0b5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:46.419242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 932/1862] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:46 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:46.426647 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 931/1863] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:06:46.432153 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c986ee-f211-4214-b12d-06fbe18ab85f service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:46.452840 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c986ee-f211-4214-b12d-06fbe18ab85f service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:46.460695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4fbe1-37af-4570-bcab-ff8b1e705e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:46.461318 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4fbe1-37af-4570-bcab-ff8b1e705e2b admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:46.461644 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4fbe1-37af-4570-bcab-ff8b1e705e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:46.461966 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4fbe1-37af-4570-bcab-ff8b1e705e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:46.462696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4fbe1-37af-4570-bcab-ff8b1e705e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:46.466138 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4fbe1-37af-4570-bcab-ff8b1e705e2b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:46.507254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 933/1864] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:46 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:46.513863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbaf4e-085f-42f7-8999-578c26a6b0b5 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:46.527930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbaf4e-085f-42f7-8999-578c26a6b0b5 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:46.618771 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec596f-fa2f-400b-89d4-4382aae7dd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:46.619662 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec596f-fa2f-400b-89d4-4382aae7dd67 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:46.619770 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec596f-fa2f-400b-89d4-4382aae7dd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:46.622101 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec596f-fa2f-400b-89d4-4382aae7dd67 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:46.622101 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec596f-fa2f-400b-89d4-4382aae7dd67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:46.623756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec596f-fa2f-400b-89d4-4382aae7dd67 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:46.645825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:46.659526 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 932/1865] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:46 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:46.660959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4fbe1-37af-4570-bcab-ff8b1e705e2b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:46.686857 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4fbe1-37af-4570-bcab-ff8b1e705e2b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:46.753908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be56659-13bb-4f3a-94a9-f9e77a0eac34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:46.755252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be56659-13bb-4f3a-94a9-f9e77a0eac34 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:46.757685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be56659-13bb-4f3a-94a9-f9e77a0eac34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:46.757685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be56659-13bb-4f3a-94a9-f9e77a0eac34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:46.757685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be56659-13bb-4f3a-94a9-f9e77a0eac34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:46.760989 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be56659-13bb-4f3a-94a9-f9e77a0eac34 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:46.794214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec596f-fa2f-400b-89d4-4382aae7dd67 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:46.794472 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 934/1866] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:46.819668 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec596f-fa2f-400b-89d4-4382aae7dd67 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:46.834205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ec92c-cf89-4f22-aaed-4f1518d4bcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:46.835231 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ec92c-cf89-4f22-aaed-4f1518d4bcb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:46.835572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ec92c-cf89-4f22-aaed-4f1518d4bcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:46.835929 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ec92c-cf89-4f22-aaed-4f1518d4bcb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:46.836858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ec92c-cf89-4f22-aaed-4f1518d4bcb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:46.839026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ec92c-cf89-4f22-aaed-4f1518d4bcb7 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:46.869710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 933/1867] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:06:46.876439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be56659-13bb-4f3a-94a9-f9e77a0eac34 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:46.889941 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be56659-13bb-4f3a-94a9-f9e77a0eac34 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:46.898758 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af0771-0030-426b-871d-bf2322b1d4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:46.900018 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af0771-0030-426b-871d-bf2322b1d4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:46.900405 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af0771-0030-426b-871d-bf2322b1d4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:46.900788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af0771-0030-426b-871d-bf2322b1d4bc admin admin] PATH_INFO: `/v3/projects/06dfd14568a842e4b2a5dff7bbb7d6c3/users/bf533225b00a43f88cfc2e01a7d49f7f/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:46.934925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af0771-0030-426b-871d-bf2322b1d4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=06dfd14568a842e4b2a5dff7bbb7d6c3, user_id=bf533225b00a43f88cfc2e01a7d49f7f, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:46.938265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af0771-0030-426b-871d-bf2322b1d4bc admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:46.962394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 935/1868] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:46 2022] PUT /identity/v3/projects/06dfd14568a842e4b2a5dff7bbb7d6c3/users/bf533225b00a43f88cfc2e01a7d49f7f/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:46.973837 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde43e18-a670-4d65-8145-1076465ce0ee None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:46.974390 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde43e18-a670-4d65-8145-1076465ce0ee None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:46.974494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde43e18-a670-4d65-8145-1076465ce0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:47.010734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-bde43e18-a670-4d65-8145-1076465ce0ee None None] MFA Rules not processed for user `bf533225b00a43f88cfc2e01a7d49f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:47.012690 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bde43e18-a670-4d65-8145-1076465ce0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:47.131889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 934/1869] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:47.137162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af0771-0030-426b-871d-bf2322b1d4bc admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:47.180949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:47.327724 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af0771-0030-426b-871d-bf2322b1d4bc admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:47.333955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde43e18-a670-4d65-8145-1076465ce0ee None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:47.336634 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bde43e18-a670-4d65-8145-1076465ce0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:47.352322 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd280d1e-f0a8-4c47-95f2-535c7313453c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:47.353576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd280d1e-f0a8-4c47-95f2-535c7313453c admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:47.354078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd280d1e-f0a8-4c47-95f2-535c7313453c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:47.354544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd280d1e-f0a8-4c47-95f2-535c7313453c admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:47.356848 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd280d1e-f0a8-4c47-95f2-535c7313453c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:47.360401 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd280d1e-f0a8-4c47-95f2-535c7313453c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:47.369015 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde43e18-a670-4d65-8145-1076465ce0ee None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:47.375698 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8298ec6-5d92-44d2-b477-1c43790944c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:47.376555 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8298ec6-5d92-44d2-b477-1c43790944c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:47.376829 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8298ec6-5d92-44d2-b477-1c43790944c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:47.377109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8298ec6-5d92-44d2-b477-1c43790944c0 admin admin] PATH_INFO: `/v3/users/2c4a6ecf8b7743d7987f88f646692c55` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:47.378450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8298ec6-5d92-44d2-b477-1c43790944c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4a6ecf8b7743d7987f88f646692c55)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:47.381787 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8298ec6-5d92-44d2-b477-1c43790944c0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:47.433826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 936/1870] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:47 2022] POST /identity/v3/projects => generated 389 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:47.437459 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd280d1e-f0a8-4c47-95f2-535c7313453c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:47.554976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd280d1e-f0a8-4c47-95f2-535c7313453c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:47.563719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9313b7-776a-43a2-9858-56b61ba58162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:47.565855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9313b7-776a-43a2-9858-56b61ba58162 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:47.565855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9313b7-776a-43a2-9858-56b61ba58162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:47.565855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9313b7-776a-43a2-9858-56b61ba58162 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:47.567323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9313b7-776a-43a2-9858-56b61ba58162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:47.570642 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9313b7-776a-43a2-9858-56b61ba58162 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:47.611206 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 937/1871] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:47 2022] POST /identity/v3/users => generated 301 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:47.615549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9313b7-776a-43a2-9858-56b61ba58162 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:47.627817 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9313b7-776a-43a2-9858-56b61ba58162 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:47.633235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea9ca8-b0ba-4099-9fac-014309dc0436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:47.634038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea9ca8-b0ba-4099-9fac-014309dc0436 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:47.634289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea9ca8-b0ba-4099-9fac-014309dc0436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:47.634624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea9ca8-b0ba-4099-9fac-014309dc0436 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:47.635467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea9ca8-b0ba-4099-9fac-014309dc0436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:47.637199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea9ca8-b0ba-4099-9fac-014309dc0436 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:47.647777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f8298ec6-5d92-44d2-b477-1c43790944c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4a6ecf8b7743d7987f88f646692c55'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:47.653036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 938/1872] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:06:47.657201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea9ca8-b0ba-4099-9fac-014309dc0436 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:47.659886 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f8298ec6-5d92-44d2-b477-1c43790944c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4a6ecf8b7743d7987f88f646692c55'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:47.671370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea9ca8-b0ba-4099-9fac-014309dc0436 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:47.675212 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f8298ec6-5d92-44d2-b477-1c43790944c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4a6ecf8b7743d7987f88f646692c55'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:47.675890 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f8298ec6-5d92-44d2-b477-1c43790944c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4a6ecf8b7743d7987f88f646692c55'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:47.676514 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f8298ec6-5d92-44d2-b477-1c43790944c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4a6ecf8b7743d7987f88f646692c55'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:47.678322 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37b4be-97a7-43be-99ea-227dba21d1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:47.679217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37b4be-97a7-43be-99ea-227dba21d1cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:47.679500 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37b4be-97a7-43be-99ea-227dba21d1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:47.679781 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37b4be-97a7-43be-99ea-227dba21d1cd admin admin] PATH_INFO: `/v3/projects/a13c3148b9fb48fe93ef0ff2002fdc3d/users/286032dd99454cb981fc09b30dcf62ce/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:47.695984 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 935/1873] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:47 2022] DELETE /identity/v3/users/2c4a6ecf8b7743d7987f88f646692c55 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:47.699660 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37b4be-97a7-43be-99ea-227dba21d1cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a13c3148b9fb48fe93ef0ff2002fdc3d, user_id=286032dd99454cb981fc09b30dcf62ce, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:47.701131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df931a0-3d9e-408a-b5c6-1d01909accff None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:47.701365 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df931a0-3d9e-408a-b5c6-1d01909accff None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:47.701952 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df931a0-3d9e-408a-b5c6-1d01909accff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:47.702718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37b4be-97a7-43be-99ea-227dba21d1cd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:47.721320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 939/1874] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:47 2022] PUT /identity/v3/projects/a13c3148b9fb48fe93ef0ff2002fdc3d/users/286032dd99454cb981fc09b30dcf62ce/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:47.727025 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37b4be-97a7-43be-99ea-227dba21d1cd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:47.728772 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3e37b4be-97a7-43be-99ea-227dba21d1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:47.732079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5df931a0-3d9e-408a-b5c6-1d01909accff None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:47.733253 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5df931a0-3d9e-408a-b5c6-1d01909accff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:47.818475 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:47.847733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 936/1875] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:47.863550 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df931a0-3d9e-408a-b5c6-1d01909accff None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:47.865125 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5df931a0-3d9e-408a-b5c6-1d01909accff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:47.865693 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37b4be-97a7-43be-99ea-227dba21d1cd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:47.872333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b1e37-550f-47f7-81cb-9575f92e9baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:47.873120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b1e37-550f-47f7-81cb-9575f92e9baa admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:47.873476 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b1e37-550f-47f7-81cb-9575f92e9baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:47.873913 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b1e37-550f-47f7-81cb-9575f92e9baa admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:47.874741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b1e37-550f-47f7-81cb-9575f92e9baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:47.876613 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b1e37-550f-47f7-81cb-9575f92e9baa admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:47.880704 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:47.896485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 940/1876] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:06:47.899959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b1e37-550f-47f7-81cb-9575f92e9baa admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:47.920850 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b1e37-550f-47f7-81cb-9575f92e9baa admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:47.930253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510731e4-7132-4961-94b5-a49edb9f31c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:47.932416 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510731e4-7132-4961-94b5-a49edb9f31c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:47.933706 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510731e4-7132-4961-94b5-a49edb9f31c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:47.934312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510731e4-7132-4961-94b5-a49edb9f31c1 admin admin] PATH_INFO: `/v3/projects/a13c3148b9fb48fe93ef0ff2002fdc3d/users/286032dd99454cb981fc09b30dcf62ce/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:47.939755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510731e4-7132-4961-94b5-a49edb9f31c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a13c3148b9fb48fe93ef0ff2002fdc3d, user_id=286032dd99454cb981fc09b30dcf62ce, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:47.946511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510731e4-7132-4961-94b5-a49edb9f31c1 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:47.974515 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df931a0-3d9e-408a-b5c6-1d01909accff None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:47.986822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 941/1877] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:47 2022] PUT /identity/v3/projects/a13c3148b9fb48fe93ef0ff2002fdc3d/users/286032dd99454cb981fc09b30dcf62ce/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:48.002395 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b142e-52e6-488f-9663-170a023584d1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:48.002395 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b142e-52e6-488f-9663-170a023584d1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:48.002395 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b142e-52e6-488f-9663-170a023584d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:48.071972 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f04b142e-52e6-488f-9663-170a023584d1 None None] MFA Rules not processed for user `286032dd99454cb981fc09b30dcf62ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:48.077594 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f04b142e-52e6-488f-9663-170a023584d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:48.125085 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865f6ba-d9c9-43fa-995f-a89c14a0a0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:48.126857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865f6ba-d9c9-43fa-995f-a89c14a0a0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:48.127792 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865f6ba-d9c9-43fa-995f-a89c14a0a0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:48.128216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865f6ba-d9c9-43fa-995f-a89c14a0a0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:48.219136 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 942/1878] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:48.235431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865f6ba-d9c9-43fa-995f-a89c14a0a0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:48.237003 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865f6ba-d9c9-43fa-995f-a89c14a0a0b2 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:48.237439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b142e-52e6-488f-9663-170a023584d1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:48.239716 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f04b142e-52e6-488f-9663-170a023584d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:48.257805 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 937/1879] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:06:48.360181 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b142e-52e6-488f-9663-170a023584d1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:48.366796 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aed95f-9abc-4c01-a627-c348b4b3c178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:48.368206 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed95f-9abc-4c01-a627-c348b4b3c178 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:48.368720 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed95f-9abc-4c01-a627-c348b4b3c178 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:48.369404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed95f-9abc-4c01-a627-c348b4b3c178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:48.387904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aed95f-9abc-4c01-a627-c348b4b3c178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:48.389809 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aed95f-9abc-4c01-a627-c348b4b3c178 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:48.411952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 943/1880] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:48.556533 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865f6ba-d9c9-43fa-995f-a89c14a0a0b2 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:48.561073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f865f6ba-d9c9-43fa-995f-a89c14a0a0b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:48.600622 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865f6ba-d9c9-43fa-995f-a89c14a0a0b2 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:48.610666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd213693-6068-46d9-882f-86d188577b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:48.611671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd213693-6068-46d9-882f-86d188577b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:48.612039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd213693-6068-46d9-882f-86d188577b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:48.612404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd213693-6068-46d9-882f-86d188577b58 admin admin] PATH_INFO: `/v3/users/5e5d160d931341cdb767fb03060f246d` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:48.613699 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd213693-6068-46d9-882f-86d188577b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e5d160d931341cdb767fb03060f246d)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:48.616642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd213693-6068-46d9-882f-86d188577b58 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:48.632223 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aed95f-9abc-4c01-a627-c348b4b3c178 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:48.647457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aed95f-9abc-4c01-a627-c348b4b3c178 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:48.655311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe522d3-0e0f-4b45-8c95-6352bf4deffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:48.656408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe522d3-0e0f-4b45-8c95-6352bf4deffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:48.656951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe522d3-0e0f-4b45-8c95-6352bf4deffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:48.657406 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe522d3-0e0f-4b45-8c95-6352bf4deffd admin admin] PATH_INFO: `/v3/users/bf533225b00a43f88cfc2e01a7d49f7f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:48.659105 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe522d3-0e0f-4b45-8c95-6352bf4deffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf533225b00a43f88cfc2e01a7d49f7f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:48.661983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe522d3-0e0f-4b45-8c95-6352bf4deffd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:48.682209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-cd213693-6068-46d9-882f-86d188577b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e5d160d931341cdb767fb03060f246d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:48.688923 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:48.692720 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-cd213693-6068-46d9-882f-86d188577b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e5d160d931341cdb767fb03060f246d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:48.711268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-cd213693-6068-46d9-882f-86d188577b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e5d160d931341cdb767fb03060f246d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:48.712374 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-cd213693-6068-46d9-882f-86d188577b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e5d160d931341cdb767fb03060f246d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:48.713087 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-cd213693-6068-46d9-882f-86d188577b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e5d160d931341cdb767fb03060f246d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:48.734015 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 938/1881] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:48 2022] DELETE /identity/v3/users/5e5d160d931341cdb767fb03060f246d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:48.737587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8fe522d3-0e0f-4b45-8c95-6352bf4deffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf533225b00a43f88cfc2e01a7d49f7f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:48.738367 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8fe522d3-0e0f-4b45-8c95-6352bf4deffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf533225b00a43f88cfc2e01a7d49f7f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:48.741696 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1aff6d-170f-4ec1-bc09-b26e73b78d36 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:48.742013 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1aff6d-170f-4ec1-bc09-b26e73b78d36 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:48.742771 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1aff6d-170f-4ec1-bc09-b26e73b78d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:48.748448 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8fe522d3-0e0f-4b45-8c95-6352bf4deffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf533225b00a43f88cfc2e01a7d49f7f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:48.762534 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8fe522d3-0e0f-4b45-8c95-6352bf4deffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf533225b00a43f88cfc2e01a7d49f7f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:48.764054 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-de1aff6d-170f-4ec1-bc09-b26e73b78d36 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:48.765296 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-de1aff6d-170f-4ec1-bc09-b26e73b78d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:48.772050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:48.788426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8fe522d3-0e0f-4b45-8c95-6352bf4deffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf533225b00a43f88cfc2e01a7d49f7f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:48.803052 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 944/1882] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:48 2022] DELETE /identity/v3/users/bf533225b00a43f88cfc2e01a7d49f7f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:06:48.804349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe522d3-0e0f-4b45-8c95-6352bf4deffd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:48.806001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8fe522d3-0e0f-4b45-8c95-6352bf4deffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:48.839922 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 939/1883] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:48.844096 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca4ae3-f633-4f39-af06-5d3d926b104a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:48.844390 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca4ae3-f633-4f39-af06-5d3d926b104a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:48.844703 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca4ae3-f633-4f39-af06-5d3d926b104a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:48.865027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6fca4ae3-f633-4f39-af06-5d3d926b104a None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:48.866389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6fca4ae3-f633-4f39-af06-5d3d926b104a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:48.903077 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe522d3-0e0f-4b45-8c95-6352bf4deffd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:48.907998 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11079ef-596d-4cda-979c-764d95db0ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:48.908943 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11079ef-596d-4cda-979c-764d95db0ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:48.909233 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11079ef-596d-4cda-979c-764d95db0ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:48.909506 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11079ef-596d-4cda-979c-764d95db0ccd admin admin] PATH_INFO: `/v3/projects/7b00b3f3fe1c41728d153bc8ca171761` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:48.910746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11079ef-596d-4cda-979c-764d95db0ccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b00b3f3fe1c41728d153bc8ca171761)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:48.912675 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11079ef-596d-4cda-979c-764d95db0ccd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:48.936077 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 940/1884] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:48.940264 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca4ae3-f633-4f39-af06-5d3d926b104a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:48.941626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6fca4ae3-f633-4f39-af06-5d3d926b104a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:48.967529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e11079ef-596d-4cda-979c-764d95db0ccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b00b3f3fe1c41728d153bc8ca171761', 'request_id': 'req-e11079ef-596d-4cda-979c-764d95db0ccd'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:48.975827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e11079ef-596d-4cda-979c-764d95db0ccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b00b3f3fe1c41728d153bc8ca171761', 'request_id': 'req-e11079ef-596d-4cda-979c-764d95db0ccd'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:48.983869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e11079ef-596d-4cda-979c-764d95db0ccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b00b3f3fe1c41728d153bc8ca171761', 'request_id': 'req-e11079ef-596d-4cda-979c-764d95db0ccd'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:48.994912 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e11079ef-596d-4cda-979c-764d95db0ccd admin admin] The token cache is being invalidate because project 7b00b3f3fe1c41728d153bc8ca171761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:48.995123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e11079ef-596d-4cda-979c-764d95db0ccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:48.996498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-e11079ef-596d-4cda-979c-764d95db0ccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:48.998437 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 945/1885] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:48 2022] DELETE /identity/v3/projects/7b00b3f3fe1c41728d153bc8ca171761 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:48.999234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11079ef-596d-4cda-979c-764d95db0ccd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:49.000667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e11079ef-596d-4cda-979c-764d95db0ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:49.012057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca4ae3-f633-4f39-af06-5d3d926b104a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:49.039892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:49.071087 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f42ee-3c20-4f1a-bbdd-7c92de2aea0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:49.072194 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f42ee-3c20-4f1a-bbdd-7c92de2aea0a service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:49.072194 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f42ee-3c20-4f1a-bbdd-7c92de2aea0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:49.072453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f42ee-3c20-4f1a-bbdd-7c92de2aea0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:49.074820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c87f42ee-3c20-4f1a-bbdd-7c92de2aea0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:49.085936 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11079ef-596d-4cda-979c-764d95db0ccd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:49.092385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c4ec6-d324-4bb1-ab78-ee028b3ca6c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:49.093162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c4ec6-d324-4bb1-ab78-ee028b3ca6c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:49.093595 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c4ec6-d324-4bb1-ab78-ee028b3ca6c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:49.094103 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c4ec6-d324-4bb1-ab78-ee028b3ca6c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:49.096608 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8d8c4ec6-d324-4bb1-ab78-ee028b3ca6c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:49.132750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:49.163501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f42ee-3c20-4f1a-bbdd-7c92de2aea0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:49.165125 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f42ee-3c20-4f1a-bbdd-7c92de2aea0a service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:49.176094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 941/1886] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:49.176983 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f42ee-3c20-4f1a-bbdd-7c92de2aea0a service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:49.178217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c4ec6-d324-4bb1-ab78-ee028b3ca6c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:49.179671 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c4ec6-d324-4bb1-ab78-ee028b3ca6c0 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:49.185498 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c87f42ee-3c20-4f1a-bbdd-7c92de2aea0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:49.201249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f42ee-3c20-4f1a-bbdd-7c92de2aea0a service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:49.203074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 946/1887] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:49.209632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e371b-9a90-421e-bf2a-ad602c0aed59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:49.209985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e371b-9a90-421e-bf2a-ad602c0aed59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:49.210170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e371b-9a90-421e-bf2a-ad602c0aed59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:49.210509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e371b-9a90-421e-bf2a-ad602c0aed59 admin admin] PATH_INFO: `/v3/users/51ed971c608049069375cc0231c1fbf1` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:49.212227 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e371b-9a90-421e-bf2a-ad602c0aed59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ed971c608049069375cc0231c1fbf1)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:49.214543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e371b-9a90-421e-bf2a-ad602c0aed59 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:49.276214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4d1e371b-9a90-421e-bf2a-ad602c0aed59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ed971c608049069375cc0231c1fbf1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:49.284563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4d1e371b-9a90-421e-bf2a-ad602c0aed59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ed971c608049069375cc0231c1fbf1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:49.300807 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4d1e371b-9a90-421e-bf2a-ad602c0aed59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ed971c608049069375cc0231c1fbf1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:49.301859 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4d1e371b-9a90-421e-bf2a-ad602c0aed59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ed971c608049069375cc0231c1fbf1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:49.302707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4d1e371b-9a90-421e-bf2a-ad602c0aed59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ed971c608049069375cc0231c1fbf1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:49.325830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 942/1888] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:49 2022] DELETE /identity/v3/users/51ed971c608049069375cc0231c1fbf1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:49.766457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c4ec6-d324-4bb1-ab78-ee028b3ca6c0 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:49.767885 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8d8c4ec6-d324-4bb1-ab78-ee028b3ca6c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:49.786974 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c4ec6-d324-4bb1-ab78-ee028b3ca6c0 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:49.847606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e371b-9a90-421e-bf2a-ad602c0aed59 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:49.850348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4d1e371b-9a90-421e-bf2a-ad602c0aed59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:49.936377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ccef0-941e-4e54-bcd7-0aa34114d858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:49.937269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ccef0-941e-4e54-bcd7-0aa34114d858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:49.937606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ccef0-941e-4e54-bcd7-0aa34114d858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:49.937929 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ccef0-941e-4e54-bcd7-0aa34114d858 admin admin] PATH_INFO: `/v3/projects/06dfd14568a842e4b2a5dff7bbb7d6c3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:49.939441 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ccef0-941e-4e54-bcd7-0aa34114d858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06dfd14568a842e4b2a5dff7bbb7d6c3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:49.941206 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ccef0-941e-4e54-bcd7-0aa34114d858 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:49.996133 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:50.021629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e371b-9a90-421e-bf2a-ad602c0aed59 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:50.045770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cb4ccef0-941e-4e54-bcd7-0aa34114d858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06dfd14568a842e4b2a5dff7bbb7d6c3', 'request_id': 'req-cb4ccef0-941e-4e54-bcd7-0aa34114d858'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.071132 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cb4ccef0-941e-4e54-bcd7-0aa34114d858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06dfd14568a842e4b2a5dff7bbb7d6c3', 'request_id': 'req-cb4ccef0-941e-4e54-bcd7-0aa34114d858'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.082165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cb4ccef0-941e-4e54-bcd7-0aa34114d858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06dfd14568a842e4b2a5dff7bbb7d6c3', 'request_id': 'req-cb4ccef0-941e-4e54-bcd7-0aa34114d858'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.110953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cb4ccef0-941e-4e54-bcd7-0aa34114d858 admin admin] The token cache is being invalidate because project 06dfd14568a842e4b2a5dff7bbb7d6c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:50.111630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cb4ccef0-941e-4e54-bcd7-0aa34114d858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.112859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cb4ccef0-941e-4e54-bcd7-0aa34114d858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.114739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 947/1889] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:49 2022] DELETE /identity/v3/projects/06dfd14568a842e4b2a5dff7bbb7d6c3 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:50.119814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ccef0-941e-4e54-bcd7-0aa34114d858 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:50.122431 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cb4ccef0-941e-4e54-bcd7-0aa34114d858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:50.214904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db2aef-f879-476f-86c6-7ed298c33a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:50.215751 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db2aef-f879-476f-86c6-7ed298c33a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:50.216150 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db2aef-f879-476f-86c6-7ed298c33a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:50.216435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db2aef-f879-476f-86c6-7ed298c33a04 admin admin] PATH_INFO: `/v3/projects/d4f7bccb3b4f421b8eb47d815684f9b1` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:50.218419 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db2aef-f879-476f-86c6-7ed298c33a04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f7bccb3b4f421b8eb47d815684f9b1)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:50.221280 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db2aef-f879-476f-86c6-7ed298c33a04 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:50.229505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:50.240405 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ccef0-941e-4e54-bcd7-0aa34114d858 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:50.270524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb2101-c561-4702-ba39-6406fa0c052b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:50.271502 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb2101-c561-4702-ba39-6406fa0c052b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:50.271943 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb2101-c561-4702-ba39-6406fa0c052b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:50.272285 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb2101-c561-4702-ba39-6406fa0c052b admin admin] PATH_INFO: `/v3/projects/0f3fef0053154af18f1c0891d6b5b555` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:50.273781 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb2101-c561-4702-ba39-6406fa0c052b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f3fef0053154af18f1c0891d6b5b555)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:50.276072 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb2101-c561-4702-ba39-6406fa0c052b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:50.348380 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d7db2aef-f879-476f-86c6-7ed298c33a04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f7bccb3b4f421b8eb47d815684f9b1', 'request_id': 'req-d7db2aef-f879-476f-86c6-7ed298c33a04'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.363778 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d7db2aef-f879-476f-86c6-7ed298c33a04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f7bccb3b4f421b8eb47d815684f9b1', 'request_id': 'req-d7db2aef-f879-476f-86c6-7ed298c33a04'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.364597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-09eb2101-c561-4702-ba39-6406fa0c052b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f3fef0053154af18f1c0891d6b5b555', 'request_id': 'req-09eb2101-c561-4702-ba39-6406fa0c052b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.376331 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d7db2aef-f879-476f-86c6-7ed298c33a04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f7bccb3b4f421b8eb47d815684f9b1', 'request_id': 'req-d7db2aef-f879-476f-86c6-7ed298c33a04'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.380813 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-09eb2101-c561-4702-ba39-6406fa0c052b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f3fef0053154af18f1c0891d6b5b555', 'request_id': 'req-09eb2101-c561-4702-ba39-6406fa0c052b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.391721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-09eb2101-c561-4702-ba39-6406fa0c052b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f3fef0053154af18f1c0891d6b5b555', 'request_id': 'req-09eb2101-c561-4702-ba39-6406fa0c052b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.399474 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d7db2aef-f879-476f-86c6-7ed298c33a04 admin admin] The token cache is being invalidate because project d4f7bccb3b4f421b8eb47d815684f9b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:50.400760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d7db2aef-f879-476f-86c6-7ed298c33a04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.402503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d7db2aef-f879-476f-86c6-7ed298c33a04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.411026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 943/1890] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:49 2022] DELETE /identity/v3/projects/d4f7bccb3b4f421b8eb47d815684f9b1 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:06:50.411026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db2aef-f879-476f-86c6-7ed298c33a04 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:50.411322 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-09eb2101-c561-4702-ba39-6406fa0c052b admin admin] The token cache is being invalidate because project 0f3fef0053154af18f1c0891d6b5b555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:50.411322 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-09eb2101-c561-4702-ba39-6406fa0c052b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.415045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d7db2aef-f879-476f-86c6-7ed298c33a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:50.426099 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-09eb2101-c561-4702-ba39-6406fa0c052b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.439924 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 948/1891] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:50 2022] DELETE /identity/v3/projects/0f3fef0053154af18f1c0891d6b5b555 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:50.439924 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb2101-c561-4702-ba39-6406fa0c052b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:50.439924 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-09eb2101-c561-4702-ba39-6406fa0c052b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:50.581550 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db2aef-f879-476f-86c6-7ed298c33a04 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:50.650023 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb2101-c561-4702-ba39-6406fa0c052b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:50.655574 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:50.658596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c501f-858f-4297-83d3-bd3323aa1cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:50.659916 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c501f-858f-4297-83d3-bd3323aa1cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:50.660365 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c501f-858f-4297-83d3-bd3323aa1cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:50.661196 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c501f-858f-4297-83d3-bd3323aa1cc3 admin admin] PATH_INFO: `/v3/users/32f16ad7a5c14a7dbff763b92d0603f9` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:50.662976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c501f-858f-4297-83d3-bd3323aa1cc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32f16ad7a5c14a7dbff763b92d0603f9)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:50.665262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c501f-858f-4297-83d3-bd3323aa1cc3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:50.700831 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536188a-fa26-4e76-838a-5aa4a72af4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:50.701913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536188a-fa26-4e76-838a-5aa4a72af4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:50.702299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536188a-fa26-4e76-838a-5aa4a72af4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:50.703744 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536188a-fa26-4e76-838a-5aa4a72af4d9 admin admin] PATH_INFO: `/v3/users/286032dd99454cb981fc09b30dcf62ce` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:50.706619 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536188a-fa26-4e76-838a-5aa4a72af4d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=286032dd99454cb981fc09b30dcf62ce)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:50.708820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536188a-fa26-4e76-838a-5aa4a72af4d9 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:50.750176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-957c501f-858f-4297-83d3-bd3323aa1cc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32f16ad7a5c14a7dbff763b92d0603f9'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.751399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-957c501f-858f-4297-83d3-bd3323aa1cc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32f16ad7a5c14a7dbff763b92d0603f9'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.767780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-957c501f-858f-4297-83d3-bd3323aa1cc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32f16ad7a5c14a7dbff763b92d0603f9'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.791024 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-957c501f-858f-4297-83d3-bd3323aa1cc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32f16ad7a5c14a7dbff763b92d0603f9'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.816867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-957c501f-858f-4297-83d3-bd3323aa1cc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32f16ad7a5c14a7dbff763b92d0603f9'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.822461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d536188a-fa26-4e76-838a-5aa4a72af4d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '286032dd99454cb981fc09b30dcf62ce'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.831001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 949/1892] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:50 2022] DELETE /identity/v3/users/32f16ad7a5c14a7dbff763b92d0603f9 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:50.831145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d536188a-fa26-4e76-838a-5aa4a72af4d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '286032dd99454cb981fc09b30dcf62ce'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.832588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b923c-b8cc-4ba0-84f4-01054dadbae5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:50.833332 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b923c-b8cc-4ba0-84f4-01054dadbae5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:50.844944 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b923c-b8cc-4ba0-84f4-01054dadbae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:50.865403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:50.873181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d536188a-fa26-4e76-838a-5aa4a72af4d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '286032dd99454cb981fc09b30dcf62ce'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.874021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d536188a-fa26-4e76-838a-5aa4a72af4d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '286032dd99454cb981fc09b30dcf62ce'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.875880 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d536188a-fa26-4e76-838a-5aa4a72af4d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '286032dd99454cb981fc09b30dcf62ce'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:50.888838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4b8b923c-b8cc-4ba0-84f4-01054dadbae5 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:50.891223 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4b8b923c-b8cc-4ba0-84f4-01054dadbae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:50.910368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 944/1893] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:50 2022] DELETE /identity/v3/users/286032dd99454cb981fc09b30dcf62ce => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:50.987996 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 950/1894] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:50.999436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7a6d3-28de-4174-89b4-d1b852cbb4af None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:50.999436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7a6d3-28de-4174-89b4-d1b852cbb4af None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:50.999436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7a6d3-28de-4174-89b4-d1b852cbb4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:51.026463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-75d7a6d3-28de-4174-89b4-d1b852cbb4af None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:51.028646 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-75d7a6d3-28de-4174-89b4-d1b852cbb4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:51.129595 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 945/1895] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:51.134119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b923c-b8cc-4ba0-84f4-01054dadbae5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:51.148414 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b923c-b8cc-4ba0-84f4-01054dadbae5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:51.156456 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b2127-5a17-4fd7-85d6-12f407e5eb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:51.157462 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b2127-5a17-4fd7-85d6-12f407e5eb63 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:51.158046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b2127-5a17-4fd7-85d6-12f407e5eb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:51.158554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b2127-5a17-4fd7-85d6-12f407e5eb63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:51.159862 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b2127-5a17-4fd7-85d6-12f407e5eb63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:06:51.160606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b2127-5a17-4fd7-85d6-12f407e5eb63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:51.163012 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b2127-5a17-4fd7-85d6-12f407e5eb63 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:51.180403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 951/1896] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:06:51.185831 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7a6d3-28de-4174-89b4-d1b852cbb4af None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:51.196509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7a6d3-28de-4174-89b4-d1b852cbb4af None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:51.202781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bdcb6-41e1-450c-85d5-92c2f8cd765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:51.203457 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bdcb6-41e1-450c-85d5-92c2f8cd765a admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:51.203748 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bdcb6-41e1-450c-85d5-92c2f8cd765a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:51.204027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bdcb6-41e1-450c-85d5-92c2f8cd765a admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:51.204742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bdcb6-41e1-450c-85d5-92c2f8cd765a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:51.206906 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bdcb6-41e1-450c-85d5-92c2f8cd765a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:51.244738 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 946/1897] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:51 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:51.249495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b2127-5a17-4fd7-85d6-12f407e5eb63 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:51.260597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b2127-5a17-4fd7-85d6-12f407e5eb63 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:51.347498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678eb39-c8f8-4d38-8015-3b5735fe9a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:51.348583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678eb39-c8f8-4d38-8015-3b5735fe9a69 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:51.348868 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678eb39-c8f8-4d38-8015-3b5735fe9a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:51.349188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678eb39-c8f8-4d38-8015-3b5735fe9a69 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:51.350022 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678eb39-c8f8-4d38-8015-3b5735fe9a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:51.353698 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678eb39-c8f8-4d38-8015-3b5735fe9a69 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:51.383919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 952/1898] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:51 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:06:51.392335 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bdcb6-41e1-450c-85d5-92c2f8cd765a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:51.406080 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bdcb6-41e1-450c-85d5-92c2f8cd765a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:51.411628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f3fe2-57ba-4ce6-8a11-5b8af20af32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:51.412330 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f3fe2-57ba-4ce6-8a11-5b8af20af32a admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:51.412615 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f3fe2-57ba-4ce6-8a11-5b8af20af32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:51.412897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f3fe2-57ba-4ce6-8a11-5b8af20af32a admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:51.413746 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f3fe2-57ba-4ce6-8a11-5b8af20af32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:51.415459 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f3fe2-57ba-4ce6-8a11-5b8af20af32a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:51.434803 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 947/1899] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:51.439506 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678eb39-c8f8-4d38-8015-3b5735fe9a69 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:51.460731 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678eb39-c8f8-4d38-8015-3b5735fe9a69 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:51.467921 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8248c-a1ad-4094-bbbb-6d89db4a405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:51.468778 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8248c-a1ad-4094-bbbb-6d89db4a405e admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:51.469545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8248c-a1ad-4094-bbbb-6d89db4a405e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:51.469545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8248c-a1ad-4094-bbbb-6d89db4a405e admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:51.470143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8248c-a1ad-4094-bbbb-6d89db4a405e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:51.472061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8248c-a1ad-4094-bbbb-6d89db4a405e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:51.484035 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 953/1900] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:51.488457 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f3fe2-57ba-4ce6-8a11-5b8af20af32a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:51.501710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f3fe2-57ba-4ce6-8a11-5b8af20af32a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:51.511095 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2f473-098b-4977-acc1-0988d454eac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:51.512977 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2f473-098b-4977-acc1-0988d454eac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:51.513336 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2f473-098b-4977-acc1-0988d454eac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:51.514562 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2f473-098b-4977-acc1-0988d454eac1 admin admin] PATH_INFO: `/v3/projects/630d615140d3475f9d4ea93b9ae7d99e/users/da1c5a7e20a9495fad7b80745663fcaa/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:51.564241 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2f473-098b-4977-acc1-0988d454eac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630d615140d3475f9d4ea93b9ae7d99e, user_id=da1c5a7e20a9495fad7b80745663fcaa, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:51.569633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2f473-098b-4977-acc1-0988d454eac1 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:51.575855 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:51.625293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 948/1901] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:51 2022] PUT /identity/v3/projects/630d615140d3475f9d4ea93b9ae7d99e/users/da1c5a7e20a9495fad7b80745663fcaa/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:51.642083 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39be63e-79b2-434e-805e-ae9a567ceba7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:51.642584 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39be63e-79b2-434e-805e-ae9a567ceba7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:51.642939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39be63e-79b2-434e-805e-ae9a567ceba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:51.680642 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c39be63e-79b2-434e-805e-ae9a567ceba7 None None] MFA Rules not processed for user `da1c5a7e20a9495fad7b80745663fcaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:51.682138 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c39be63e-79b2-434e-805e-ae9a567ceba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:51.796798 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2f473-098b-4977-acc1-0988d454eac1 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:51.801689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-33d2f473-098b-4977-acc1-0988d454eac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:51.839260 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:51.850160 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 954/1902] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:51.851347 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39be63e-79b2-434e-805e-ae9a567ceba7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:51.970661 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2f473-098b-4977-acc1-0988d454eac1 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:51.976229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053abb6e-0251-4e96-be67-8d8c92e270b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:51.977364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053abb6e-0251-4e96-be67-8d8c92e270b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:51.977766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053abb6e-0251-4e96-be67-8d8c92e270b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:51.979392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053abb6e-0251-4e96-be67-8d8c92e270b4 admin admin] PATH_INFO: `/v3/projects/ac750a1d7f1c4c8390b158d66c1bc698` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:51.980912 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053abb6e-0251-4e96-be67-8d8c92e270b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac750a1d7f1c4c8390b158d66c1bc698)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:51.983100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053abb6e-0251-4e96-be67-8d8c92e270b4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:51.996055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39be63e-79b2-434e-805e-ae9a567ceba7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:52.001488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870eb245-e184-4100-8dd6-dfc4b4bdfe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:52.002341 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eb245-e184-4100-8dd6-dfc4b4bdfe50 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:52.002538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eb245-e184-4100-8dd6-dfc4b4bdfe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:52.002821 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eb245-e184-4100-8dd6-dfc4b4bdfe50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:52.003530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870eb245-e184-4100-8dd6-dfc4b4bdfe50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:52.005477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870eb245-e184-4100-8dd6-dfc4b4bdfe50 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:52.045395 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 955/1903] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:51 2022] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:52.048659 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870eb245-e184-4100-8dd6-dfc4b4bdfe50 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:52.051473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-870eb245-e184-4100-8dd6-dfc4b4bdfe50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:52.109816 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-053abb6e-0251-4e96-be67-8d8c92e270b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac750a1d7f1c4c8390b158d66c1bc698', 'request_id': 'req-053abb6e-0251-4e96-be67-8d8c92e270b4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:52.126776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-053abb6e-0251-4e96-be67-8d8c92e270b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac750a1d7f1c4c8390b158d66c1bc698', 'request_id': 'req-053abb6e-0251-4e96-be67-8d8c92e270b4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:52.147423 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-053abb6e-0251-4e96-be67-8d8c92e270b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac750a1d7f1c4c8390b158d66c1bc698', 'request_id': 'req-053abb6e-0251-4e96-be67-8d8c92e270b4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:52.164766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-053abb6e-0251-4e96-be67-8d8c92e270b4 admin admin] The token cache is being invalidate because project ac750a1d7f1c4c8390b158d66c1bc698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:52.165052 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-053abb6e-0251-4e96-be67-8d8c92e270b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:52.166351 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-053abb6e-0251-4e96-be67-8d8c92e270b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:52.167983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870eb245-e184-4100-8dd6-dfc4b4bdfe50 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:52.168143 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 949/1904] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:51 2022] DELETE /identity/v3/projects/ac750a1d7f1c4c8390b158d66c1bc698 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:52.168909 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053abb6e-0251-4e96-be67-8d8c92e270b4 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:52.170294 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-053abb6e-0251-4e96-be67-8d8c92e270b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:52.242336 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e5f9e-5e94-41c6-afd5-28c949b37fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:52.243270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e5f9e-5e94-41c6-afd5-28c949b37fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:52.243684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e5f9e-5e94-41c6-afd5-28c949b37fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:52.244018 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e5f9e-5e94-41c6-afd5-28c949b37fbb admin admin] PATH_INFO: `/v3/projects/a13c3148b9fb48fe93ef0ff2002fdc3d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:52.247065 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e5f9e-5e94-41c6-afd5-28c949b37fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a13c3148b9fb48fe93ef0ff2002fdc3d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:52.249905 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e5f9e-5e94-41c6-afd5-28c949b37fbb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:52.282531 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053abb6e-0251-4e96-be67-8d8c92e270b4 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:52.287708 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c414ac4-366c-4129-bb75-2069d2872e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:52.288402 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c414ac4-366c-4129-bb75-2069d2872e82 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:52.289068 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c414ac4-366c-4129-bb75-2069d2872e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:52.289068 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c414ac4-366c-4129-bb75-2069d2872e82 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:52.289666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c414ac4-366c-4129-bb75-2069d2872e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:52.291708 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c414ac4-366c-4129-bb75-2069d2872e82 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:52.300452 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:52.319161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 950/1905] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:52 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:52.321131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011b6f8-5f25-4895-8e13-77a0489770a8 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:52.321637 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011b6f8-5f25-4895-8e13-77a0489770a8 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:52.322233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011b6f8-5f25-4895-8e13-77a0489770a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:52.326862 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-342e5f9e-5e94-41c6-afd5-28c949b37fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a13c3148b9fb48fe93ef0ff2002fdc3d', 'request_id': 'req-342e5f9e-5e94-41c6-afd5-28c949b37fbb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:52.335178 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-342e5f9e-5e94-41c6-afd5-28c949b37fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a13c3148b9fb48fe93ef0ff2002fdc3d', 'request_id': 'req-342e5f9e-5e94-41c6-afd5-28c949b37fbb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:52.342297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-342e5f9e-5e94-41c6-afd5-28c949b37fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a13c3148b9fb48fe93ef0ff2002fdc3d', 'request_id': 'req-342e5f9e-5e94-41c6-afd5-28c949b37fbb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:52.351278 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-3011b6f8-5f25-4895-8e13-77a0489770a8 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:52.352775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3011b6f8-5f25-4895-8e13-77a0489770a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:52.360592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-342e5f9e-5e94-41c6-afd5-28c949b37fbb admin admin] The token cache is being invalidate because project a13c3148b9fb48fe93ef0ff2002fdc3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:52.360887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-342e5f9e-5e94-41c6-afd5-28c949b37fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:52.361807 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-342e5f9e-5e94-41c6-afd5-28c949b37fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:52.363629 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 956/1906] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:52 2022] DELETE /identity/v3/projects/a13c3148b9fb48fe93ef0ff2002fdc3d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:52.364217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e5f9e-5e94-41c6-afd5-28c949b37fbb admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:52.364723 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:52.366860 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-342e5f9e-5e94-41c6-afd5-28c949b37fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:52.445379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 951/1907] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:52.447313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f3620-060c-4ebe-9a47-44e427560577 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:52.447609 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f3620-060c-4ebe-9a47-44e427560577 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:52.447888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f3620-060c-4ebe-9a47-44e427560577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:52.457177 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e5f9e-5e94-41c6-afd5-28c949b37fbb admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:52.462565 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f475c-e318-43b6-8c97-2978cd2f4f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:52.463496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f475c-e318-43b6-8c97-2978cd2f4f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:52.463781 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f475c-e318-43b6-8c97-2978cd2f4f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:52.464091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f475c-e318-43b6-8c97-2978cd2f4f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:52.464832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f475c-e318-43b6-8c97-2978cd2f4f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:52.466754 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f475c-e318-43b6-8c97-2978cd2f4f46 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:52.467501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b36f3620-060c-4ebe-9a47-44e427560577 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:52.468721 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b36f3620-060c-4ebe-9a47-44e427560577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:52.480814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 957/1908] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:52.482472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 952/1909] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:52.485721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d0594-9e10-4e32-b647-8d813cf2bc42 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:52.486024 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d0594-9e10-4e32-b647-8d813cf2bc42 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:52.486310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d0594-9e10-4e32-b647-8d813cf2bc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:52.486603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f3620-060c-4ebe-9a47-44e427560577 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:52.505510 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f3620-060c-4ebe-9a47-44e427560577 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:52.508711 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-fd6d0594-9e10-4e32-b647-8d813cf2bc42 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:52.510299 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fd6d0594-9e10-4e32-b647-8d813cf2bc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:52.515467 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09379d-ac90-44cb-9b27-f4eeb8ae5ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:52.516382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09379d-ac90-44cb-9b27-f4eeb8ae5ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:52.516662 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09379d-ac90-44cb-9b27-f4eeb8ae5ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:52.516938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09379d-ac90-44cb-9b27-f4eeb8ae5ed3 admin admin] PATH_INFO: `/v3/projects/0510c58f1c4e49f586ac4ca5f74de34c/users/de2302a3524a453a9690d139cd7ed219/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:52.519929 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 958/1910] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:52.523210 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce572852-ce9b-4e4d-b772-bd86a6865b63 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:52.523210 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce572852-ce9b-4e4d-b772-bd86a6865b63 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:52.523210 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce572852-ce9b-4e4d-b772-bd86a6865b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:52.534266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09379d-ac90-44cb-9b27-f4eeb8ae5ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0510c58f1c4e49f586ac4ca5f74de34c, user_id=de2302a3524a453a9690d139cd7ed219, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:52.537553 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09379d-ac90-44cb-9b27-f4eeb8ae5ed3 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:52.541963 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ce572852-ce9b-4e4d-b772-bd86a6865b63 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:52.544545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ce572852-ce9b-4e4d-b772-bd86a6865b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:52.555321 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 959/1911] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:52.556183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce572852-ce9b-4e4d-b772-bd86a6865b63 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:52.559643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 953/1912] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:52 2022] PUT /identity/v3/projects/0510c58f1c4e49f586ac4ca5f74de34c/users/de2302a3524a453a9690d139cd7ed219/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:52.564453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09379d-ac90-44cb-9b27-f4eeb8ae5ed3 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:52.568441 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce572852-ce9b-4e4d-b772-bd86a6865b63 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:52.644466 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc367d-3af8-4adc-bdf1-dafc8549c149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:52.645146 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc367d-3af8-4adc-bdf1-dafc8549c149 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:52.645428 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc367d-3af8-4adc-bdf1-dafc8549c149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:52.645795 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc367d-3af8-4adc-bdf1-dafc8549c149 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:52.646534 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc367d-3af8-4adc-bdf1-dafc8549c149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:06:52.646847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc367d-3af8-4adc-bdf1-dafc8549c149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:52.648555 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc367d-3af8-4adc-bdf1-dafc8549c149 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:52.658793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09379d-ac90-44cb-9b27-f4eeb8ae5ed3 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:52.664452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f37c29-228a-4b5f-a37a-56392610bdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:52.665278 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f37c29-228a-4b5f-a37a-56392610bdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:52.665643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f37c29-228a-4b5f-a37a-56392610bdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:52.666032 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f37c29-228a-4b5f-a37a-56392610bdf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:52.666505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 960/1913] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:06:52.666912 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f37c29-228a-4b5f-a37a-56392610bdf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:06:52.667247 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc367d-3af8-4adc-bdf1-dafc8549c149 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:52.667383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f37c29-228a-4b5f-a37a-56392610bdf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:52.669149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f37c29-228a-4b5f-a37a-56392610bdf3 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:52.677838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc367d-3af8-4adc-bdf1-dafc8549c149 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:52.684595 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b174205-85a1-4d0b-b5b2-88e25ba8c9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:52.685267 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b174205-85a1-4d0b-b5b2-88e25ba8c9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:52.685559 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b174205-85a1-4d0b-b5b2-88e25ba8c9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:52.686140 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b174205-85a1-4d0b-b5b2-88e25ba8c9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:52.686297 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 954/1914] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:06:52.686756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b174205-85a1-4d0b-b5b2-88e25ba8c9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:52.686992 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f37c29-228a-4b5f-a37a-56392610bdf3 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:52.688391 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b174205-85a1-4d0b-b5b2-88e25ba8c9e9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:52.699476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f37c29-228a-4b5f-a37a-56392610bdf3 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:52.702626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 961/1915] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:52.703728 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b174205-85a1-4d0b-b5b2-88e25ba8c9e9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:52.704781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086bb4e-54f3-466d-8e68-d4767c55e497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:52.705451 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086bb4e-54f3-466d-8e68-d4767c55e497 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:52.705768 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086bb4e-54f3-466d-8e68-d4767c55e497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:52.706185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086bb4e-54f3-466d-8e68-d4767c55e497 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:52.707179 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086bb4e-54f3-466d-8e68-d4767c55e497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:52.710393 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086bb4e-54f3-466d-8e68-d4767c55e497 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:52.718773 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b174205-85a1-4d0b-b5b2-88e25ba8c9e9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:52.723691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544f3f2-0a49-4f02-9a92-88d13321ec14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:52.724351 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544f3f2-0a49-4f02-9a92-88d13321ec14 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:52.724634 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544f3f2-0a49-4f02-9a92-88d13321ec14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:52.724908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544f3f2-0a49-4f02-9a92-88d13321ec14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:52.725600 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544f3f2-0a49-4f02-9a92-88d13321ec14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:52.727528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544f3f2-0a49-4f02-9a92-88d13321ec14 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:52.751150 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 955/1916] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:52 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:52.751150 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086bb4e-54f3-466d-8e68-d4767c55e497 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:52.771473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 962/1917] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:52 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:52.771473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544f3f2-0a49-4f02-9a92-88d13321ec14 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:52.783267 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:52.822742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:52.828531 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086bb4e-54f3-466d-8e68-d4767c55e497 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:52.852271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544f3f2-0a49-4f02-9a92-88d13321ec14 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:52.857047 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec9cb3-325e-4f71-9d0a-1e5ba93592cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:52.857757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec9cb3-325e-4f71-9d0a-1e5ba93592cb admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:52.858042 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec9cb3-325e-4f71-9d0a-1e5ba93592cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:52.858320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec9cb3-325e-4f71-9d0a-1e5ba93592cb admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:52.859019 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec9cb3-325e-4f71-9d0a-1e5ba93592cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:52.860978 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec9cb3-325e-4f71-9d0a-1e5ba93592cb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:52.886132 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 963/1918] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:52 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:52.887458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec9cb3-325e-4f71-9d0a-1e5ba93592cb admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:52.896704 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207d723-a997-45ce-a18a-d25c3a6c7f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:52.897604 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207d723-a997-45ce-a18a-d25c3a6c7f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:52.897841 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec9cb3-325e-4f71-9d0a-1e5ba93592cb admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:52.897951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207d723-a997-45ce-a18a-d25c3a6c7f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:52.898187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207d723-a997-45ce-a18a-d25c3a6c7f91 admin admin] PATH_INFO: `/v3/projects/0510c58f1c4e49f586ac4ca5f74de34c/users/de2302a3524a453a9690d139cd7ed219/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:52.900238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207d723-a997-45ce-a18a-d25c3a6c7f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0510c58f1c4e49f586ac4ca5f74de34c, user_id=de2302a3524a453a9690d139cd7ed219, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:52.902533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39d178-0d36-46be-841c-57a7e9574e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:52.903191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39d178-0d36-46be-841c-57a7e9574e80 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:52.903530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39d178-0d36-46be-841c-57a7e9574e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:52.903633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207d723-a997-45ce-a18a-d25c3a6c7f91 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:52.903807 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39d178-0d36-46be-841c-57a7e9574e80 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:52.904523 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39d178-0d36-46be-841c-57a7e9574e80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:52.906466 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39d178-0d36-46be-841c-57a7e9574e80 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:52.918196 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 956/1919] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:52 2022] PUT /identity/v3/projects/0510c58f1c4e49f586ac4ca5f74de34c/users/de2302a3524a453a9690d139cd7ed219/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:52.919188 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207d723-a997-45ce-a18a-d25c3a6c7f91 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:52.927725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 964/1920] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:52 2022] POST /identity/v3/users => generated 288 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:52.932349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39d178-0d36-46be-841c-57a7e9574e80 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:52.950465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39d178-0d36-46be-841c-57a7e9574e80 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:53.015970 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207d723-a997-45ce-a18a-d25c3a6c7f91 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:53.021200 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216b67d-9193-42ad-a39e-6da69cf2344f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:53.021477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b1c61-f312-460b-adb6-35a580b061a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:53.021993 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216b67d-9193-42ad-a39e-6da69cf2344f admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:53.022275 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216b67d-9193-42ad-a39e-6da69cf2344f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:53.022434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b1c61-f312-460b-adb6-35a580b061a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:53.022713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216b67d-9193-42ad-a39e-6da69cf2344f admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:53.022866 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b1c61-f312-460b-adb6-35a580b061a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:53.023471 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216b67d-9193-42ad-a39e-6da69cf2344f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:53.023699 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b1c61-f312-460b-adb6-35a580b061a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:53.024724 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b1c61-f312-460b-adb6-35a580b061a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:53.025231 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216b67d-9193-42ad-a39e-6da69cf2344f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:53.027251 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b1c61-f312-460b-adb6-35a580b061a8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:53.036236 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 957/1921] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:53.037619 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1109b41-82e8-49b0-ae46-34184495771a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:53.037934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1109b41-82e8-49b0-ae46-34184495771a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:53.038214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1109b41-82e8-49b0-ae46-34184495771a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:53.038644 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 965/1922] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:06:53.040075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b1c61-f312-460b-adb6-35a580b061a8 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:53.050805 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b1c61-f312-460b-adb6-35a580b061a8 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:53.060273 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14966a4a-6660-4936-bca9-f8ec9f845b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:53.066636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14966a4a-6660-4936-bca9-f8ec9f845b50 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:53.066636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14966a4a-6660-4936-bca9-f8ec9f845b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:53.066636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14966a4a-6660-4936-bca9-f8ec9f845b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:53.066636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14966a4a-6660-4936-bca9-f8ec9f845b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:53.066636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14966a4a-6660-4936-bca9-f8ec9f845b50 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:53.076304 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b1109b41-82e8-49b0-ae46-34184495771a None None] MFA Rules not processed for user `de2302a3524a453a9690d139cd7ed219`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:53.077750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b1109b41-82e8-49b0-ae46-34184495771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:53.082087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 966/1923] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:06:53.082087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14966a4a-6660-4936-bca9-f8ec9f845b50 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:53.092790 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14966a4a-6660-4936-bca9-f8ec9f845b50 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:53.098761 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4e612-1225-49da-b93d-d1c6c50ba451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:53.099952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4e612-1225-49da-b93d-d1c6c50ba451 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:53.100364 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4e612-1225-49da-b93d-d1c6c50ba451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:53.101261 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4e612-1225-49da-b93d-d1c6c50ba451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:53.102112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4e612-1225-49da-b93d-d1c6c50ba451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:53.103755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4e612-1225-49da-b93d-d1c6c50ba451 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:53.118990 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 967/1924] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:53.120200 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4e612-1225-49da-b93d-d1c6c50ba451 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:53.132557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4e612-1225-49da-b93d-d1c6c50ba451 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:53.138955 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c139935-c19f-4e39-b73d-b306733531e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:53.139978 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c139935-c19f-4e39-b73d-b306733531e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:53.140288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c139935-c19f-4e39-b73d-b306733531e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:53.140912 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c139935-c19f-4e39-b73d-b306733531e2 admin admin] PATH_INFO: `/v3/projects/e43681814e3b47b3b150f57a5b0294c4/users/23a9be8acd6548109936e2e7ae850084/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:53.163147 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c139935-c19f-4e39-b73d-b306733531e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43681814e3b47b3b150f57a5b0294c4, user_id=23a9be8acd6548109936e2e7ae850084, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:53.165956 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c139935-c19f-4e39-b73d-b306733531e2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:53.184249 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 968/1925] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:53 2022] PUT /identity/v3/projects/e43681814e3b47b3b150f57a5b0294c4/users/23a9be8acd6548109936e2e7ae850084/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:53.185295 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c139935-c19f-4e39-b73d-b306733531e2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:53.187390 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 958/1926] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:53.195820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37556331-c40c-4345-97d3-6ab5e25e6c93 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:53.196185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37556331-c40c-4345-97d3-6ab5e25e6c93 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:53.196477 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37556331-c40c-4345-97d3-6ab5e25e6c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:53.247449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:53.250084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-37556331-c40c-4345-97d3-6ab5e25e6c93 None None] MFA Rules not processed for user `23a9be8acd6548109936e2e7ae850084`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:53.251366 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-37556331-c40c-4345-97d3-6ab5e25e6c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:53.269316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:53.315263 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c139935-c19f-4e39-b73d-b306733531e2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:53.319929 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20e958-07c5-4a9c-bc81-e66acc43e1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:53.320836 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20e958-07c5-4a9c-bc81-e66acc43e1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:53.321122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20e958-07c5-4a9c-bc81-e66acc43e1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:53.321398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20e958-07c5-4a9c-bc81-e66acc43e1a0 admin admin] PATH_INFO: `/v3/projects/9720855c0c984b038348a02ce872b7ae/users/816046b774504e6fabbe136e42335b82/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:53.343537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20e958-07c5-4a9c-bc81-e66acc43e1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9720855c0c984b038348a02ce872b7ae, user_id=816046b774504e6fabbe136e42335b82, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:53.346559 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20e958-07c5-4a9c-bc81-e66acc43e1a0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:53.367063 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 969/1927] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:53 2022] PUT /identity/v3/projects/9720855c0c984b038348a02ce872b7ae/users/816046b774504e6fabbe136e42335b82/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:53.367769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20e958-07c5-4a9c-bc81-e66acc43e1a0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:53.383185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 959/1928] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:06:53.384311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8b20e958-07c5-4a9c-bc81-e66acc43e1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:53.384617 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd4635-9265-412f-a645-28ce5a684657 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:53.384912 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd4635-9265-412f-a645-28ce5a684657 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:53.385196 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd4635-9265-412f-a645-28ce5a684657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:53.427632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d6cd4635-9265-412f-a645-28ce5a684657 None None] MFA Rules not processed for user `816046b774504e6fabbe136e42335b82`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:53.429779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d6cd4635-9265-412f-a645-28ce5a684657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:53.500268 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20e958-07c5-4a9c-bc81-e66acc43e1a0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:53.504876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914231-c5cb-418e-9cc0-113594c5cb31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:53.505562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914231-c5cb-418e-9cc0-113594c5cb31 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:53.507564 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914231-c5cb-418e-9cc0-113594c5cb31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:53.507858 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914231-c5cb-418e-9cc0-113594c5cb31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:53.520360 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 960/1929] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:53.520360 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd4635-9265-412f-a645-28ce5a684657 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:53.582976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07914231-c5cb-418e-9cc0-113594c5cb31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:53.584544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07914231-c5cb-418e-9cc0-113594c5cb31 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:53.591577 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd4635-9265-412f-a645-28ce5a684657 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:53.594966 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 970/1930] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:53.595826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914231-c5cb-418e-9cc0-113594c5cb31 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:53.596696 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076748de-c85f-404a-8db0-4e43415bc8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:53.597271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-07914231-c5cb-418e-9cc0-113594c5cb31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:53.597496 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076748de-c85f-404a-8db0-4e43415bc8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:53.597870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076748de-c85f-404a-8db0-4e43415bc8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:53.598219 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076748de-c85f-404a-8db0-4e43415bc8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:53.598993 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076748de-c85f-404a-8db0-4e43415bc8e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:53.600980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076748de-c85f-404a-8db0-4e43415bc8e1 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:53.615471 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914231-c5cb-418e-9cc0-113594c5cb31 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:53.619955 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c940-bacb-430a-86d2-81572dbcce8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:53.621590 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c940-bacb-430a-86d2-81572dbcce8f service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:53.622428 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c940-bacb-430a-86d2-81572dbcce8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:53.622800 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9c940-bacb-430a-86d2-81572dbcce8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:53.634798 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9c940-bacb-430a-86d2-81572dbcce8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:53.635018 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 961/1931] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:53 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:53.637511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9c940-bacb-430a-86d2-81572dbcce8f service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:53.645464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076748de-c85f-404a-8db0-4e43415bc8e1 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:53.649895 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 971/1932] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:53.674531 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:53.743306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c940-bacb-430a-86d2-81572dbcce8f service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:53.750713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076748de-c85f-404a-8db0-4e43415bc8e1 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:53.753268 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9c940-bacb-430a-86d2-81572dbcce8f service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:53.756985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518da29-b35a-4805-b2e6-4e8553a66085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:53.758153 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518da29-b35a-4805-b2e6-4e8553a66085 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:53.758651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518da29-b35a-4805-b2e6-4e8553a66085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:53.759253 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518da29-b35a-4805-b2e6-4e8553a66085 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:53.760167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518da29-b35a-4805-b2e6-4e8553a66085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:53.763436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518da29-b35a-4805-b2e6-4e8553a66085 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:53.796466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 962/1933] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:53 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:06:53.802073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518da29-b35a-4805-b2e6-4e8553a66085 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:53.814601 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:53.825859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa482a3-2b0a-4654-acc8-69fb1f82749b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:53.826536 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa482a3-2b0a-4654-acc8-69fb1f82749b service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:53.826828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa482a3-2b0a-4654-acc8-69fb1f82749b service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:53.827105 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa482a3-2b0a-4654-acc8-69fb1f82749b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:53.837225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-aaa482a3-2b0a-4654-acc8-69fb1f82749b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:53.837416 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518da29-b35a-4805-b2e6-4e8553a66085 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:53.840828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c673a07-d748-48d2-9e10-a4055f8b2459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:53.841640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c673a07-d748-48d2-9e10-a4055f8b2459 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:53.842274 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c673a07-d748-48d2-9e10-a4055f8b2459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:53.842588 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c673a07-d748-48d2-9e10-a4055f8b2459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:53.843558 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c673a07-d748-48d2-9e10-a4055f8b2459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:53.845525 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c673a07-d748-48d2-9e10-a4055f8b2459 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:53.897115 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 963/1934] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:53.899628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c673a07-d748-48d2-9e10-a4055f8b2459 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:53.927431 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa482a3-2b0a-4654-acc8-69fb1f82749b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:53.929604 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa482a3-2b0a-4654-acc8-69fb1f82749b service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:53.939511 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c673a07-d748-48d2-9e10-a4055f8b2459 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:53.942053 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 972/1935] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:06:53.955968 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb5e84-5e4e-4a45-8b44-a24ef89648a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:53.957279 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb5e84-5e4e-4a45-8b44-a24ef89648a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:53.958544 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb5e84-5e4e-4a45-8b44-a24ef89648a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:53.958839 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb5e84-5e4e-4a45-8b44-a24ef89648a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:53.961131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb5e84-5e4e-4a45-8b44-a24ef89648a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:53.966768 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb5e84-5e4e-4a45-8b44-a24ef89648a6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:54.013871 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 964/1936] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:54.015742 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa482a3-2b0a-4654-acc8-69fb1f82749b service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:54.031149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa482a3-2b0a-4654-acc8-69fb1f82749b service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:54.056048 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38857d-1d46-459d-b2ed-212ba28404d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:54.072816 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38857d-1d46-459d-b2ed-212ba28404d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:54.075800 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38857d-1d46-459d-b2ed-212ba28404d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:54.076062 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38857d-1d46-459d-b2ed-212ba28404d6 admin admin] PATH_INFO: `/v3/projects/1d7f078e6eb94f049594244283eb2d66/users/664aaf57cc24408599613fbc805729b7/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:54.127317 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb5e84-5e4e-4a45-8b44-a24ef89648a6 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:54.132325 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-38eb5e84-5e4e-4a45-8b44-a24ef89648a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:54.134874 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38857d-1d46-459d-b2ed-212ba28404d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7f078e6eb94f049594244283eb2d66, user_id=664aaf57cc24408599613fbc805729b7, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:54.141426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38857d-1d46-459d-b2ed-212ba28404d6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:54.171512 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb5e84-5e4e-4a45-8b44-a24ef89648a6 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:54.174064 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 973/1937] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:54 2022] PUT /identity/v3/projects/1d7f078e6eb94f049594244283eb2d66/users/664aaf57cc24408599613fbc805729b7/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:54.188041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6671e1-c67e-4b0c-8907-4033f020a8d5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:54.188403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6671e1-c67e-4b0c-8907-4033f020a8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:54.188685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6671e1-c67e-4b0c-8907-4033f020a8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:54.246381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0e6671e1-c67e-4b0c-8907-4033f020a8d5 None None] MFA Rules not processed for user `664aaf57cc24408599613fbc805729b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:54.247651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0e6671e1-c67e-4b0c-8907-4033f020a8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:54.302778 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8d61c-40a9-40e5-b2ad-4e9bbcbaa82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:54.303913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8d61c-40a9-40e5-b2ad-4e9bbcbaa82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:54.304867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8d61c-40a9-40e5-b2ad-4e9bbcbaa82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:54.308499 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8d61c-40a9-40e5-b2ad-4e9bbcbaa82d admin admin] PATH_INFO: `/v3/users/6d333ebaed9e4a8384159f7b65a71f22` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:54.308499 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8d61c-40a9-40e5-b2ad-4e9bbcbaa82d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d333ebaed9e4a8384159f7b65a71f22)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:54.310840 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8d61c-40a9-40e5-b2ad-4e9bbcbaa82d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:54.349290 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 974/1938] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:06:54.353767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6671e1-c67e-4b0c-8907-4033f020a8d5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:54.368389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6671e1-c67e-4b0c-8907-4033f020a8d5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:54.375453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7796b-b8f0-4f30-a32b-de2d8ea6db8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:54.376372 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7796b-b8f0-4f30-a32b-de2d8ea6db8f admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:54.376844 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7796b-b8f0-4f30-a32b-de2d8ea6db8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:54.377770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7796b-b8f0-4f30-a32b-de2d8ea6db8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:54.378718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7796b-b8f0-4f30-a32b-de2d8ea6db8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:54.381143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7796b-b8f0-4f30-a32b-de2d8ea6db8f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:54.411796 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c3d8d61c-40a9-40e5-b2ad-4e9bbcbaa82d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d333ebaed9e4a8384159f7b65a71f22'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:54.421332 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 975/1939] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:54 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:06:54.422367 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7796b-b8f0-4f30-a32b-de2d8ea6db8f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:54.446396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c3d8d61c-40a9-40e5-b2ad-4e9bbcbaa82d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d333ebaed9e4a8384159f7b65a71f22'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:54.469978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c3d8d61c-40a9-40e5-b2ad-4e9bbcbaa82d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d333ebaed9e4a8384159f7b65a71f22'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:54.471461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c3d8d61c-40a9-40e5-b2ad-4e9bbcbaa82d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d333ebaed9e4a8384159f7b65a71f22'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:54.472226 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c3d8d61c-40a9-40e5-b2ad-4e9bbcbaa82d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d333ebaed9e4a8384159f7b65a71f22'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:54.501529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:54.502482 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 965/1940] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:54 2022] DELETE /identity/v3/users/6d333ebaed9e4a8384159f7b65a71f22 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:54.503380 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8d61c-40a9-40e5-b2ad-4e9bbcbaa82d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:54.506528 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c3d8d61c-40a9-40e5-b2ad-4e9bbcbaa82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:54.532538 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:54.541298 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7796b-b8f0-4f30-a32b-de2d8ea6db8f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:54.618459 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8d61c-40a9-40e5-b2ad-4e9bbcbaa82d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:54.625758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f715734-ee15-4633-9a56-0eb6ba5527f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:54.625758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f715734-ee15-4633-9a56-0eb6ba5527f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:54.626087 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f715734-ee15-4633-9a56-0eb6ba5527f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:54.626174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f715734-ee15-4633-9a56-0eb6ba5527f1 admin admin] PATH_INFO: `/v3/users/da1c5a7e20a9495fad7b80745663fcaa` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:54.628412 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f715734-ee15-4633-9a56-0eb6ba5527f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da1c5a7e20a9495fad7b80745663fcaa)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:54.631379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f715734-ee15-4633-9a56-0eb6ba5527f1 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:54.659921 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61943b6c-fc82-4864-83ab-86b9459e3169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:54.662138 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61943b6c-fc82-4864-83ab-86b9459e3169 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:54.662916 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61943b6c-fc82-4864-83ab-86b9459e3169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:54.663418 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61943b6c-fc82-4864-83ab-86b9459e3169 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:54.664336 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61943b6c-fc82-4864-83ab-86b9459e3169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:54.667971 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61943b6c-fc82-4864-83ab-86b9459e3169 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:54.713129 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1f715734-ee15-4633-9a56-0eb6ba5527f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da1c5a7e20a9495fad7b80745663fcaa'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:54.732180 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 976/1941] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:54 2022] POST /identity/v3/users => generated 300 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:54.734740 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e581c3a-f58e-45aa-b6b7-b16bc8628518 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:54.734891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1f715734-ee15-4633-9a56-0eb6ba5527f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da1c5a7e20a9495fad7b80745663fcaa'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:54.735087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e581c3a-f58e-45aa-b6b7-b16bc8628518 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:54.735316 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e581c3a-f58e-45aa-b6b7-b16bc8628518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:54.774729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1e581c3a-f58e-45aa-b6b7-b16bc8628518 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:54.776335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1e581c3a-f58e-45aa-b6b7-b16bc8628518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:54.778178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1f715734-ee15-4633-9a56-0eb6ba5527f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da1c5a7e20a9495fad7b80745663fcaa'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:54.779636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1f715734-ee15-4633-9a56-0eb6ba5527f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da1c5a7e20a9495fad7b80745663fcaa'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:54.781487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1f715734-ee15-4633-9a56-0eb6ba5527f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da1c5a7e20a9495fad7b80745663fcaa'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:54.814624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 977/1942] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:54.819127 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 966/1943] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:54 2022] DELETE /identity/v3/users/da1c5a7e20a9495fad7b80745663fcaa => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:54.822292 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e581c3a-f58e-45aa-b6b7-b16bc8628518 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:54.825424 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea235c-fe53-4613-9539-cfaf74ddae13 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:54.826107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea235c-fe53-4613-9539-cfaf74ddae13 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:54.826232 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1e581c3a-f58e-45aa-b6b7-b16bc8628518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:54.826464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea235c-fe53-4613-9539-cfaf74ddae13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:54.854106 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ceea235c-fe53-4613-9539-cfaf74ddae13 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:54.857037 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e581c3a-f58e-45aa-b6b7-b16bc8628518 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:54.859356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ceea235c-fe53-4613-9539-cfaf74ddae13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:54.953832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a175c8-4951-46c0-96e5-e9e774367f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:54.954602 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a175c8-4951-46c0-96e5-e9e774367f4f admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:54.954900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a175c8-4951-46c0-96e5-e9e774367f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:54.955038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a175c8-4951-46c0-96e5-e9e774367f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:54.955783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a175c8-4951-46c0-96e5-e9e774367f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:54.957890 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a175c8-4951-46c0-96e5-e9e774367f4f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:54.974004 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 978/1944] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:54.974230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 967/1945] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:06:54.974326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a175c8-4951-46c0-96e5-e9e774367f4f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:54.975644 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea235c-fe53-4613-9539-cfaf74ddae13 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:54.989884 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea235c-fe53-4613-9539-cfaf74ddae13 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:54.992242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-77a175c8-4951-46c0-96e5-e9e774367f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:54.995251 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbbec8-c084-41c0-a397-1a3c6ea91239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:54.997328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbbec8-c084-41c0-a397-1a3c6ea91239 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:54.997615 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbbec8-c084-41c0-a397-1a3c6ea91239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:54.998062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbbec8-c084-41c0-a397-1a3c6ea91239 admin admin] PATH_INFO: `/v3/projects/64b2128f02884265b6d6c5cf6e93e8a8/users/a32a5ff50840463d8f566ecb83110cbd/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:55.021857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdbbec8-c084-41c0-a397-1a3c6ea91239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b2128f02884265b6d6c5cf6e93e8a8, user_id=a32a5ff50840463d8f566ecb83110cbd, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:55.025106 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdbbec8-c084-41c0-a397-1a3c6ea91239 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:55.047950 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 968/1946] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:54 2022] PUT /identity/v3/projects/64b2128f02884265b6d6c5cf6e93e8a8/users/a32a5ff50840463d8f566ecb83110cbd/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:06:55.048965 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbbec8-c084-41c0-a397-1a3c6ea91239 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:55.051466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1fdbbec8-c084-41c0-a397-1a3c6ea91239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:55.068443 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:55.108546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a175c8-4951-46c0-96e5-e9e774367f4f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:55.153288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbbec8-c084-41c0-a397-1a3c6ea91239 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:55.161505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc45f83-b353-4c31-bedc-966ca09ab6cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:55.163012 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc45f83-b353-4c31-bedc-966ca09ab6cc service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:55.163619 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc45f83-b353-4c31-bedc-966ca09ab6cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:55.164266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc45f83-b353-4c31-bedc-966ca09ab6cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:55.168901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:55.228524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f1704-b8f7-4115-9bc3-8c22585f8be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:55.228718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f1704-b8f7-4115-9bc3-8c22585f8be7 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:55.229013 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f1704-b8f7-4115-9bc3-8c22585f8be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:55.229406 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f1704-b8f7-4115-9bc3-8c22585f8be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:55.271552 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc45f83-b353-4c31-bedc-966ca09ab6cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:55.273245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc45f83-b353-4c31-bedc-966ca09ab6cc service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:55.286545 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 969/1947] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:55.287795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc45f83-b353-4c31-bedc-966ca09ab6cc service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:55.301713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc45f83-b353-4c31-bedc-966ca09ab6cc service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:55.320984 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc37e6-dfe8-4f12-921e-1d97b0b84951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:55.321808 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc37e6-dfe8-4f12-921e-1d97b0b84951 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:55.322354 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc37e6-dfe8-4f12-921e-1d97b0b84951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:55.322718 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc37e6-dfe8-4f12-921e-1d97b0b84951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:55.325141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc37e6-dfe8-4f12-921e-1d97b0b84951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:55.328418 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc37e6-dfe8-4f12-921e-1d97b0b84951 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:55.357518 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 970/1948] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:55.358870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc37e6-dfe8-4f12-921e-1d97b0b84951 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:55.366649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f1704-b8f7-4115-9bc3-8c22585f8be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:55.369191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f1704-b8f7-4115-9bc3-8c22585f8be7 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:55.453237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 979/1949] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:55.454985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc37e6-dfe8-4f12-921e-1d97b0b84951 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:55.462592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb2d51-46b9-4dc8-8b3d-fe826c283e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:55.463779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb2d51-46b9-4dc8-8b3d-fe826c283e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:55.464295 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb2d51-46b9-4dc8-8b3d-fe826c283e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:55.464561 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb2d51-46b9-4dc8-8b3d-fe826c283e21 admin admin] PATH_INFO: `/v3/projects/64b2128f02884265b6d6c5cf6e93e8a8/users/a32a5ff50840463d8f566ecb83110cbd/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:55.466970 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb2d51-46b9-4dc8-8b3d-fe826c283e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b2128f02884265b6d6c5cf6e93e8a8, user_id=a32a5ff50840463d8f566ecb83110cbd, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:55.470604 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb2d51-46b9-4dc8-8b3d-fe826c283e21 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:55.505548 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 971/1950] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:55 2022] PUT /identity/v3/projects/64b2128f02884265b6d6c5cf6e93e8a8/users/a32a5ff50840463d8f566ecb83110cbd/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:55.516916 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cb1c1-0ad0-4229-9ffb-37f9b39e3e6c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:55.517216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cb1c1-0ad0-4229-9ffb-37f9b39e3e6c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:55.517503 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cb1c1-0ad0-4229-9ffb-37f9b39e3e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:55.569222 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-353cb1c1-0ad0-4229-9ffb-37f9b39e3e6c None None] MFA Rules not processed for user `a32a5ff50840463d8f566ecb83110cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:55.570550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-353cb1c1-0ad0-4229-9ffb-37f9b39e3e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:55.666632 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 980/1951] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:55.678781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb2d51-46b9-4dc8-8b3d-fe826c283e21 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:55.681258 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-78bb2d51-46b9-4dc8-8b3d-fe826c283e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:55.755974 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:55.832891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb2d51-46b9-4dc8-8b3d-fe826c283e21 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:55.841384 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e986914-af48-47eb-8c6a-d8e20710939e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:55.842265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e986914-af48-47eb-8c6a-d8e20710939e service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:55.842434 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e986914-af48-47eb-8c6a-d8e20710939e service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:55.844694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e986914-af48-47eb-8c6a-d8e20710939e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:55.856112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e986914-af48-47eb-8c6a-d8e20710939e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:55.857837 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e986914-af48-47eb-8c6a-d8e20710939e service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:55.872832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 972/1952] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:55.976234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cb1c1-0ad0-4229-9ffb-37f9b39e3e6c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:55.977971 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-353cb1c1-0ad0-4229-9ffb-37f9b39e3e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:56.021999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:56.079317 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cb1c1-0ad0-4229-9ffb-37f9b39e3e6c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:56.084239 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da13ad5-f543-429f-a1d5-8d14c66fb106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:56.085146 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da13ad5-f543-429f-a1d5-8d14c66fb106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:56.085593 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da13ad5-f543-429f-a1d5-8d14c66fb106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:56.085745 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da13ad5-f543-429f-a1d5-8d14c66fb106 admin admin] PATH_INFO: `/v3/projects/b951375b8ac14f22b50dc3dc49aa4e24` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:56.087037 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da13ad5-f543-429f-a1d5-8d14c66fb106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b951375b8ac14f22b50dc3dc49aa4e24)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:56.089318 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da13ad5-f543-429f-a1d5-8d14c66fb106 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:56.157410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1da13ad5-f543-429f-a1d5-8d14c66fb106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b951375b8ac14f22b50dc3dc49aa4e24', 'request_id': 'req-1da13ad5-f543-429f-a1d5-8d14c66fb106'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:56.168635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1da13ad5-f543-429f-a1d5-8d14c66fb106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b951375b8ac14f22b50dc3dc49aa4e24', 'request_id': 'req-1da13ad5-f543-429f-a1d5-8d14c66fb106'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:56.176486 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1da13ad5-f543-429f-a1d5-8d14c66fb106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b951375b8ac14f22b50dc3dc49aa4e24', 'request_id': 'req-1da13ad5-f543-429f-a1d5-8d14c66fb106'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:56.192395 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1da13ad5-f543-429f-a1d5-8d14c66fb106 admin admin] The token cache is being invalidate because project b951375b8ac14f22b50dc3dc49aa4e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:56.192724 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1da13ad5-f543-429f-a1d5-8d14c66fb106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:56.193380 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1da13ad5-f543-429f-a1d5-8d14c66fb106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:56.198056 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 981/1953] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:55 2022] DELETE /identity/v3/projects/b951375b8ac14f22b50dc3dc49aa4e24 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:56.201613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e986914-af48-47eb-8c6a-d8e20710939e service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:56.225369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e986914-af48-47eb-8c6a-d8e20710939e service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:56.295176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c07298-d513-4e2e-8e1c-962c6c3f4795 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:56.295458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c07298-d513-4e2e-8e1c-962c6c3f4795 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:56.295844 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c07298-d513-4e2e-8e1c-962c6c3f4795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:56.329972 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-88c07298-d513-4e2e-8e1c-962c6c3f4795 None None] MFA Rules not processed for user `816046b774504e6fabbe136e42335b82`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:56.331217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-88c07298-d513-4e2e-8e1c-962c6c3f4795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:56.335466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022eb63-64be-4dc1-8bf3-744bad29ea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:56.336353 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022eb63-64be-4dc1-8bf3-744bad29ea98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:56.336660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022eb63-64be-4dc1-8bf3-744bad29ea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:56.336924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022eb63-64be-4dc1-8bf3-744bad29ea98 admin admin] PATH_INFO: `/v3/users/57fdbbb2f89c46008bc761670580a105` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:56.341558 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022eb63-64be-4dc1-8bf3-744bad29ea98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57fdbbb2f89c46008bc761670580a105)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:56.345726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022eb63-64be-4dc1-8bf3-744bad29ea98 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:56.461682 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4022eb63-64be-4dc1-8bf3-744bad29ea98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57fdbbb2f89c46008bc761670580a105'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:56.480240 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 982/1954] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:56.481580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c07298-d513-4e2e-8e1c-962c6c3f4795 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:56.486279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-88c07298-d513-4e2e-8e1c-962c6c3f4795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:56.487098 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4022eb63-64be-4dc1-8bf3-744bad29ea98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57fdbbb2f89c46008bc761670580a105'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:56.518474 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c07298-d513-4e2e-8e1c-962c6c3f4795 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:56.533142 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4022eb63-64be-4dc1-8bf3-744bad29ea98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57fdbbb2f89c46008bc761670580a105'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:56.533982 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a99da6-4a42-472c-bed9-162347f24b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:56.534194 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4022eb63-64be-4dc1-8bf3-744bad29ea98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57fdbbb2f89c46008bc761670580a105'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:56.534802 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4022eb63-64be-4dc1-8bf3-744bad29ea98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57fdbbb2f89c46008bc761670580a105'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:56.535001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a99da6-4a42-472c-bed9-162347f24b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:56.535243 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a99da6-4a42-472c-bed9-162347f24b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:56.535464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a99da6-4a42-472c-bed9-162347f24b95 admin admin] PATH_INFO: `/v3/projects/630d615140d3475f9d4ea93b9ae7d99e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:56.537968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a99da6-4a42-472c-bed9-162347f24b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=630d615140d3475f9d4ea93b9ae7d99e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:56.540021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a99da6-4a42-472c-bed9-162347f24b95 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:56.577380 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 973/1955] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:56 2022] DELETE /identity/v3/users/57fdbbb2f89c46008bc761670580a105 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:56.641695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:56.646666 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-62a99da6-4a42-472c-bed9-162347f24b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630d615140d3475f9d4ea93b9ae7d99e', 'request_id': 'req-62a99da6-4a42-472c-bed9-162347f24b95'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:56.667015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-62a99da6-4a42-472c-bed9-162347f24b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630d615140d3475f9d4ea93b9ae7d99e', 'request_id': 'req-62a99da6-4a42-472c-bed9-162347f24b95'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:56.677246 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-62a99da6-4a42-472c-bed9-162347f24b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630d615140d3475f9d4ea93b9ae7d99e', 'request_id': 'req-62a99da6-4a42-472c-bed9-162347f24b95'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:56.692982 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-62a99da6-4a42-472c-bed9-162347f24b95 admin admin] The token cache is being invalidate because project 630d615140d3475f9d4ea93b9ae7d99e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:56.693280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-62a99da6-4a42-472c-bed9-162347f24b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:56.694021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-62a99da6-4a42-472c-bed9-162347f24b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:56.700879 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022eb63-64be-4dc1-8bf3-744bad29ea98 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:56.701437 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 983/1956] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:56 2022] DELETE /identity/v3/projects/630d615140d3475f9d4ea93b9ae7d99e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:56.702433 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4022eb63-64be-4dc1-8bf3-744bad29ea98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:56.812009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:56.836243 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022eb63-64be-4dc1-8bf3-744bad29ea98 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:56.860636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a99da6-4a42-472c-bed9-162347f24b95 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:56.862179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-62a99da6-4a42-472c-bed9-162347f24b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:56.930093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a8b19-a46e-4cda-b254-bd920f07b7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:56.930993 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a8b19-a46e-4cda-b254-bd920f07b7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:56.931282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a8b19-a46e-4cda-b254-bd920f07b7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:56.931560 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a8b19-a46e-4cda-b254-bd920f07b7f4 admin admin] PATH_INFO: `/v3/users/de2302a3524a453a9690d139cd7ed219` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:56.933850 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a8b19-a46e-4cda-b254-bd920f07b7f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de2302a3524a453a9690d139cd7ed219)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:56.936194 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a8b19-a46e-4cda-b254-bd920f07b7f4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:56.944320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a99da6-4a42-472c-bed9-162347f24b95 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:56.949592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d733a2f-7db3-47a9-be06-f5a1c6e10ee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:56.950590 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d733a2f-7db3-47a9-be06-f5a1c6e10ee3 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:56.950955 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d733a2f-7db3-47a9-be06-f5a1c6e10ee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:56.951313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d733a2f-7db3-47a9-be06-f5a1c6e10ee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:56.953357 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6d733a2f-7db3-47a9-be06-f5a1c6e10ee3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:56.996507 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-386a8b19-a46e-4cda-b254-bd920f07b7f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de2302a3524a453a9690d139cd7ed219'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:57.004834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-386a8b19-a46e-4cda-b254-bd920f07b7f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de2302a3524a453a9690d139cd7ed219'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:57.021535 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-386a8b19-a46e-4cda-b254-bd920f07b7f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de2302a3524a453a9690d139cd7ed219'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:57.023698 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-386a8b19-a46e-4cda-b254-bd920f07b7f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de2302a3524a453a9690d139cd7ed219'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:57.025081 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-386a8b19-a46e-4cda-b254-bd920f07b7f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de2302a3524a453a9690d139cd7ed219'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:57.030226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d733a2f-7db3-47a9-be06-f5a1c6e10ee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:57.031822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d733a2f-7db3-47a9-be06-f5a1c6e10ee3 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:57.045937 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 974/1957] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:56 2022] DELETE /identity/v3/users/de2302a3524a453a9690d139cd7ed219 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:57.049828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 984/1958] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:06:57.376549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a8b19-a46e-4cda-b254-bd920f07b7f4 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:57.378762 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-386a8b19-a46e-4cda-b254-bd920f07b7f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:57.537799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d733a2f-7db3-47a9-be06-f5a1c6e10ee3 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:57.539397 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6d733a2f-7db3-47a9-be06-f5a1c6e10ee3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:57.572174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d733a2f-7db3-47a9-be06-f5a1c6e10ee3 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:57.576838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a8b19-a46e-4cda-b254-bd920f07b7f4 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:57.589424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571c849-062b-463c-969b-0b3964bd7c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:57.591133 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571c849-062b-463c-969b-0b3964bd7c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:57.591923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571c849-062b-463c-969b-0b3964bd7c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:57.592487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571c849-062b-463c-969b-0b3964bd7c41 admin admin] PATH_INFO: `/v3/projects/0510c58f1c4e49f586ac4ca5f74de34c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:57.594035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a1c4f-8ff1-441c-89d4-42975202121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:57.595680 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a1c4f-8ff1-441c-89d4-42975202121b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:57.595965 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a1c4f-8ff1-441c-89d4-42975202121b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:57.596243 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a1c4f-8ff1-441c-89d4-42975202121b admin admin] PATH_INFO: `/v3/projects/b0ae1e5cbee0468593fef691fdf3da5f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:57.597080 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571c849-062b-463c-969b-0b3964bd7c41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0510c58f1c4e49f586ac4ca5f74de34c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:57.597543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a1c4f-8ff1-441c-89d4-42975202121b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ae1e5cbee0468593fef691fdf3da5f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:57.600173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a1c4f-8ff1-441c-89d4-42975202121b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:57.601697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571c849-062b-463c-969b-0b3964bd7c41 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:57.624143 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:57.675772 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-789a1c4f-8ff1-441c-89d4-42975202121b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ae1e5cbee0468593fef691fdf3da5f', 'request_id': 'req-789a1c4f-8ff1-441c-89d4-42975202121b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:57.681249 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4571c849-062b-463c-969b-0b3964bd7c41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0510c58f1c4e49f586ac4ca5f74de34c', 'request_id': 'req-4571c849-062b-463c-969b-0b3964bd7c41'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:57.685550 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-789a1c4f-8ff1-441c-89d4-42975202121b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ae1e5cbee0468593fef691fdf3da5f', 'request_id': 'req-789a1c4f-8ff1-441c-89d4-42975202121b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:57.691496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4571c849-062b-463c-969b-0b3964bd7c41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0510c58f1c4e49f586ac4ca5f74de34c', 'request_id': 'req-4571c849-062b-463c-969b-0b3964bd7c41'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:57.694110 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-789a1c4f-8ff1-441c-89d4-42975202121b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ae1e5cbee0468593fef691fdf3da5f', 'request_id': 'req-789a1c4f-8ff1-441c-89d4-42975202121b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:57.700855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4571c849-062b-463c-969b-0b3964bd7c41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0510c58f1c4e49f586ac4ca5f74de34c', 'request_id': 'req-4571c849-062b-463c-969b-0b3964bd7c41'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:57.715052 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4571c849-062b-463c-969b-0b3964bd7c41 admin admin] The token cache is being invalidate because project 0510c58f1c4e49f586ac4ca5f74de34c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:57.715528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4571c849-062b-463c-969b-0b3964bd7c41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:57.716217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4571c849-062b-463c-969b-0b3964bd7c41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:57.716763 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-789a1c4f-8ff1-441c-89d4-42975202121b admin admin] The token cache is being invalidate because project b0ae1e5cbee0468593fef691fdf3da5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:57.717139 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-789a1c4f-8ff1-441c-89d4-42975202121b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:57.718083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-789a1c4f-8ff1-441c-89d4-42975202121b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:57.718739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 985/1959] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:57 2022] DELETE /identity/v3/projects/0510c58f1c4e49f586ac4ca5f74de34c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:57.723654 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f794171-0b43-4a8b-9039-6b31b31ad655 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:57.723884 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f794171-0b43-4a8b-9039-6b31b31ad655 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:57.724165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f794171-0b43-4a8b-9039-6b31b31ad655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:57.725348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 975/1960] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:57 2022] DELETE /identity/v3/projects/b0ae1e5cbee0468593fef691fdf3da5f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:06:57.731972 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339c0e4-f7f9-4369-96af-1e2d8ba6e719 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:57.732459 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339c0e4-f7f9-4369-96af-1e2d8ba6e719 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:57.734159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339c0e4-f7f9-4369-96af-1e2d8ba6e719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:57.741337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:57.805876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6f794171-0b43-4a8b-9039-6b31b31ad655 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:57.807305 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6f794171-0b43-4a8b-9039-6b31b31ad655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:57.814620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f339c0e4-f7f9-4369-96af-1e2d8ba6e719 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:57.816696 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f339c0e4-f7f9-4369-96af-1e2d8ba6e719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:57.879904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 986/1961] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:06:57.890804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c921a27-5e2b-4d0b-9329-671a5d6f41a4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:57.891086 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c921a27-5e2b-4d0b-9329-671a5d6f41a4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:57.891360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c921a27-5e2b-4d0b-9329-671a5d6f41a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:57.927067 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9c921a27-5e2b-4d0b-9329-671a5d6f41a4 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:57.928168 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9c921a27-5e2b-4d0b-9329-671a5d6f41a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:57.937488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 987/1962] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:57.941898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c921a27-5e2b-4d0b-9329-671a5d6f41a4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:57.946798 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 976/1963] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:57.961720 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d451d-235c-4dad-a212-938ad7292dca None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:57.962327 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d451d-235c-4dad-a212-938ad7292dca None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:57.963671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d451d-235c-4dad-a212-938ad7292dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:57.969826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c921a27-5e2b-4d0b-9329-671a5d6f41a4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:57.975953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582c550-66a8-4103-a837-c9a5e50a57ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:57.976683 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582c550-66a8-4103-a837-c9a5e50a57ac admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:57.976970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582c550-66a8-4103-a837-c9a5e50a57ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:57.977248 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582c550-66a8-4103-a837-c9a5e50a57ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:57.978025 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582c550-66a8-4103-a837-c9a5e50a57ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:06:57.978336 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582c550-66a8-4103-a837-c9a5e50a57ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:57.980452 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582c550-66a8-4103-a837-c9a5e50a57ac admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:57.994564 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 988/1964] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:06:57.998913 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582c550-66a8-4103-a837-c9a5e50a57ac admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:58.010225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582c550-66a8-4103-a837-c9a5e50a57ac admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:58.017871 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-236d451d-235c-4dad-a212-938ad7292dca None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:58.018049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1be474-5dd8-47de-8fd5-f13209104a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:58.018819 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1be474-5dd8-47de-8fd5-f13209104a70 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:58.019207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1be474-5dd8-47de-8fd5-f13209104a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:58.020037 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-236d451d-235c-4dad-a212-938ad7292dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:58.020440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1be474-5dd8-47de-8fd5-f13209104a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:58.021250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1be474-5dd8-47de-8fd5-f13209104a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:58.026179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1be474-5dd8-47de-8fd5-f13209104a70 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:58.049003 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 977/1965] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:58.059623 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d451d-235c-4dad-a212-938ad7292dca None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:58.082779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d451d-235c-4dad-a212-938ad7292dca None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:58.083093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 989/1966] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:57 2022] POST /identity/v3/projects => generated 359 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:06:58.086899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1be474-5dd8-47de-8fd5-f13209104a70 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:58.167237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1be474-5dd8-47de-8fd5-f13209104a70 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:58.173063 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71df778-bd6a-4887-80e7-3d76497ec84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:58.173905 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71df778-bd6a-4887-80e7-3d76497ec84b admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:58.174316 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71df778-bd6a-4887-80e7-3d76497ec84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:58.174603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71df778-bd6a-4887-80e7-3d76497ec84b admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:58.175307 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71df778-bd6a-4887-80e7-3d76497ec84b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:58.177342 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71df778-bd6a-4887-80e7-3d76497ec84b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:58.180546 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcaff2-7b62-4792-908a-20f986604efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:58.181365 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcaff2-7b62-4792-908a-20f986604efc admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:58.181674 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcaff2-7b62-4792-908a-20f986604efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:58.181971 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bcaff2-7b62-4792-908a-20f986604efc admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:58.183364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bcaff2-7b62-4792-908a-20f986604efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:06:58.183684 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bcaff2-7b62-4792-908a-20f986604efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:58.185309 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bcaff2-7b62-4792-908a-20f986604efc admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:58.199081 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 978/1967] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 17:06:58.201624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 990/1968] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:58 2022] POST /identity/v3/users => generated 280 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:06:58.203860 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcaff2-7b62-4792-908a-20f986604efc admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:58.206592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71df778-bd6a-4887-80e7-3d76497ec84b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:58.216626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bcaff2-7b62-4792-908a-20f986604efc admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:58.219559 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71df778-bd6a-4887-80e7-3d76497ec84b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:58.221998 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ea549-e693-4be3-8541-ae9ce1a20505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:58.222685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ea549-e693-4be3-8541-ae9ce1a20505 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:58.222972 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ea549-e693-4be3-8541-ae9ce1a20505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:58.223388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ea549-e693-4be3-8541-ae9ce1a20505 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:58.224270 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ea549-e693-4be3-8541-ae9ce1a20505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:58.224536 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342bd49-438a-457a-856d-beb4e336abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:58.225293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342bd49-438a-457a-856d-beb4e336abaf admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:58.225529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342bd49-438a-457a-856d-beb4e336abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:58.225848 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342bd49-438a-457a-856d-beb4e336abaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:58.226265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ea549-e693-4be3-8541-ae9ce1a20505 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:58.226591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342bd49-438a-457a-856d-beb4e336abaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:58.228195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342bd49-438a-457a-856d-beb4e336abaf admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:58.243088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 991/1969] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:06:58.247510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342bd49-438a-457a-856d-beb4e336abaf admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:58.254426 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:58.258666 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342bd49-438a-457a-856d-beb4e336abaf admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:58.262707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 979/1970] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:58 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:06:58.265609 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b64ce-9f17-4a51-925e-cc410b24268c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:58.266374 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b64ce-9f17-4a51-925e-cc410b24268c admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:58.266635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b64ce-9f17-4a51-925e-cc410b24268c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:58.266942 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b64ce-9f17-4a51-925e-cc410b24268c admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:58.267153 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ea549-e693-4be3-8541-ae9ce1a20505 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:58.267660 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b64ce-9f17-4a51-925e-cc410b24268c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:58.269354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b64ce-9f17-4a51-925e-cc410b24268c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:58.281872 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 992/1971] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:58.285921 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b64ce-9f17-4a51-925e-cc410b24268c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:58.299065 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b64ce-9f17-4a51-925e-cc410b24268c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:58.313230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:58.341049 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ea549-e693-4be3-8541-ae9ce1a20505 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:58.345958 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dcbdf-842e-41a5-a13b-985ea74c7fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:58.346650 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dcbdf-842e-41a5-a13b-985ea74c7fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:58.346940 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dcbdf-842e-41a5-a13b-985ea74c7fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:58.347225 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dcbdf-842e-41a5-a13b-985ea74c7fcc admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:58.347926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118dcbdf-842e-41a5-a13b-985ea74c7fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:58.349893 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118dcbdf-842e-41a5-a13b-985ea74c7fcc admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:58.373849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91930ec4-8b59-4e82-b296-45a6e5b2bca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:58.374256 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 980/1972] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:58 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:06:58.375709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91930ec4-8b59-4e82-b296-45a6e5b2bca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:58.376175 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91930ec4-8b59-4e82-b296-45a6e5b2bca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:58.376523 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91930ec4-8b59-4e82-b296-45a6e5b2bca9 admin admin] PATH_INFO: `/v3/projects/a18e2f43d3424c39bf1f26142584c1c2/users/92315235825e4950ae95dff6437bef27/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:58.378350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dcbdf-842e-41a5-a13b-985ea74c7fcc admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:58.389335 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dcbdf-842e-41a5-a13b-985ea74c7fcc admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:58.394236 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972c320-ffcc-400c-88ff-7ced34463e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:58.394622 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91930ec4-8b59-4e82-b296-45a6e5b2bca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18e2f43d3424c39bf1f26142584c1c2, user_id=92315235825e4950ae95dff6437bef27, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:58.394929 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972c320-ffcc-400c-88ff-7ced34463e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:58.395216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972c320-ffcc-400c-88ff-7ced34463e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:58.395492 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972c320-ffcc-400c-88ff-7ced34463e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:58.396226 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972c320-ffcc-400c-88ff-7ced34463e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:58.397317 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91930ec4-8b59-4e82-b296-45a6e5b2bca9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:58.397890 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972c320-ffcc-400c-88ff-7ced34463e35 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:58.408799 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 981/1973] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:06:58.415456 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 993/1974] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:58 2022] PUT /identity/v3/projects/a18e2f43d3424c39bf1f26142584c1c2/users/92315235825e4950ae95dff6437bef27/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:06:58.415637 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972c320-ffcc-400c-88ff-7ced34463e35 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:58.423858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972c320-ffcc-400c-88ff-7ced34463e35 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:58.424133 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109557f-8f26-427c-a0cb-5a4073004cc7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:58.424411 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109557f-8f26-427c-a0cb-5a4073004cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:58.424695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109557f-8f26-427c-a0cb-5a4073004cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:58.453040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4109557f-8f26-427c-a0cb-5a4073004cc7 None None] MFA Rules not processed for user `92315235825e4950ae95dff6437bef27`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:58.454307 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4109557f-8f26-427c-a0cb-5a4073004cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:58.489426 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26808c24-f9a0-4076-b8eb-ae2a26949754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:58.490078 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26808c24-f9a0-4076-b8eb-ae2a26949754 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:58.490473 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26808c24-f9a0-4076-b8eb-ae2a26949754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:58.490773 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26808c24-f9a0-4076-b8eb-ae2a26949754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:58.491666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26808c24-f9a0-4076-b8eb-ae2a26949754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:58.493339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26808c24-f9a0-4076-b8eb-ae2a26949754 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:58.504529 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 982/1975] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:58.508606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26808c24-f9a0-4076-b8eb-ae2a26949754 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:58.518746 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26808c24-f9a0-4076-b8eb-ae2a26949754 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:58.523708 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633abde-b957-49dd-923e-e6f23bad13ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:58.524592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633abde-b957-49dd-923e-e6f23bad13ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:58.525084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633abde-b957-49dd-923e-e6f23bad13ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:58.525220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633abde-b957-49dd-923e-e6f23bad13ba admin admin] PATH_INFO: `/v3/projects/e52eeb9b56af410b8d573fb2174943bf/users/961afeb9197546ae80afb6c3f9e6baeb/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:58.528525 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 994/1976] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:58 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:06:58.540500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633abde-b957-49dd-923e-e6f23bad13ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e52eeb9b56af410b8d573fb2174943bf, user_id=961afeb9197546ae80afb6c3f9e6baeb, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:58.543855 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633abde-b957-49dd-923e-e6f23bad13ba admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:58.559913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 983/1977] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:58 2022] PUT /identity/v3/projects/e52eeb9b56af410b8d573fb2174943bf/users/961afeb9197546ae80afb6c3f9e6baeb/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:06:58.564059 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109557f-8f26-427c-a0cb-5a4073004cc7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:58.565475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4109557f-8f26-427c-a0cb-5a4073004cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:58.570907 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3b253-e9c4-4ecd-a69e-68e164422a8f None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:58.571227 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3b253-e9c4-4ecd-a69e-68e164422a8f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:58.571512 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3b253-e9c4-4ecd-a69e-68e164422a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:58.598054 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a1a3b253-e9c4-4ecd-a69e-68e164422a8f None None] MFA Rules not processed for user `961afeb9197546ae80afb6c3f9e6baeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:58.599320 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a1a3b253-e9c4-4ecd-a69e-68e164422a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:58.629922 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109557f-8f26-427c-a0cb-5a4073004cc7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:58.643960 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:58.683133 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 984/1978] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:06:58.684872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3b253-e9c4-4ecd-a69e-68e164422a8f None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:58.690347 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:58.700315 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbd1a2-81a9-468f-9d0e-2c4756751fd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:58.700977 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbd1a2-81a9-468f-9d0e-2c4756751fd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:58.701269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbd1a2-81a9-468f-9d0e-2c4756751fd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:58.701545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbd1a2-81a9-468f-9d0e-2c4756751fd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:58.786196 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3b253-e9c4-4ecd-a69e-68e164422a8f None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:58.792140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db6b7d-4aa3-4e75-8f1b-8ff061e6464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:58.793129 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db6b7d-4aa3-4e75-8f1b-8ff061e6464a admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:58.793757 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db6b7d-4aa3-4e75-8f1b-8ff061e6464a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:58.794226 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db6b7d-4aa3-4e75-8f1b-8ff061e6464a admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:58.794951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db6b7d-4aa3-4e75-8f1b-8ff061e6464a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:58.797050 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db6b7d-4aa3-4e75-8f1b-8ff061e6464a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:58.806889 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbd1a2-81a9-468f-9d0e-2c4756751fd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:58.809429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbd1a2-81a9-468f-9d0e-2c4756751fd3 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:58.824469 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 995/1979] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:58 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:58.834758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 985/1980] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:06:58 2022] POST /identity/v3/projects => generated 363 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:06:58.839173 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbd1a2-81a9-468f-9d0e-2c4756751fd3 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:58.844148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db6b7d-4aa3-4e75-8f1b-8ff061e6464a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:58.865090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbd1a2-81a9-468f-9d0e-2c4756751fd3 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:58.935871 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db6b7d-4aa3-4e75-8f1b-8ff061e6464a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:58.940780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95a513-4fce-450f-90ba-3949c9e64891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:58.941140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a82bd0-9497-40ca-a29d-35bf7c7049a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:58.941577 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95a513-4fce-450f-90ba-3949c9e64891 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:58.942035 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95a513-4fce-450f-90ba-3949c9e64891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:58.942232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a82bd0-9497-40ca-a29d-35bf7c7049a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:58.942325 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95a513-4fce-450f-90ba-3949c9e64891 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:58.942606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a82bd0-9497-40ca-a29d-35bf7c7049a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:58.942971 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a82bd0-9497-40ca-a29d-35bf7c7049a5 admin admin] PATH_INFO: `/v3/users/92315235825e4950ae95dff6437bef27` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:58.943155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95a513-4fce-450f-90ba-3949c9e64891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:58.944711 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a82bd0-9497-40ca-a29d-35bf7c7049a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92315235825e4950ae95dff6437bef27)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:58.945091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95a513-4fce-450f-90ba-3949c9e64891 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:58.946693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a82bd0-9497-40ca-a29d-35bf7c7049a5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:58.975174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 996/1981] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:06:58 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:06:58.980303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95a513-4fce-450f-90ba-3949c9e64891 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:58.992161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95a513-4fce-450f-90ba-3949c9e64891 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:58.997590 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0e9c6-15de-4c33-bb68-2ddbc1e1c222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:58.998475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0e9c6-15de-4c33-bb68-2ddbc1e1c222 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:58.998776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0e9c6-15de-4c33-bb68-2ddbc1e1c222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:58.999130 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0e9c6-15de-4c33-bb68-2ddbc1e1c222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:58.999954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0e9c6-15de-4c33-bb68-2ddbc1e1c222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:59.001673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0e9c6-15de-4c33-bb68-2ddbc1e1c222 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:59.005824 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-45a82bd0-9497-40ca-a29d-35bf7c7049a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92315235825e4950ae95dff6437bef27'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:59.015031 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-45a82bd0-9497-40ca-a29d-35bf7c7049a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92315235825e4950ae95dff6437bef27'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:59.015982 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 997/1982] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:59.019932 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0e9c6-15de-4c33-bb68-2ddbc1e1c222 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:59.023421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:59.031807 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0e9c6-15de-4c33-bb68-2ddbc1e1c222 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:59.033877 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-45a82bd0-9497-40ca-a29d-35bf7c7049a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92315235825e4950ae95dff6437bef27'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:59.036911 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-45a82bd0-9497-40ca-a29d-35bf7c7049a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92315235825e4950ae95dff6437bef27'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:59.036911 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-45a82bd0-9497-40ca-a29d-35bf7c7049a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92315235825e4950ae95dff6437bef27'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:59.037241 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf806c-307c-4d03-8701-184b3487df70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:59.038251 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf806c-307c-4d03-8701-184b3487df70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:59.038532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf806c-307c-4d03-8701-184b3487df70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:59.038809 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf806c-307c-4d03-8701-184b3487df70 admin admin] PATH_INFO: `/v3/projects/053f36a2fc0143dea57a41a068c86637/users/4dbe43ef6ad34d869b8c31d576e2b6ee/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:59.056929 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 986/1983] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:06:58 2022] DELETE /identity/v3/users/92315235825e4950ae95dff6437bef27 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:06:59.062464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a4a09-02a8-44e8-ab2a-f68f1526e59d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:59.062821 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a4a09-02a8-44e8-ab2a-f68f1526e59d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:59.063399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a4a09-02a8-44e8-ab2a-f68f1526e59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:59.078074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf806c-307c-4d03-8701-184b3487df70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=053f36a2fc0143dea57a41a068c86637, user_id=4dbe43ef6ad34d869b8c31d576e2b6ee, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:59.081452 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf806c-307c-4d03-8701-184b3487df70 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:59.087278 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-745a4a09-02a8-44e8-ab2a-f68f1526e59d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:59.088835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-745a4a09-02a8-44e8-ab2a-f68f1526e59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:59.100364 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 998/1984] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:59 2022] PUT /identity/v3/projects/053f36a2fc0143dea57a41a068c86637/users/4dbe43ef6ad34d869b8c31d576e2b6ee/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:06:59.102713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf806c-307c-4d03-8701-184b3487df70 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:59.105732 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b6bf806c-307c-4d03-8701-184b3487df70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:59.168727 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:59.191472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 987/1985] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:59.191928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf806c-307c-4d03-8701-184b3487df70 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:59.202063 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db199b3b-733f-4f76-8d77-96609a1616fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:59.202908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db199b3b-733f-4f76-8d77-96609a1616fe admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:59.203271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db199b3b-733f-4f76-8d77-96609a1616fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:59.203690 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db199b3b-733f-4f76-8d77-96609a1616fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:59.203812 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a4a09-02a8-44e8-ab2a-f68f1526e59d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:59.204573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db199b3b-733f-4f76-8d77-96609a1616fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:59.206442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db199b3b-733f-4f76-8d77-96609a1616fe admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:59.206657 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-745a4a09-02a8-44e8-ab2a-f68f1526e59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:59.225728 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 999/1986] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:06:59.227259 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db199b3b-733f-4f76-8d77-96609a1616fe admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:59.238814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db199b3b-733f-4f76-8d77-96609a1616fe admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:59.243885 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21b523-30f2-4f13-880b-7b4d3c432cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:59.244781 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21b523-30f2-4f13-880b-7b4d3c432cec admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:59.245058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21b523-30f2-4f13-880b-7b4d3c432cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:59.246196 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21b523-30f2-4f13-880b-7b4d3c432cec admin admin] PATH_INFO: `/v3/projects/053f36a2fc0143dea57a41a068c86637/users/4dbe43ef6ad34d869b8c31d576e2b6ee/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:59.248317 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21b523-30f2-4f13-880b-7b4d3c432cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=053f36a2fc0143dea57a41a068c86637, user_id=4dbe43ef6ad34d869b8c31d576e2b6ee, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:59.251664 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21b523-30f2-4f13-880b-7b4d3c432cec admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:59.263258 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1000/1987] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:06:59 2022] PUT /identity/v3/projects/053f36a2fc0143dea57a41a068c86637/users/4dbe43ef6ad34d869b8c31d576e2b6ee/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:06:59.273265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cc6b7-31e9-4738-ae49-674761a10eef None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:59.273570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cc6b7-31e9-4738-ae49-674761a10eef None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:59.273856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cc6b7-31e9-4738-ae49-674761a10eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:59.314873 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2c9cc6b7-31e9-4738-ae49-674761a10eef None None] MFA Rules not processed for user `4dbe43ef6ad34d869b8c31d576e2b6ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:59.316358 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2c9cc6b7-31e9-4738-ae49-674761a10eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:59.370864 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a4a09-02a8-44e8-ab2a-f68f1526e59d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:59.404713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1001/1988] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:59 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:06:59.416856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cc6b7-31e9-4738-ae49-674761a10eef None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:59.419424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2c9cc6b7-31e9-4738-ae49-674761a10eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:59.427653 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bee0fe-9e1c-4567-ad17-f2ccc996c07c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:59.428786 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bee0fe-9e1c-4567-ad17-f2ccc996c07c service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:59.429068 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bee0fe-9e1c-4567-ad17-f2ccc996c07c service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:59.429490 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bee0fe-9e1c-4567-ad17-f2ccc996c07c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:59.474357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:59.485861 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cc6b7-31e9-4738-ae49-674761a10eef None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:59.489678 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e394d2-06d1-42a1-98cd-1c96a4392e9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:59.490422 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e394d2-06d1-42a1-98cd-1c96a4392e9b service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:59.490794 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e394d2-06d1-42a1-98cd-1c96a4392e9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:59.491140 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e394d2-06d1-42a1-98cd-1c96a4392e9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:59.500613 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e394d2-06d1-42a1-98cd-1c96a4392e9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:59.502144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e394d2-06d1-42a1-98cd-1c96a4392e9b service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:59.507023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bee0fe-9e1c-4567-ad17-f2ccc996c07c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:59.508506 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bee0fe-9e1c-4567-ad17-f2ccc996c07c service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:59.512505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1002/1989] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:59 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:06:59.521007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 988/1990] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:59.599485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e394d2-06d1-42a1-98cd-1c96a4392e9b service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:59.610034 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e394d2-06d1-42a1-98cd-1c96a4392e9b service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:59.614578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c260c-5454-4c2d-a80d-1046aa38e0d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:59.615501 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c260c-5454-4c2d-a80d-1046aa38e0d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:59.615501 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c260c-5454-4c2d-a80d-1046aa38e0d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:59.615777 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c260c-5454-4c2d-a80d-1046aa38e0d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:59.618024 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e81c260c-5454-4c2d-a80d-1046aa38e0d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:59.688740 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c260c-5454-4c2d-a80d-1046aa38e0d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:59.690364 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c260c-5454-4c2d-a80d-1046aa38e0d6 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:59.700831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1003/1991] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:06:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:06:59.833192 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bee0fe-9e1c-4567-ad17-f2ccc996c07c service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:06:59.834901 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-56bee0fe-9e1c-4567-ad17-f2ccc996c07c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:06:59.855083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bee0fe-9e1c-4567-ad17-f2ccc996c07c service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:06:59.860168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46f524-abfa-4083-a1aa-ca2117c2d15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:06:59.861175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46f524-abfa-4083-a1aa-ca2117c2d15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:59.861331 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46f524-abfa-4083-a1aa-ca2117c2d15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:59.861614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46f524-abfa-4083-a1aa-ca2117c2d15e admin admin] PATH_INFO: `/v3/projects/a18e2f43d3424c39bf1f26142584c1c2` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:59.862856 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46f524-abfa-4083-a1aa-ca2117c2d15e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18e2f43d3424c39bf1f26142584c1c2)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:06:59.864856 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46f524-abfa-4083-a1aa-ca2117c2d15e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:06:59.919440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-6b46f524-abfa-4083-a1aa-ca2117c2d15e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18e2f43d3424c39bf1f26142584c1c2', 'request_id': 'req-6b46f524-abfa-4083-a1aa-ca2117c2d15e'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:59.929537 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-6b46f524-abfa-4083-a1aa-ca2117c2d15e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18e2f43d3424c39bf1f26142584c1c2', 'request_id': 'req-6b46f524-abfa-4083-a1aa-ca2117c2d15e'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:59.937598 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-6b46f524-abfa-4083-a1aa-ca2117c2d15e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18e2f43d3424c39bf1f26142584c1c2', 'request_id': 'req-6b46f524-abfa-4083-a1aa-ca2117c2d15e'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:59.952986 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-6b46f524-abfa-4083-a1aa-ca2117c2d15e admin admin] The token cache is being invalidate because project a18e2f43d3424c39bf1f26142584c1c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:06:59.953297 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-6b46f524-abfa-4083-a1aa-ca2117c2d15e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:59.953977 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-6b46f524-abfa-4083-a1aa-ca2117c2d15e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:06:59.955783 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 989/1992] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:06:59 2022] DELETE /identity/v3/projects/a18e2f43d3424c39bf1f26142584c1c2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:06:59.960618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228c7e9-91b3-4472-ade6-7d49ad417a29 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:06:59.960919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228c7e9-91b3-4472-ade6-7d49ad417a29 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:06:59.961207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228c7e9-91b3-4472-ade6-7d49ad417a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:06:59.973099 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:59.987800 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e228c7e9-91b3-4472-ade6-7d49ad417a29 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:06:59.989694 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e228c7e9-91b3-4472-ade6-7d49ad417a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:00.072807 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1004/1993] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:00.082824 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d5ff3-97fa-4443-961f-442856469c56 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:00.083680 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d5ff3-97fa-4443-961f-442856469c56 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:00.084169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d5ff3-97fa-4443-961f-442856469c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:00.125924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-cf9d5ff3-97fa-4443-961f-442856469c56 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:00.127168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cf9d5ff3-97fa-4443-961f-442856469c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:00.136531 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 990/1994] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:00.141242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228c7e9-91b3-4472-ade6-7d49ad417a29 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:00.153009 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228c7e9-91b3-4472-ade6-7d49ad417a29 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:00.158983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d0d3a-8324-4ce5-8be5-79f109b7cf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:00.159664 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d0d3a-8324-4ce5-8be5-79f109b7cf75 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:00.159955 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d0d3a-8324-4ce5-8be5-79f109b7cf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:00.160240 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d0d3a-8324-4ce5-8be5-79f109b7cf75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:00.161014 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d0d3a-8324-4ce5-8be5-79f109b7cf75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:07:00.161398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d0d3a-8324-4ce5-8be5-79f109b7cf75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:00.163166 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d0d3a-8324-4ce5-8be5-79f109b7cf75 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:00.176890 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1005/1995] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:07:00.181973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d5ff3-97fa-4443-961f-442856469c56 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:00.207206 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d5ff3-97fa-4443-961f-442856469c56 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:00.228100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6171f69-5a90-4072-9e55-c3721bd0ed17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:00.229076 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6171f69-5a90-4072-9e55-c3721bd0ed17 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:00.231992 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6171f69-5a90-4072-9e55-c3721bd0ed17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:00.232511 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6171f69-5a90-4072-9e55-c3721bd0ed17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:00.238659 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6171f69-5a90-4072-9e55-c3721bd0ed17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:00.243636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6171f69-5a90-4072-9e55-c3721bd0ed17 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:00.294987 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 991/1996] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:07:00 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:00.300361 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d0d3a-8324-4ce5-8be5-79f109b7cf75 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:00.312735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d0d3a-8324-4ce5-8be5-79f109b7cf75 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:00.395518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6773ff4-7427-4efa-afa4-444e50daf955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:00.396896 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6773ff4-7427-4efa-afa4-444e50daf955 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:00.397313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6773ff4-7427-4efa-afa4-444e50daf955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:00.397908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6773ff4-7427-4efa-afa4-444e50daf955 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:00.398685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6773ff4-7427-4efa-afa4-444e50daf955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:00.400729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6773ff4-7427-4efa-afa4-444e50daf955 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:00.427046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1006/1997] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:07:00 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:00.431245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6171f69-5a90-4072-9e55-c3721bd0ed17 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:00.446259 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6171f69-5a90-4072-9e55-c3721bd0ed17 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:00.452713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a634876-fe76-4e73-aa31-c2c16ffc435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:00.453431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a634876-fe76-4e73-aa31-c2c16ffc435a admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:00.453826 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a634876-fe76-4e73-aa31-c2c16ffc435a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:00.454308 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a634876-fe76-4e73-aa31-c2c16ffc435a admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:00.455174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a634876-fe76-4e73-aa31-c2c16ffc435a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:00.457042 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a634876-fe76-4e73-aa31-c2c16ffc435a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:00.473704 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 992/1998] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:00.476021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6773ff4-7427-4efa-afa4-444e50daf955 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:00.488055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6773ff4-7427-4efa-afa4-444e50daf955 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:00.492975 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d03cc5-632d-4adf-b321-7d5e89cf35de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:00.493685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d03cc5-632d-4adf-b321-7d5e89cf35de admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:00.493991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d03cc5-632d-4adf-b321-7d5e89cf35de admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:00.494268 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d03cc5-632d-4adf-b321-7d5e89cf35de admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:00.495020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d03cc5-632d-4adf-b321-7d5e89cf35de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:00.497251 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d03cc5-632d-4adf-b321-7d5e89cf35de admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:00.513374 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1007/1999] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:00.515921 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a634876-fe76-4e73-aa31-c2c16ffc435a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:00.528868 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a634876-fe76-4e73-aa31-c2c16ffc435a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:00.537572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368050f-1288-4159-b442-ab569eebe2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:00.538507 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368050f-1288-4159-b442-ab569eebe2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:00.538792 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368050f-1288-4159-b442-ab569eebe2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:00.539069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368050f-1288-4159-b442-ab569eebe2fd admin admin] PATH_INFO: `/v3/projects/ff59a82bf6a14020bb24a82368f8aed3/users/610c2f7f02214c2da660b19156986479/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:00.555704 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368050f-1288-4159-b442-ab569eebe2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff59a82bf6a14020bb24a82368f8aed3, user_id=610c2f7f02214c2da660b19156986479, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:00.559069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368050f-1288-4159-b442-ab569eebe2fd admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:00.575573 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 993/2000] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:00 2022] PUT /identity/v3/projects/ff59a82bf6a14020bb24a82368f8aed3/users/610c2f7f02214c2da660b19156986479/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:00.585926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed7d27-ed0e-43cf-b274-8d9256898453 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:00.586249 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed7d27-ed0e-43cf-b274-8d9256898453 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:00.586527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed7d27-ed0e-43cf-b274-8d9256898453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:00.614868 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-99ed7d27-ed0e-43cf-b274-8d9256898453 None None] MFA Rules not processed for user `610c2f7f02214c2da660b19156986479`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:00.616090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-99ed7d27-ed0e-43cf-b274-8d9256898453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:00.689313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:00.695144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1008/2001] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:00.708259 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368050f-1288-4159-b442-ab569eebe2fd admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:00.710640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d368050f-1288-4159-b442-ab569eebe2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:00.766044 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:00.770593 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368050f-1288-4159-b442-ab569eebe2fd admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:00.775440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e36f5-bef3-4a5c-aa56-e0a90bed1257 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:00.776112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e36f5-bef3-4a5c-aa56-e0a90bed1257 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:00.776734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e36f5-bef3-4a5c-aa56-e0a90bed1257 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:00.777258 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e36f5-bef3-4a5c-aa56-e0a90bed1257 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:00.788126 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e36f5-bef3-4a5c-aa56-e0a90bed1257 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:00.790110 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e36f5-bef3-4a5c-aa56-e0a90bed1257 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:00.801829 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 994/2002] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:00.833862 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed7d27-ed0e-43cf-b274-8d9256898453 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:00.902698 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed7d27-ed0e-43cf-b274-8d9256898453 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:00.909190 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2968911-c04c-4f34-a527-0ea21f84d791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:00.910561 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2968911-c04c-4f34-a527-0ea21f84d791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:00.910855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2968911-c04c-4f34-a527-0ea21f84d791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:00.911140 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2968911-c04c-4f34-a527-0ea21f84d791 admin admin] PATH_INFO: `/v3/users/610c2f7f02214c2da660b19156986479` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:00.912437 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2968911-c04c-4f34-a527-0ea21f84d791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=610c2f7f02214c2da660b19156986479)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:00.914405 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2968911-c04c-4f34-a527-0ea21f84d791 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:00.989141 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f2968911-c04c-4f34-a527-0ea21f84d791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '610c2f7f02214c2da660b19156986479'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:00.989878 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f2968911-c04c-4f34-a527-0ea21f84d791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '610c2f7f02214c2da660b19156986479'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:01.001286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f2968911-c04c-4f34-a527-0ea21f84d791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '610c2f7f02214c2da660b19156986479'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:01.008927 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f2968911-c04c-4f34-a527-0ea21f84d791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '610c2f7f02214c2da660b19156986479'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:01.023300 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f2968911-c04c-4f34-a527-0ea21f84d791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '610c2f7f02214c2da660b19156986479'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:01.033114 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1009/2003] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:07:00 2022] DELETE /identity/v3/users/610c2f7f02214c2da660b19156986479 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:01.035143 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8356d47-63ed-42aa-8ac9-dc9fb7d04168 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:01.035436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8356d47-63ed-42aa-8ac9-dc9fb7d04168 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:01.035732 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8356d47-63ed-42aa-8ac9-dc9fb7d04168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:01.059619 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f8356d47-63ed-42aa-8ac9-dc9fb7d04168 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:01.061108 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f8356d47-63ed-42aa-8ac9-dc9fb7d04168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:01.156632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 995/2004] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:01.168196 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2968911-c04c-4f34-a527-0ea21f84d791 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:01.170342 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f2968911-c04c-4f34-a527-0ea21f84d791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:01.242265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2968911-c04c-4f34-a527-0ea21f84d791 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:01.246623 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6cbef-aa5c-449e-842d-e210d867eff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:01.247313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6cbef-aa5c-449e-842d-e210d867eff5 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:01.247556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6cbef-aa5c-449e-842d-e210d867eff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:01.247837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6cbef-aa5c-449e-842d-e210d867eff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:01.260297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6cbef-aa5c-449e-842d-e210d867eff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:01.264960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6cbef-aa5c-449e-842d-e210d867eff5 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:01.278276 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1010/2005] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:01.531857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8356d47-63ed-42aa-8ac9-dc9fb7d04168 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:01.533389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f8356d47-63ed-42aa-8ac9-dc9fb7d04168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:01.576792 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6cbef-aa5c-449e-842d-e210d867eff5 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:01.578378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-dbd6cbef-aa5c-449e-842d-e210d867eff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:01.594103 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6cbef-aa5c-449e-842d-e210d867eff5 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:01.599995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca850a47-319c-46fa-8b6c-5d0ce744eb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:01.600894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca850a47-319c-46fa-8b6c-5d0ce744eb64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:01.601181 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca850a47-319c-46fa-8b6c-5d0ce744eb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:01.601459 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca850a47-319c-46fa-8b6c-5d0ce744eb64 admin admin] PATH_INFO: `/v3/projects/ff59a82bf6a14020bb24a82368f8aed3` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:01.602737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca850a47-319c-46fa-8b6c-5d0ce744eb64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff59a82bf6a14020bb24a82368f8aed3)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:01.604697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca850a47-319c-46fa-8b6c-5d0ce744eb64 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:01.624032 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:01.625901 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8356d47-63ed-42aa-8ac9-dc9fb7d04168 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:01.629843 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af31bd-3816-48cd-bb48-0dee507ea8d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:01.630503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af31bd-3816-48cd-bb48-0dee507ea8d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:01.630788 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af31bd-3816-48cd-bb48-0dee507ea8d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:01.631063 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af31bd-3816-48cd-bb48-0dee507ea8d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:01.633025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-95af31bd-3816-48cd-bb48-0dee507ea8d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:01.659766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ca850a47-319c-46fa-8b6c-5d0ce744eb64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff59a82bf6a14020bb24a82368f8aed3', 'request_id': 'req-ca850a47-319c-46fa-8b6c-5d0ce744eb64'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:01.668327 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ca850a47-319c-46fa-8b6c-5d0ce744eb64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff59a82bf6a14020bb24a82368f8aed3', 'request_id': 'req-ca850a47-319c-46fa-8b6c-5d0ce744eb64'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:01.679113 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ca850a47-319c-46fa-8b6c-5d0ce744eb64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff59a82bf6a14020bb24a82368f8aed3', 'request_id': 'req-ca850a47-319c-46fa-8b6c-5d0ce744eb64'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:01.690841 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ca850a47-319c-46fa-8b6c-5d0ce744eb64 admin admin] The token cache is being invalidate because project ff59a82bf6a14020bb24a82368f8aed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:07:01.691129 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ca850a47-319c-46fa-8b6c-5d0ce744eb64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:01.691760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ca850a47-319c-46fa-8b6c-5d0ce744eb64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:01.693387 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1011/2006] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:07:01 2022] DELETE /identity/v3/projects/ff59a82bf6a14020bb24a82368f8aed3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:01.703625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af31bd-3816-48cd-bb48-0dee507ea8d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:01.705141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af31bd-3816-48cd-bb48-0dee507ea8d5 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:01.717431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 996/2007] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:03.939497 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca850a47-319c-46fa-8b6c-5d0ce744eb64 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:03.941073 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ca850a47-319c-46fa-8b6c-5d0ce744eb64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:04.006207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca850a47-319c-46fa-8b6c-5d0ce744eb64 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:04.010906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00703120-5aef-4de2-a4bf-4c0edb62407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:04.011839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00703120-5aef-4de2-a4bf-4c0edb62407f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:04.012217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00703120-5aef-4de2-a4bf-4c0edb62407f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:04.012390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00703120-5aef-4de2-a4bf-4c0edb62407f admin admin] PATH_INFO: `/v3/users/23a9be8acd6548109936e2e7ae850084` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:04.013627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00703120-5aef-4de2-a4bf-4c0edb62407f admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a9be8acd6548109936e2e7ae850084)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:04.015618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00703120-5aef-4de2-a4bf-4c0edb62407f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:04.062907 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-00703120-5aef-4de2-a4bf-4c0edb62407f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a9be8acd6548109936e2e7ae850084'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:04.063724 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-00703120-5aef-4de2-a4bf-4c0edb62407f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a9be8acd6548109936e2e7ae850084'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:04.071234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-00703120-5aef-4de2-a4bf-4c0edb62407f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a9be8acd6548109936e2e7ae850084'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:04.078966 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-00703120-5aef-4de2-a4bf-4c0edb62407f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a9be8acd6548109936e2e7ae850084'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:04.092060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-00703120-5aef-4de2-a4bf-4c0edb62407f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a9be8acd6548109936e2e7ae850084'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:04.098116 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1012/2008] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:07:03 2022] DELETE /identity/v3/users/23a9be8acd6548109936e2e7ae850084 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:04.102701 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e13ddb-c683-4f98-9ff0-779de86139c3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:04.103149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e13ddb-c683-4f98-9ff0-779de86139c3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:04.103276 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e13ddb-c683-4f98-9ff0-779de86139c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:04.120839 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-22e13ddb-c683-4f98-9ff0-779de86139c3 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:04.122093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-22e13ddb-c683-4f98-9ff0-779de86139c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:04.165479 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:04.183820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 997/2009] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:04.193803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00703120-5aef-4de2-a4bf-4c0edb62407f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:04.195320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-00703120-5aef-4de2-a4bf-4c0edb62407f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:04.222845 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:04.262757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00703120-5aef-4de2-a4bf-4c0edb62407f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:04.266638 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb92492-6fce-44a6-8057-deb9289c59e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:04.267293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb92492-6fce-44a6-8057-deb9289c59e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:04.267590 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb92492-6fce-44a6-8057-deb9289c59e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:04.267944 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb92492-6fce-44a6-8057-deb9289c59e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:04.282541 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb92492-6fce-44a6-8057-deb9289c59e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:04.283983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb92492-6fce-44a6-8057-deb9289c59e2 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:04.297254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1013/2010] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:04.751532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e13ddb-c683-4f98-9ff0-779de86139c3 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:04.752999 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-22e13ddb-c683-4f98-9ff0-779de86139c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:04.768748 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e13ddb-c683-4f98-9ff0-779de86139c3 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:04.774214 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0e683-9982-4fa6-9e97-ede6fbd5a3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:04.775100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0e683-9982-4fa6-9e97-ede6fbd5a3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:04.775387 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0e683-9982-4fa6-9e97-ede6fbd5a3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:04.775667 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0e683-9982-4fa6-9e97-ede6fbd5a3dd admin admin] PATH_INFO: `/v3/projects/e43681814e3b47b3b150f57a5b0294c4` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:04.777723 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0e683-9982-4fa6-9e97-ede6fbd5a3dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e43681814e3b47b3b150f57a5b0294c4)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:04.779621 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0e683-9982-4fa6-9e97-ede6fbd5a3dd admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:04.839657 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-75b0e683-9982-4fa6-9e97-ede6fbd5a3dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e43681814e3b47b3b150f57a5b0294c4', 'request_id': 'req-75b0e683-9982-4fa6-9e97-ede6fbd5a3dd'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:04.845454 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-75b0e683-9982-4fa6-9e97-ede6fbd5a3dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e43681814e3b47b3b150f57a5b0294c4', 'request_id': 'req-75b0e683-9982-4fa6-9e97-ede6fbd5a3dd'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:04.851687 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-75b0e683-9982-4fa6-9e97-ede6fbd5a3dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e43681814e3b47b3b150f57a5b0294c4', 'request_id': 'req-75b0e683-9982-4fa6-9e97-ede6fbd5a3dd'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:04.865157 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-75b0e683-9982-4fa6-9e97-ede6fbd5a3dd admin admin] The token cache is being invalidate because project e43681814e3b47b3b150f57a5b0294c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:07:04.865452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-75b0e683-9982-4fa6-9e97-ede6fbd5a3dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:04.866102 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-75b0e683-9982-4fa6-9e97-ede6fbd5a3dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:04.867641 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 998/2011] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:07:04 2022] DELETE /identity/v3/projects/e43681814e3b47b3b150f57a5b0294c4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:04.871884 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb92492-6fce-44a6-8057-deb9289c59e2 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:04.881875 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb92492-6fce-44a6-8057-deb9289c59e2 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:04.938102 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3dd90-20de-4468-9d0e-5c308aa58ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:04.938890 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3dd90-20de-4468-9d0e-5c308aa58ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:04.939175 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3dd90-20de-4468-9d0e-5c308aa58ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:04.939451 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3dd90-20de-4468-9d0e-5c308aa58ba1 admin admin] PATH_INFO: `/v3/users/664aaf57cc24408599613fbc805729b7` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:04.940639 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3dd90-20de-4468-9d0e-5c308aa58ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=664aaf57cc24408599613fbc805729b7)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:04.942603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3dd90-20de-4468-9d0e-5c308aa58ba1 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:04.989781 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-42c3dd90-20de-4468-9d0e-5c308aa58ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '664aaf57cc24408599613fbc805729b7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:04.990448 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-42c3dd90-20de-4468-9d0e-5c308aa58ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '664aaf57cc24408599613fbc805729b7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:04.997952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-42c3dd90-20de-4468-9d0e-5c308aa58ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '664aaf57cc24408599613fbc805729b7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:05.005000 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-42c3dd90-20de-4468-9d0e-5c308aa58ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '664aaf57cc24408599613fbc805729b7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:05.016985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-42c3dd90-20de-4468-9d0e-5c308aa58ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '664aaf57cc24408599613fbc805729b7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:05.022938 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1014/2012] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:07:04 2022] DELETE /identity/v3/users/664aaf57cc24408599613fbc805729b7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:05.295095 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0e683-9982-4fa6-9e97-ede6fbd5a3dd admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:05.298076 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-75b0e683-9982-4fa6-9e97-ede6fbd5a3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:05.325539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0e683-9982-4fa6-9e97-ede6fbd5a3dd admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:05.397795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5674052-3484-415d-9b49-714e48031c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:05.398667 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5674052-3484-415d-9b49-714e48031c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:05.398956 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5674052-3484-415d-9b49-714e48031c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:05.399232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5674052-3484-415d-9b49-714e48031c83 admin admin] PATH_INFO: `/v3/projects/1d7f078e6eb94f049594244283eb2d66` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:05.400427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5674052-3484-415d-9b49-714e48031c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d7f078e6eb94f049594244283eb2d66)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:05.404314 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5674052-3484-415d-9b49-714e48031c83 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:05.453416 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c5674052-3484-415d-9b49-714e48031c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d7f078e6eb94f049594244283eb2d66', 'request_id': 'req-c5674052-3484-415d-9b49-714e48031c83'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:05.458921 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c5674052-3484-415d-9b49-714e48031c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d7f078e6eb94f049594244283eb2d66', 'request_id': 'req-c5674052-3484-415d-9b49-714e48031c83'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:05.466270 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c5674052-3484-415d-9b49-714e48031c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d7f078e6eb94f049594244283eb2d66', 'request_id': 'req-c5674052-3484-415d-9b49-714e48031c83'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:05.476133 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:05.481485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c5674052-3484-415d-9b49-714e48031c83 admin admin] The token cache is being invalidate because project 1d7f078e6eb94f049594244283eb2d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:07:05.481962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c5674052-3484-415d-9b49-714e48031c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:05.483530 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c5674052-3484-415d-9b49-714e48031c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:05.490135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 999/2013] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:07:05 2022] DELETE /identity/v3/projects/1d7f078e6eb94f049594244283eb2d66 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:05.491166 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3dd90-20de-4468-9d0e-5c308aa58ba1 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:05.492596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-42c3dd90-20de-4468-9d0e-5c308aa58ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:05.506511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3dd90-20de-4468-9d0e-5c308aa58ba1 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:05.548713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:05.566840 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036d4e3-7ad1-43ef-81d3-5c7f317ccd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:05.567726 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036d4e3-7ad1-43ef-81d3-5c7f317ccd12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:05.568011 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036d4e3-7ad1-43ef-81d3-5c7f317ccd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:05.568289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036d4e3-7ad1-43ef-81d3-5c7f317ccd12 admin admin] PATH_INFO: `/v3/users/a32a5ff50840463d8f566ecb83110cbd` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:05.569683 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036d4e3-7ad1-43ef-81d3-5c7f317ccd12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a32a5ff50840463d8f566ecb83110cbd)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:05.571620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036d4e3-7ad1-43ef-81d3-5c7f317ccd12 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:05.631478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5036d4e3-7ad1-43ef-81d3-5c7f317ccd12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a32a5ff50840463d8f566ecb83110cbd'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:05.632169 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5036d4e3-7ad1-43ef-81d3-5c7f317ccd12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a32a5ff50840463d8f566ecb83110cbd'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:05.642822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5036d4e3-7ad1-43ef-81d3-5c7f317ccd12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a32a5ff50840463d8f566ecb83110cbd'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:05.651298 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5036d4e3-7ad1-43ef-81d3-5c7f317ccd12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a32a5ff50840463d8f566ecb83110cbd'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:05.665059 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5036d4e3-7ad1-43ef-81d3-5c7f317ccd12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a32a5ff50840463d8f566ecb83110cbd'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:05.673451 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1015/2014] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:07:05 2022] DELETE /identity/v3/users/a32a5ff50840463d8f566ecb83110cbd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:07:06.049014 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5674052-3484-415d-9b49-714e48031c83 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:06.050502 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c5674052-3484-415d-9b49-714e48031c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:06.066220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5674052-3484-415d-9b49-714e48031c83 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:06.127521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f9258-3e37-4921-9c76-fadffd7e5700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:06.128382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f9258-3e37-4921-9c76-fadffd7e5700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:06.128666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f9258-3e37-4921-9c76-fadffd7e5700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:06.128970 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f9258-3e37-4921-9c76-fadffd7e5700 admin admin] PATH_INFO: `/v3/projects/64b2128f02884265b6d6c5cf6e93e8a8` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:06.130216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f9258-3e37-4921-9c76-fadffd7e5700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b2128f02884265b6d6c5cf6e93e8a8)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:06.132153 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f9258-3e37-4921-9c76-fadffd7e5700 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:06.181091 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-708f9258-3e37-4921-9c76-fadffd7e5700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b2128f02884265b6d6c5cf6e93e8a8', 'request_id': 'req-708f9258-3e37-4921-9c76-fadffd7e5700'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:06.189427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-708f9258-3e37-4921-9c76-fadffd7e5700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b2128f02884265b6d6c5cf6e93e8a8', 'request_id': 'req-708f9258-3e37-4921-9c76-fadffd7e5700'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:06.195698 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-708f9258-3e37-4921-9c76-fadffd7e5700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b2128f02884265b6d6c5cf6e93e8a8', 'request_id': 'req-708f9258-3e37-4921-9c76-fadffd7e5700'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:06.208473 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-708f9258-3e37-4921-9c76-fadffd7e5700 admin admin] The token cache is being invalidate because project 64b2128f02884265b6d6c5cf6e93e8a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:07:06.208782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-708f9258-3e37-4921-9c76-fadffd7e5700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:06.209399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-708f9258-3e37-4921-9c76-fadffd7e5700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:06.210964 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1000/2015] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:07:06 2022] DELETE /identity/v3/projects/64b2128f02884265b6d6c5cf6e93e8a8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:06.217287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dee1d-f500-4434-9986-a2dfdef969d6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:06.217769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dee1d-f500-4434-9986-a2dfdef969d6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:06.217903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dee1d-f500-4434-9986-a2dfdef969d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:06.236094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c33dee1d-f500-4434-9986-a2dfdef969d6 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:06.237311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c33dee1d-f500-4434-9986-a2dfdef969d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:06.296125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1016/2016] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:06.305715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d920c-51b3-44e5-9ad1-8199253b3bfa None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:06.306189 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d920c-51b3-44e5-9ad1-8199253b3bfa None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:06.306304 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d920c-51b3-44e5-9ad1-8199253b3bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:06.325968 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-db0d920c-51b3-44e5-9ad1-8199253b3bfa None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:06.327176 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-db0d920c-51b3-44e5-9ad1-8199253b3bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:06.335231 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1001/2017] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:06.340422 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dee1d-f500-4434-9986-a2dfdef969d6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:06.350431 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dee1d-f500-4434-9986-a2dfdef969d6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:06.356284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8f37b-8d2d-417b-a023-5904d89f61e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:06.357129 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8f37b-8d2d-417b-a023-5904d89f61e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:06.357452 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8f37b-8d2d-417b-a023-5904d89f61e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:06.357758 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8f37b-8d2d-417b-a023-5904d89f61e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:06.358505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8f37b-8d2d-417b-a023-5904d89f61e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:07:06.358881 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8f37b-8d2d-417b-a023-5904d89f61e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:06.360582 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8f37b-8d2d-417b-a023-5904d89f61e7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:06.373309 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1017/2018] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:07:06.377641 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d920c-51b3-44e5-9ad1-8199253b3bfa None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:06.388838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d920c-51b3-44e5-9ad1-8199253b3bfa None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:06.394946 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73b3f7-1628-4c0a-91e2-ac2e6eab14f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:06.395659 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73b3f7-1628-4c0a-91e2-ac2e6eab14f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:06.395943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73b3f7-1628-4c0a-91e2-ac2e6eab14f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:06.396223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73b3f7-1628-4c0a-91e2-ac2e6eab14f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:06.397086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73b3f7-1628-4c0a-91e2-ac2e6eab14f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:06.399060 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73b3f7-1628-4c0a-91e2-ac2e6eab14f8 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:06.430527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1002/2019] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:07:06 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:07:06.436189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8f37b-8d2d-417b-a023-5904d89f61e7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:06.446590 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8f37b-8d2d-417b-a023-5904d89f61e7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:06.498755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:06.514465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61670c-f077-4703-a9e5-7aefa8434485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:06.514465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61670c-f077-4703-a9e5-7aefa8434485 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:06.514465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61670c-f077-4703-a9e5-7aefa8434485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:06.514465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61670c-f077-4703-a9e5-7aefa8434485 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:06.514858 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61670c-f077-4703-a9e5-7aefa8434485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:06.516912 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61670c-f077-4703-a9e5-7aefa8434485 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:06.541322 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1018/2020] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:07:06 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:06.543297 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73b3f7-1628-4c0a-91e2-ac2e6eab14f8 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:06.553728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73b3f7-1628-4c0a-91e2-ac2e6eab14f8 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:06.558484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984074b9-ad4d-4a8f-9bc5-d036ee1ae693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:06.559159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984074b9-ad4d-4a8f-9bc5-d036ee1ae693 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:06.559448 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984074b9-ad4d-4a8f-9bc5-d036ee1ae693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:06.559758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984074b9-ad4d-4a8f-9bc5-d036ee1ae693 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:06.560617 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984074b9-ad4d-4a8f-9bc5-d036ee1ae693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:06.562272 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984074b9-ad4d-4a8f-9bc5-d036ee1ae693 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:06.573376 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1003/2021] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:06.578088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61670c-f077-4703-a9e5-7aefa8434485 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:06.590694 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61670c-f077-4703-a9e5-7aefa8434485 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:06.595625 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882699f-8385-4ce1-a17b-f4e5eff08149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:06.597044 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882699f-8385-4ce1-a17b-f4e5eff08149 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:06.597402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882699f-8385-4ce1-a17b-f4e5eff08149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:06.597831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882699f-8385-4ce1-a17b-f4e5eff08149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:06.598682 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882699f-8385-4ce1-a17b-f4e5eff08149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:06.600175 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1882699f-8385-4ce1-a17b-f4e5eff08149 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:06.612538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1019/2022] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:06.616767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984074b9-ad4d-4a8f-9bc5-d036ee1ae693 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:06.627424 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984074b9-ad4d-4a8f-9bc5-d036ee1ae693 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:06.632058 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4907e-d8ce-449b-b50d-c8cdf7d403e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:06.632937 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4907e-d8ce-449b-b50d-c8cdf7d403e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:06.633222 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4907e-d8ce-449b-b50d-c8cdf7d403e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:06.633503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4907e-d8ce-449b-b50d-c8cdf7d403e4 admin admin] PATH_INFO: `/v3/projects/5efb4afd9f1a4166977647358f1ffb76/users/652b50b5a8e14aad8ed9755ce44ad77a/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:06.649069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4907e-d8ce-449b-b50d-c8cdf7d403e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efb4afd9f1a4166977647358f1ffb76, user_id=652b50b5a8e14aad8ed9755ce44ad77a, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:06.652506 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4907e-d8ce-449b-b50d-c8cdf7d403e4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:06.669722 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1004/2023] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:06 2022] PUT /identity/v3/projects/5efb4afd9f1a4166977647358f1ffb76/users/652b50b5a8e14aad8ed9755ce44ad77a/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:06.683047 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef757c-0965-4f7c-82e5-ac3c80c573f3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:06.683351 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef757c-0965-4f7c-82e5-ac3c80c573f3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:06.683632 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef757c-0965-4f7c-82e5-ac3c80c573f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:06.718433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ecef757c-0965-4f7c-82e5-ac3c80c573f3 None None] MFA Rules not processed for user `652b50b5a8e14aad8ed9755ce44ad77a`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:06.719808 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ecef757c-0965-4f7c-82e5-ac3c80c573f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:06.792662 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1020/2024] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:06.799617 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4907e-d8ce-449b-b50d-c8cdf7d403e4 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:06.830120 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:06.866506 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4907e-d8ce-449b-b50d-c8cdf7d403e4 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:06.871500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c989cc8-5860-46c2-8dae-551ecfe4ef86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:06.872168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c989cc8-5860-46c2-8dae-551ecfe4ef86 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:06.872828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c989cc8-5860-46c2-8dae-551ecfe4ef86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:06.873107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c989cc8-5860-46c2-8dae-551ecfe4ef86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:06.873854 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c989cc8-5860-46c2-8dae-551ecfe4ef86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:06.875775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c989cc8-5860-46c2-8dae-551ecfe4ef86 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:06.906048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1005/2025] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:07:06 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:07:06.907108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef757c-0965-4f7c-82e5-ac3c80c573f3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:06.918300 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef757c-0965-4f7c-82e5-ac3c80c573f3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:06.976030 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db6da9-6ac6-45c4-9b09-a85890c52d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:06.976767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db6da9-6ac6-45c4-9b09-a85890c52d53 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:06.977123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db6da9-6ac6-45c4-9b09-a85890c52d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:06.977316 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db6da9-6ac6-45c4-9b09-a85890c52d53 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:06.978042 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db6da9-6ac6-45c4-9b09-a85890c52d53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:06.980174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db6da9-6ac6-45c4-9b09-a85890c52d53 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:07.005414 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1021/2026] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:07:06 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:07.006653 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c989cc8-5860-46c2-8dae-551ecfe4ef86 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:07.017953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c989cc8-5860-46c2-8dae-551ecfe4ef86 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:07.023463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d5930-cfa8-4159-ac11-9b8c5b4a87bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:07.024277 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d5930-cfa8-4159-ac11-9b8c5b4a87bd admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:07.024649 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d5930-cfa8-4159-ac11-9b8c5b4a87bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:07.025023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d5930-cfa8-4159-ac11-9b8c5b4a87bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:07.025905 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d5930-cfa8-4159-ac11-9b8c5b4a87bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:07.028275 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d5930-cfa8-4159-ac11-9b8c5b4a87bd admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:07.040642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1006/2027] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:07.044460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db6da9-6ac6-45c4-9b09-a85890c52d53 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:07.061358 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db6da9-6ac6-45c4-9b09-a85890c52d53 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:07.067170 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0871e4-45d2-4383-aaf2-5a8b408ac07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:07.068135 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0871e4-45d2-4383-aaf2-5a8b408ac07c admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:07.068489 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0871e4-45d2-4383-aaf2-5a8b408ac07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:07.068831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0871e4-45d2-4383-aaf2-5a8b408ac07c admin admin] PATH_INFO: `/v3/projects/e0a212cff1784483b8d05ed25e7c4f60/users/df27e6a5092240a09c50b72ff8ac5ab2/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:07.086328 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0871e4-45d2-4383-aaf2-5a8b408ac07c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a212cff1784483b8d05ed25e7c4f60, user_id=df27e6a5092240a09c50b72ff8ac5ab2, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:07.089272 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0871e4-45d2-4383-aaf2-5a8b408ac07c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:07.107687 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1022/2028] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:07 2022] PUT /identity/v3/projects/e0a212cff1784483b8d05ed25e7c4f60/users/df27e6a5092240a09c50b72ff8ac5ab2/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:07:07.111627 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d5930-cfa8-4159-ac11-9b8c5b4a87bd admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:07.122697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d5930-cfa8-4159-ac11-9b8c5b4a87bd admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:07.185331 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97126ba9-71b4-4ef7-8283-f1c11e41c852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:07.186031 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97126ba9-71b4-4ef7-8283-f1c11e41c852 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:07.186310 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97126ba9-71b4-4ef7-8283-f1c11e41c852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:07.186582 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97126ba9-71b4-4ef7-8283-f1c11e41c852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:07.187301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97126ba9-71b4-4ef7-8283-f1c11e41c852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:07.188895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97126ba9-71b4-4ef7-8283-f1c11e41c852 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:07.199411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1007/2029] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:07.203674 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0871e4-45d2-4383-aaf2-5a8b408ac07c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:07.214579 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0871e4-45d2-4383-aaf2-5a8b408ac07c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:07.219201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4674bf-fcd5-416b-8cbc-61247505a43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:07.220112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4674bf-fcd5-416b-8cbc-61247505a43e admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:07.220399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4674bf-fcd5-416b-8cbc-61247505a43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:07.220684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4674bf-fcd5-416b-8cbc-61247505a43e admin admin] PATH_INFO: `/v3/projects/e0a212cff1784483b8d05ed25e7c4f60/users/df27e6a5092240a09c50b72ff8ac5ab2/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:07.222776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4674bf-fcd5-416b-8cbc-61247505a43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a212cff1784483b8d05ed25e7c4f60, user_id=df27e6a5092240a09c50b72ff8ac5ab2, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:07.225454 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4674bf-fcd5-416b-8cbc-61247505a43e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:07.236356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1023/2030] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:07 2022] PUT /identity/v3/projects/e0a212cff1784483b8d05ed25e7c4f60/users/df27e6a5092240a09c50b72ff8ac5ab2/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:07.247378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb563173-c09a-4a27-8a90-c85568583234 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:07.247668 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb563173-c09a-4a27-8a90-c85568583234 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:07.247948 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb563173-c09a-4a27-8a90-c85568583234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:07.274252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-cb563173-c09a-4a27-8a90-c85568583234 None None] MFA Rules not processed for user `df27e6a5092240a09c50b72ff8ac5ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:07.275470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cb563173-c09a-4a27-8a90-c85568583234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:07.343587 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1008/2031] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:07.354518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4674bf-fcd5-416b-8cbc-61247505a43e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:07.356541 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ef4674bf-fcd5-416b-8cbc-61247505a43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:07.371402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:07.425483 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4674bf-fcd5-416b-8cbc-61247505a43e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:07.430035 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84c600-f449-4b8b-8e96-506ae16ea9a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:07.430927 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84c600-f449-4b8b-8e96-506ae16ea9a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:07.431334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84c600-f449-4b8b-8e96-506ae16ea9a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:07.431749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84c600-f449-4b8b-8e96-506ae16ea9a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:07.443905 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84c600-f449-4b8b-8e96-506ae16ea9a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:07.445401 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84c600-f449-4b8b-8e96-506ae16ea9a0 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:07.458713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1024/2032] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:07.531482 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb563173-c09a-4a27-8a90-c85568583234 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:07.554324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb563173-c09a-4a27-8a90-c85568583234 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:07.564036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a068fc5-81e1-4b46-adaf-4068f673b4fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:07.565131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a068fc5-81e1-4b46-adaf-4068f673b4fd service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:07.565585 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a068fc5-81e1-4b46-adaf-4068f673b4fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:07.566039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a068fc5-81e1-4b46-adaf-4068f673b4fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:07.602534 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:07.656040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a068fc5-81e1-4b46-adaf-4068f673b4fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:07.657704 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a068fc5-81e1-4b46-adaf-4068f673b4fd service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:07.668705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1009/2033] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:11.591218 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84c600-f449-4b8b-8e96-506ae16ea9a0 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:11.592772 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ad84c600-f449-4b8b-8e96-506ae16ea9a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:11.665051 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84c600-f449-4b8b-8e96-506ae16ea9a0 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:11.670334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4760fd-4ce8-4656-a3b2-7496110e8f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:11.671261 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4760fd-4ce8-4656-a3b2-7496110e8f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:11.671536 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4760fd-4ce8-4656-a3b2-7496110e8f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:11.671811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4760fd-4ce8-4656-a3b2-7496110e8f90 admin admin] PATH_INFO: `/v3/users/961afeb9197546ae80afb6c3f9e6baeb` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:11.673014 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4760fd-4ce8-4656-a3b2-7496110e8f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=961afeb9197546ae80afb6c3f9e6baeb)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:11.674985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4760fd-4ce8-4656-a3b2-7496110e8f90 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:11.726308 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-da4760fd-4ce8-4656-a3b2-7496110e8f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '961afeb9197546ae80afb6c3f9e6baeb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:11.726965 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-da4760fd-4ce8-4656-a3b2-7496110e8f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '961afeb9197546ae80afb6c3f9e6baeb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:11.735511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-da4760fd-4ce8-4656-a3b2-7496110e8f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '961afeb9197546ae80afb6c3f9e6baeb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:11.743397 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-da4760fd-4ce8-4656-a3b2-7496110e8f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '961afeb9197546ae80afb6c3f9e6baeb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:11.756431 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-da4760fd-4ce8-4656-a3b2-7496110e8f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '961afeb9197546ae80afb6c3f9e6baeb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:11.762741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1025/2034] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:07:11 2022] DELETE /identity/v3/users/961afeb9197546ae80afb6c3f9e6baeb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:11.767233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f8c8d-a512-487b-adbf-ce43a90250cb None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:11.767723 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f8c8d-a512-487b-adbf-ce43a90250cb None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:11.767805 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f8c8d-a512-487b-adbf-ce43a90250cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:11.788287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-385f8c8d-a512-487b-adbf-ce43a90250cb None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:11.789681 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-385f8c8d-a512-487b-adbf-ce43a90250cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:11.861208 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1010/2035] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:07:11.871472 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4760fd-4ce8-4656-a3b2-7496110e8f90 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:11.873026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-da4760fd-4ce8-4656-a3b2-7496110e8f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:11.912115 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:11.938302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4760fd-4ce8-4656-a3b2-7496110e8f90 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:11.942051 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29112c13-6532-4a65-8c61-041d41f38ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:11.942695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29112c13-6532-4a65-8c61-041d41f38ddb service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:11.943356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29112c13-6532-4a65-8c61-041d41f38ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:11.943646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29112c13-6532-4a65-8c61-041d41f38ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:11.954415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29112c13-6532-4a65-8c61-041d41f38ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:11.955861 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29112c13-6532-4a65-8c61-041d41f38ddb service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:11.967226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1026/2036] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:12.327235 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f8c8d-a512-487b-adbf-ce43a90250cb None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:12.329015 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-385f8c8d-a512-487b-adbf-ce43a90250cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:12.345970 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f8c8d-a512-487b-adbf-ce43a90250cb None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:12.351620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd108c68-c885-428b-9c89-826087c1ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:12.352693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd108c68-c885-428b-9c89-826087c1ce65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:12.353128 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd108c68-c885-428b-9c89-826087c1ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:12.353765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd108c68-c885-428b-9c89-826087c1ce65 admin admin] PATH_INFO: `/v3/projects/e52eeb9b56af410b8d573fb2174943bf` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:12.355664 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd108c68-c885-428b-9c89-826087c1ce65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e52eeb9b56af410b8d573fb2174943bf)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:12.358432 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd108c68-c885-428b-9c89-826087c1ce65 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:12.455699 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dd108c68-c885-428b-9c89-826087c1ce65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e52eeb9b56af410b8d573fb2174943bf', 'request_id': 'req-dd108c68-c885-428b-9c89-826087c1ce65'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:12.465112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dd108c68-c885-428b-9c89-826087c1ce65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e52eeb9b56af410b8d573fb2174943bf', 'request_id': 'req-dd108c68-c885-428b-9c89-826087c1ce65'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:12.474010 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dd108c68-c885-428b-9c89-826087c1ce65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e52eeb9b56af410b8d573fb2174943bf', 'request_id': 'req-dd108c68-c885-428b-9c89-826087c1ce65'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:12.498486 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dd108c68-c885-428b-9c89-826087c1ce65 admin admin] The token cache is being invalidate because project e52eeb9b56af410b8d573fb2174943bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:07:12.499122 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dd108c68-c885-428b-9c89-826087c1ce65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:12.500488 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dd108c68-c885-428b-9c89-826087c1ce65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:12.502854 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1011/2037] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:07:12 2022] DELETE /identity/v3/projects/e52eeb9b56af410b8d573fb2174943bf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:12.506519 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29112c13-6532-4a65-8c61-041d41f38ddb service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:12.508260 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd108c68-c885-428b-9c89-826087c1ce65 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:12.511388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-dd108c68-c885-428b-9c89-826087c1ce65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:12.517941 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29112c13-6532-4a65-8c61-041d41f38ddb service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:12.579480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:12.611189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944d3ca-93b1-43be-a30c-c808ae5b8216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:12.612354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944d3ca-93b1-43be-a30c-c808ae5b8216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:12.612354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944d3ca-93b1-43be-a30c-c808ae5b8216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:12.612744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944d3ca-93b1-43be-a30c-c808ae5b8216 admin admin] PATH_INFO: `/v3/users/4dbe43ef6ad34d869b8c31d576e2b6ee` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:12.614501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd108c68-c885-428b-9c89-826087c1ce65 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:12.614631 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944d3ca-93b1-43be-a30c-c808ae5b8216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dbe43ef6ad34d869b8c31d576e2b6ee)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:12.616302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944d3ca-93b1-43be-a30c-c808ae5b8216 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:12.619945 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6b059-ba45-4615-a8e1-6a2be41fe514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:12.621065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6b059-ba45-4615-a8e1-6a2be41fe514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:12.621179 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6b059-ba45-4615-a8e1-6a2be41fe514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:12.621452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6b059-ba45-4615-a8e1-6a2be41fe514 admin admin] PATH_INFO: `/v3/users/652b50b5a8e14aad8ed9755ce44ad77a` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:12.624058 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6b059-ba45-4615-a8e1-6a2be41fe514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=652b50b5a8e14aad8ed9755ce44ad77a)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:12.625341 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6b059-ba45-4615-a8e1-6a2be41fe514 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:12.677067 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6944d3ca-93b1-43be-a30c-c808ae5b8216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dbe43ef6ad34d869b8c31d576e2b6ee'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:12.681843 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6944d3ca-93b1-43be-a30c-c808ae5b8216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dbe43ef6ad34d869b8c31d576e2b6ee'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:12.697222 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6944d3ca-93b1-43be-a30c-c808ae5b8216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dbe43ef6ad34d869b8c31d576e2b6ee'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:12.702742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-17b6b059-ba45-4615-a8e1-6a2be41fe514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '652b50b5a8e14aad8ed9755ce44ad77a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:12.712625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-17b6b059-ba45-4615-a8e1-6a2be41fe514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '652b50b5a8e14aad8ed9755ce44ad77a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:12.714488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6944d3ca-93b1-43be-a30c-c808ae5b8216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dbe43ef6ad34d869b8c31d576e2b6ee'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:12.729990 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-17b6b059-ba45-4615-a8e1-6a2be41fe514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '652b50b5a8e14aad8ed9755ce44ad77a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:12.731016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-17b6b059-ba45-4615-a8e1-6a2be41fe514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '652b50b5a8e14aad8ed9755ce44ad77a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:12.731809 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-17b6b059-ba45-4615-a8e1-6a2be41fe514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '652b50b5a8e14aad8ed9755ce44ad77a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:12.736109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6944d3ca-93b1-43be-a30c-c808ae5b8216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dbe43ef6ad34d869b8c31d576e2b6ee'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:12.746172 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1027/2038] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:07:12 2022] DELETE /identity/v3/users/4dbe43ef6ad34d869b8c31d576e2b6ee => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:07:12.751563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1012/2039] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:07:12 2022] DELETE /identity/v3/users/652b50b5a8e14aad8ed9755ce44ad77a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:12.755922 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e28534-db0c-4fe5-9405-43c056dd216e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:12.756209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e28534-db0c-4fe5-9405-43c056dd216e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:12.756536 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e28534-db0c-4fe5-9405-43c056dd216e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:12.782047 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f7e28534-db0c-4fe5-9405-43c056dd216e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:12.783993 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f7e28534-db0c-4fe5-9405-43c056dd216e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:12.876741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:12.902738 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1028/2040] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:12.909371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6b059-ba45-4615-a8e1-6a2be41fe514 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:12.910830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-17b6b059-ba45-4615-a8e1-6a2be41fe514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:13.014891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6b059-ba45-4615-a8e1-6a2be41fe514 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:13.019914 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28928673-851b-400e-84bf-25ac2e6d960b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:13.020832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28928673-851b-400e-84bf-25ac2e6d960b service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:13.021243 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28928673-851b-400e-84bf-25ac2e6d960b service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:13.021593 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28928673-851b-400e-84bf-25ac2e6d960b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:13.041496 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28928673-851b-400e-84bf-25ac2e6d960b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:13.044580 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28928673-851b-400e-84bf-25ac2e6d960b service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:13.062052 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1013/2041] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:13.226744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e28534-db0c-4fe5-9405-43c056dd216e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:13.230106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f7e28534-db0c-4fe5-9405-43c056dd216e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:13.268183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e28534-db0c-4fe5-9405-43c056dd216e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:13.278764 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a53bf9-44ff-4529-b030-e5648dd1eda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:13.280576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a53bf9-44ff-4529-b030-e5648dd1eda9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:13.281265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a53bf9-44ff-4529-b030-e5648dd1eda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:13.281881 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a53bf9-44ff-4529-b030-e5648dd1eda9 admin admin] PATH_INFO: `/v3/projects/053f36a2fc0143dea57a41a068c86637` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:13.284346 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a53bf9-44ff-4529-b030-e5648dd1eda9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=053f36a2fc0143dea57a41a068c86637)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:13.288535 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a53bf9-44ff-4529-b030-e5648dd1eda9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:13.412689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a5a53bf9-44ff-4529-b030-e5648dd1eda9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '053f36a2fc0143dea57a41a068c86637', 'request_id': 'req-a5a53bf9-44ff-4529-b030-e5648dd1eda9'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:13.428933 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a5a53bf9-44ff-4529-b030-e5648dd1eda9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '053f36a2fc0143dea57a41a068c86637', 'request_id': 'req-a5a53bf9-44ff-4529-b030-e5648dd1eda9'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:13.439968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a5a53bf9-44ff-4529-b030-e5648dd1eda9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '053f36a2fc0143dea57a41a068c86637', 'request_id': 'req-a5a53bf9-44ff-4529-b030-e5648dd1eda9'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:13.460035 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a5a53bf9-44ff-4529-b030-e5648dd1eda9 admin admin] The token cache is being invalidate because project 053f36a2fc0143dea57a41a068c86637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:07:13.460492 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a5a53bf9-44ff-4529-b030-e5648dd1eda9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:13.461471 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a5a53bf9-44ff-4529-b030-e5648dd1eda9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:13.464162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1029/2042] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:07:13 2022] DELETE /identity/v3/projects/053f36a2fc0143dea57a41a068c86637 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:13.470587 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3ac4e-79b3-479a-8b1b-374094e410ad None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:13.471384 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3ac4e-79b3-479a-8b1b-374094e410ad None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:13.472031 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3ac4e-79b3-479a-8b1b-374094e410ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:13.520569 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-51a3ac4e-79b3-479a-8b1b-374094e410ad None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:13.522738 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-51a3ac4e-79b3-479a-8b1b-374094e410ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:13.550988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a53bf9-44ff-4529-b030-e5648dd1eda9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:13.554335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a5a53bf9-44ff-4529-b030-e5648dd1eda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:13.649708 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1014/2043] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:13.658643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c83df5-3522-44eb-8b03-a7ec2d1ac255 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:13.659384 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c83df5-3522-44eb-8b03-a7ec2d1ac255 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:13.659888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c83df5-3522-44eb-8b03-a7ec2d1ac255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:13.678286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:13.693913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-66c83df5-3522-44eb-8b03-a7ec2d1ac255 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:13.696381 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-66c83df5-3522-44eb-8b03-a7ec2d1ac255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:13.712225 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1015/2044] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:13.713986 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c83df5-3522-44eb-8b03-a7ec2d1ac255 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:13.731262 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c83df5-3522-44eb-8b03-a7ec2d1ac255 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:13.743816 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce35045-16b0-4ddb-a3d8-dc5a36071b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:13.744734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce35045-16b0-4ddb-a3d8-dc5a36071b98 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:13.745761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce35045-16b0-4ddb-a3d8-dc5a36071b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:13.746217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce35045-16b0-4ddb-a3d8-dc5a36071b98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:13.747400 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce35045-16b0-4ddb-a3d8-dc5a36071b98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:07:13.747787 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce35045-16b0-4ddb-a3d8-dc5a36071b98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:13.749826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a53bf9-44ff-4529-b030-e5648dd1eda9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:13.750339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce35045-16b0-4ddb-a3d8-dc5a36071b98 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:13.758272 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2231283-41e9-4a11-981a-5782cd87496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:13.759875 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2231283-41e9-4a11-981a-5782cd87496e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:13.760158 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2231283-41e9-4a11-981a-5782cd87496e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:13.760863 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2231283-41e9-4a11-981a-5782cd87496e admin admin] PATH_INFO: `/v3/projects/5efb4afd9f1a4166977647358f1ffb76` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:13.762332 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2231283-41e9-4a11-981a-5782cd87496e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5efb4afd9f1a4166977647358f1ffb76)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:13.764264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2231283-41e9-4a11-981a-5782cd87496e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:13.765334 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1016/2045] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:07:13.769283 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce35045-16b0-4ddb-a3d8-dc5a36071b98 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:13.786138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce35045-16b0-4ddb-a3d8-dc5a36071b98 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:13.803330 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3093a-7acb-4452-874e-0a90f892dd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:13.805048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3093a-7acb-4452-874e-0a90f892dd96 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:13.805855 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3093a-7acb-4452-874e-0a90f892dd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:13.806648 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3093a-7acb-4452-874e-0a90f892dd96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:13.809908 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3093a-7acb-4452-874e-0a90f892dd96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:13.816199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3093a-7acb-4452-874e-0a90f892dd96 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:13.858986 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b2231283-41e9-4a11-981a-5782cd87496e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5efb4afd9f1a4166977647358f1ffb76', 'request_id': 'req-b2231283-41e9-4a11-981a-5782cd87496e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:13.869384 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1017/2046] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:07:13 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:07:13.875103 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3093a-7acb-4452-874e-0a90f892dd96 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:13.877457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b2231283-41e9-4a11-981a-5782cd87496e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5efb4afd9f1a4166977647358f1ffb76', 'request_id': 'req-b2231283-41e9-4a11-981a-5782cd87496e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:13.888452 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b2231283-41e9-4a11-981a-5782cd87496e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5efb4afd9f1a4166977647358f1ffb76', 'request_id': 'req-b2231283-41e9-4a11-981a-5782cd87496e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:13.935142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b2231283-41e9-4a11-981a-5782cd87496e admin admin] The token cache is being invalidate because project 5efb4afd9f1a4166977647358f1ffb76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:07:13.935434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b2231283-41e9-4a11-981a-5782cd87496e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:13.937593 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b2231283-41e9-4a11-981a-5782cd87496e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:13.942659 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1030/2047] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:07:13 2022] DELETE /identity/v3/projects/5efb4afd9f1a4166977647358f1ffb76 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:13.946188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2231283-41e9-4a11-981a-5782cd87496e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:13.947623 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b2231283-41e9-4a11-981a-5782cd87496e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:13.977991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:14.048441 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3093a-7acb-4452-874e-0a90f892dd96 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:14.068509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a1044-13a2-4441-9461-df8dfe65637e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:14.069478 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a1044-13a2-4441-9461-df8dfe65637e admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:14.069860 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a1044-13a2-4441-9461-df8dfe65637e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:14.070215 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a1044-13a2-4441-9461-df8dfe65637e admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:14.071005 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a1044-13a2-4441-9461-df8dfe65637e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:14.074406 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a1044-13a2-4441-9461-df8dfe65637e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:14.096518 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2231283-41e9-4a11-981a-5782cd87496e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:14.109963 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1018/2048] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:07:13 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:14.111837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877eae1-4fbe-4b53-b3cb-665b90766308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:14.113645 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a1044-13a2-4441-9461-df8dfe65637e admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:14.114864 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877eae1-4fbe-4b53-b3cb-665b90766308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:14.115159 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877eae1-4fbe-4b53-b3cb-665b90766308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:14.115804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877eae1-4fbe-4b53-b3cb-665b90766308 admin admin] PATH_INFO: `/v3/users/df27e6a5092240a09c50b72ff8ac5ab2` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:14.116074 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-823a1044-13a2-4441-9461-df8dfe65637e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:14.118491 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877eae1-4fbe-4b53-b3cb-665b90766308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df27e6a5092240a09c50b72ff8ac5ab2)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:14.123688 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877eae1-4fbe-4b53-b3cb-665b90766308 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:14.140870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a1044-13a2-4441-9461-df8dfe65637e admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:14.148526 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b2f34-b95e-4278-870f-09869362b4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:14.149227 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b2f34-b95e-4278-870f-09869362b4ae admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:14.149515 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b2f34-b95e-4278-870f-09869362b4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:14.150067 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b2f34-b95e-4278-870f-09869362b4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:14.151361 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b2f34-b95e-4278-870f-09869362b4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:14.154499 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b2f34-b95e-4278-870f-09869362b4ae admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:14.167919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1019/2049] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:07:14.171916 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b2f34-b95e-4278-870f-09869362b4ae admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:14.185091 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b2f34-b95e-4278-870f-09869362b4ae admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:14.193074 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf60cf-38e5-4d96-a1a4-0f1ddc4c4746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:14.193790 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf60cf-38e5-4d96-a1a4-0f1ddc4c4746 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:14.194086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf60cf-38e5-4d96-a1a4-0f1ddc4c4746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:14.194371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf60cf-38e5-4d96-a1a4-0f1ddc4c4746 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:14.195280 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf60cf-38e5-4d96-a1a4-0f1ddc4c4746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:14.197249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf60cf-38e5-4d96-a1a4-0f1ddc4c4746 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:14.214927 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1020/2050] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:07:14.215842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3877eae1-4fbe-4b53-b3cb-665b90766308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df27e6a5092240a09c50b72ff8ac5ab2'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:14.215934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf60cf-38e5-4d96-a1a4-0f1ddc4c4746 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:14.216509 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3877eae1-4fbe-4b53-b3cb-665b90766308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df27e6a5092240a09c50b72ff8ac5ab2'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:14.227156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf60cf-38e5-4d96-a1a4-0f1ddc4c4746 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:14.230253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3877eae1-4fbe-4b53-b3cb-665b90766308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df27e6a5092240a09c50b72ff8ac5ab2'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:14.233586 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef5cfd-6b53-4aba-bdbc-f1dc287f38f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:14.234595 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef5cfd-6b53-4aba-bdbc-f1dc287f38f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:14.234891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef5cfd-6b53-4aba-bdbc-f1dc287f38f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:14.235152 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef5cfd-6b53-4aba-bdbc-f1dc287f38f1 admin admin] PATH_INFO: `/v3/projects/f4a93c36a49d4a29a764888b224c85cd/users/5ae43e512ec44294920f6de050c98073/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:14.241724 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3877eae1-4fbe-4b53-b3cb-665b90766308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df27e6a5092240a09c50b72ff8ac5ab2'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:14.260703 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef5cfd-6b53-4aba-bdbc-f1dc287f38f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a93c36a49d4a29a764888b224c85cd, user_id=5ae43e512ec44294920f6de050c98073, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:14.263468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3877eae1-4fbe-4b53-b3cb-665b90766308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df27e6a5092240a09c50b72ff8ac5ab2'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:14.265563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef5cfd-6b53-4aba-bdbc-f1dc287f38f1 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:14.274842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1031/2051] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:07:13 2022] DELETE /identity/v3/users/df27e6a5092240a09c50b72ff8ac5ab2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:07:14.287640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1021/2052] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:14 2022] PUT /identity/v3/projects/f4a93c36a49d4a29a764888b224c85cd/users/5ae43e512ec44294920f6de050c98073/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:14.299670 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21299351-8559-4959-b2e5-129ff22f128a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:14.299966 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21299351-8559-4959-b2e5-129ff22f128a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:14.300250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21299351-8559-4959-b2e5-129ff22f128a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:14.333576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-21299351-8559-4959-b2e5-129ff22f128a None None] MFA Rules not processed for user `5ae43e512ec44294920f6de050c98073`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:14.334860 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-21299351-8559-4959-b2e5-129ff22f128a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:14.416180 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1032/2053] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:14.419545 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef5cfd-6b53-4aba-bdbc-f1dc287f38f1 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:14.423926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-94ef5cfd-6b53-4aba-bdbc-f1dc287f38f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:14.508536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef5cfd-6b53-4aba-bdbc-f1dc287f38f1 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:14.514237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a14fb-ccfc-45c7-a5bb-8798784c5269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:14.514991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a14fb-ccfc-45c7-a5bb-8798784c5269 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:14.515351 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a14fb-ccfc-45c7-a5bb-8798784c5269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:14.515719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a14fb-ccfc-45c7-a5bb-8798784c5269 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:14.516491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a14fb-ccfc-45c7-a5bb-8798784c5269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:14.518539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a14fb-ccfc-45c7-a5bb-8798784c5269 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:14.533575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:14.557205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1022/2054] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:07:14 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:14.562299 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21299351-8559-4959-b2e5-129ff22f128a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:14.574683 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21299351-8559-4959-b2e5-129ff22f128a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:14.591273 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:14.642514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b09c9-3ff8-46e5-bb53-243ec12c4b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:14.643244 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b09c9-3ff8-46e5-bb53-243ec12c4b54 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:14.643546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b09c9-3ff8-46e5-bb53-243ec12c4b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:14.643836 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b09c9-3ff8-46e5-bb53-243ec12c4b54 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:14.644700 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b09c9-3ff8-46e5-bb53-243ec12c4b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:14.646703 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b09c9-3ff8-46e5-bb53-243ec12c4b54 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:14.670233 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1033/2055] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:07:14 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:07:14.673926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a14fb-ccfc-45c7-a5bb-8798784c5269 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:14.687722 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a14fb-ccfc-45c7-a5bb-8798784c5269 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:14.694551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e483f2-324e-4b5a-860a-75d0b03a74c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:14.695710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e483f2-324e-4b5a-860a-75d0b03a74c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:14.696205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e483f2-324e-4b5a-860a-75d0b03a74c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:14.696805 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e483f2-324e-4b5a-860a-75d0b03a74c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:14.697791 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e483f2-324e-4b5a-860a-75d0b03a74c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:14.700360 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e483f2-324e-4b5a-860a-75d0b03a74c7 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:14.718447 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1023/2056] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:14.722635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b09c9-3ff8-46e5-bb53-243ec12c4b54 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:14.736714 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b09c9-3ff8-46e5-bb53-243ec12c4b54 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:14.742329 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bbf35-3d04-4064-8f9f-1deaf4a862a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:14.743562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bbf35-3d04-4064-8f9f-1deaf4a862a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:14.744588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bbf35-3d04-4064-8f9f-1deaf4a862a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:14.745210 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79bbf35-3d04-4064-8f9f-1deaf4a862a2 admin admin] PATH_INFO: `/v3/projects/f95cc6d9818341518d0af021972555b0/users/589e236f411d4c5cba9d9690407e66be/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:14.769766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79bbf35-3d04-4064-8f9f-1deaf4a862a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95cc6d9818341518d0af021972555b0, user_id=589e236f411d4c5cba9d9690407e66be, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:14.774235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79bbf35-3d04-4064-8f9f-1deaf4a862a2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:14.790779 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1034/2057] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:14 2022] PUT /identity/v3/projects/f95cc6d9818341518d0af021972555b0/users/589e236f411d4c5cba9d9690407e66be/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:07:14.795533 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e483f2-324e-4b5a-860a-75d0b03a74c7 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:14.808170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e483f2-324e-4b5a-860a-75d0b03a74c7 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:14.839834 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bbf35-3d04-4064-8f9f-1deaf4a862a2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:14.841668 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b79bbf35-3d04-4064-8f9f-1deaf4a862a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:14.890499 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14327514-af33-4912-99b8-2de0852b064f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:14.891542 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14327514-af33-4912-99b8-2de0852b064f admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:14.891542 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14327514-af33-4912-99b8-2de0852b064f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:14.891854 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14327514-af33-4912-99b8-2de0852b064f admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:14.892637 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14327514-af33-4912-99b8-2de0852b064f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:14.894308 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14327514-af33-4912-99b8-2de0852b064f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:14.909167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1024/2058] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:14.913603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14327514-af33-4912-99b8-2de0852b064f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:14.924954 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14327514-af33-4912-99b8-2de0852b064f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:14.930636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14e19e-483f-447c-8149-9a3c655c85df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:14.931589 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14e19e-483f-447c-8149-9a3c655c85df admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:14.931876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14e19e-483f-447c-8149-9a3c655c85df admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:14.932952 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14e19e-483f-447c-8149-9a3c655c85df admin admin] PATH_INFO: `/v3/projects/f95cc6d9818341518d0af021972555b0/users/589e236f411d4c5cba9d9690407e66be/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:14.936256 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14e19e-483f-447c-8149-9a3c655c85df admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95cc6d9818341518d0af021972555b0, user_id=589e236f411d4c5cba9d9690407e66be, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:14.938395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14e19e-483f-447c-8149-9a3c655c85df admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:14.945353 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79bbf35-3d04-4064-8f9f-1deaf4a862a2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:14.952836 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1025/2059] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:14 2022] PUT /identity/v3/projects/f95cc6d9818341518d0af021972555b0/users/589e236f411d4c5cba9d9690407e66be/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:14.963575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f7d5b-8fb5-4773-a177-e963a42268c5 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:14.965509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f7d5b-8fb5-4773-a177-e963a42268c5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:14.965877 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f7d5b-8fb5-4773-a177-e963a42268c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:14.995702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-921f7d5b-8fb5-4773-a177-e963a42268c5 None None] MFA Rules not processed for user `589e236f411d4c5cba9d9690407e66be`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:14.997086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-921f7d5b-8fb5-4773-a177-e963a42268c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:15.014747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bec0a-611b-47eb-9f96-7f80c560e08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:15.015666 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bec0a-611b-47eb-9f96-7f80c560e08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:15.015951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bec0a-611b-47eb-9f96-7f80c560e08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:15.016235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bec0a-611b-47eb-9f96-7f80c560e08c admin admin] PATH_INFO: `/v3/projects/e0a212cff1784483b8d05ed25e7c4f60` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:15.017447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bec0a-611b-47eb-9f96-7f80c560e08c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a212cff1784483b8d05ed25e7c4f60)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:15.019441 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bec0a-611b-47eb-9f96-7f80c560e08c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:15.077833 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:15.102139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9d5bec0a-611b-47eb-9f96-7f80c560e08c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a212cff1784483b8d05ed25e7c4f60', 'request_id': 'req-9d5bec0a-611b-47eb-9f96-7f80c560e08c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:15.107569 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1026/2060] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:07:15.114012 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9d5bec0a-611b-47eb-9f96-7f80c560e08c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a212cff1784483b8d05ed25e7c4f60', 'request_id': 'req-9d5bec0a-611b-47eb-9f96-7f80c560e08c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:15.116176 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f7d5b-8fb5-4773-a177-e963a42268c5 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:15.118035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-921f7d5b-8fb5-4773-a177-e963a42268c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:15.124732 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9d5bec0a-611b-47eb-9f96-7f80c560e08c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a212cff1784483b8d05ed25e7c4f60', 'request_id': 'req-9d5bec0a-611b-47eb-9f96-7f80c560e08c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:15.144598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9d5bec0a-611b-47eb-9f96-7f80c560e08c admin admin] The token cache is being invalidate because project e0a212cff1784483b8d05ed25e7c4f60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:07:15.144946 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9d5bec0a-611b-47eb-9f96-7f80c560e08c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:15.146642 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9d5bec0a-611b-47eb-9f96-7f80c560e08c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:15.153690 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1035/2061] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:07:14 2022] DELETE /identity/v3/projects/e0a212cff1784483b8d05ed25e7c4f60 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:07:15.156436 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8a687-0629-4b6b-b1c3-ef4eb248b42d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:15.156730 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8a687-0629-4b6b-b1c3-ef4eb248b42d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:15.157065 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8a687-0629-4b6b-b1c3-ef4eb248b42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:15.181270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-01c8a687-0629-4b6b-b1c3-ef4eb248b42d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:15.183372 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-01c8a687-0629-4b6b-b1c3-ef4eb248b42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:15.197013 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f7d5b-8fb5-4773-a177-e963a42268c5 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:15.201291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:15.268498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1036/2062] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:07:15.270184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60397b6c-9e11-495b-86a6-1bf94f644e1b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:15.270632 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60397b6c-9e11-495b-86a6-1bf94f644e1b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:15.270992 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60397b6c-9e11-495b-86a6-1bf94f644e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:15.271135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8443dd-7675-4fd2-ba9f-de679ceda25f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:15.272978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8443dd-7675-4fd2-ba9f-de679ceda25f service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:15.273339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8443dd-7675-4fd2-ba9f-de679ceda25f service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:15.273705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8443dd-7675-4fd2-ba9f-de679ceda25f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:15.276921 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3d8443dd-7675-4fd2-ba9f-de679ceda25f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:15.291093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-60397b6c-9e11-495b-86a6-1bf94f644e1b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:15.292803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-60397b6c-9e11-495b-86a6-1bf94f644e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:15.301889 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1037/2063] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:15.306454 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60397b6c-9e11-495b-86a6-1bf94f644e1b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:15.317828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60397b6c-9e11-495b-86a6-1bf94f644e1b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:15.324877 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339c34b-125b-46d9-9720-eec06209a42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:15.326692 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339c34b-125b-46d9-9720-eec06209a42f admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:15.327102 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339c34b-125b-46d9-9720-eec06209a42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:15.327460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339c34b-125b-46d9-9720-eec06209a42f admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:15.328321 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339c34b-125b-46d9-9720-eec06209a42f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:07:15.329072 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339c34b-125b-46d9-9720-eec06209a42f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:15.330719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339c34b-125b-46d9-9720-eec06209a42f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:15.349050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1038/2064] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:07:15.354560 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339c34b-125b-46d9-9720-eec06209a42f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:15.367367 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339c34b-125b-46d9-9720-eec06209a42f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:15.372959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0127a1-68a3-4c17-92c0-e31543bfd4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:15.373794 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0127a1-68a3-4c17-92c0-e31543bfd4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:15.374087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0127a1-68a3-4c17-92c0-e31543bfd4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:15.374371 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0127a1-68a3-4c17-92c0-e31543bfd4a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:15.375079 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0127a1-68a3-4c17-92c0-e31543bfd4a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:15.377049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0127a1-68a3-4c17-92c0-e31543bfd4a3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:15.387103 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8443dd-7675-4fd2-ba9f-de679ceda25f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:15.389069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8443dd-7675-4fd2-ba9f-de679ceda25f service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:15.403237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1027/2065] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:07:15.419530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1039/2066] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:07:15 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:15.423505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8443dd-7675-4fd2-ba9f-de679ceda25f service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:15.431601 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0127a1-68a3-4c17-92c0-e31543bfd4a3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:15.434633 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5c0127a1-68a3-4c17-92c0-e31543bfd4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:15.438687 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8443dd-7675-4fd2-ba9f-de679ceda25f service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:15.505581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109dd3a-0e5c-4d0a-82e2-fcdc4e10443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:15.506411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109dd3a-0e5c-4d0a-82e2-fcdc4e10443c admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:15.507135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109dd3a-0e5c-4d0a-82e2-fcdc4e10443c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:15.507135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109dd3a-0e5c-4d0a-82e2-fcdc4e10443c admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:15.507652 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109dd3a-0e5c-4d0a-82e2-fcdc4e10443c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:15.509620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109dd3a-0e5c-4d0a-82e2-fcdc4e10443c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:15.512008 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0127a1-68a3-4c17-92c0-e31543bfd4a3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:15.516767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7b47c-7453-4e63-9366-5025118e35e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:15.517696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7b47c-7453-4e63-9366-5025118e35e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:15.517991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7b47c-7453-4e63-9366-5025118e35e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:15.518275 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7b47c-7453-4e63-9366-5025118e35e9 admin admin] PATH_INFO: `/v3/users/5ae43e512ec44294920f6de050c98073` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:15.519506 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7b47c-7453-4e63-9366-5025118e35e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae43e512ec44294920f6de050c98073)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:15.521491 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7b47c-7453-4e63-9366-5025118e35e9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:15.535834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1028/2067] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:07:15 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:15.536951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109dd3a-0e5c-4d0a-82e2-fcdc4e10443c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:15.547109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109dd3a-0e5c-4d0a-82e2-fcdc4e10443c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:15.552545 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276be56-a9b4-4ab7-a772-7bcca5fb43f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:15.553224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276be56-a9b4-4ab7-a772-7bcca5fb43f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:15.553512 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276be56-a9b4-4ab7-a772-7bcca5fb43f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:15.553827 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276be56-a9b4-4ab7-a772-7bcca5fb43f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:15.554570 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276be56-a9b4-4ab7-a772-7bcca5fb43f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:15.555667 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:15.557165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276be56-a9b4-4ab7-a772-7bcca5fb43f0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:15.569811 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1029/2068] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:07:15.574723 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276be56-a9b4-4ab7-a772-7bcca5fb43f0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:15.586633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276be56-a9b4-4ab7-a772-7bcca5fb43f0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:15.594083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a146c5-a0f8-4a8e-9e40-048d9d19b437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:15.594759 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a146c5-a0f8-4a8e-9e40-048d9d19b437 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:15.595061 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a146c5-a0f8-4a8e-9e40-048d9d19b437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:15.595340 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a146c5-a0f8-4a8e-9e40-048d9d19b437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:15.595822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0dd7b47c-7453-4e63-9366-5025118e35e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae43e512ec44294920f6de050c98073'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:15.596152 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a146c5-a0f8-4a8e-9e40-048d9d19b437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:15.596702 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0dd7b47c-7453-4e63-9366-5025118e35e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae43e512ec44294920f6de050c98073'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:15.597769 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a146c5-a0f8-4a8e-9e40-048d9d19b437 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:15.607070 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0dd7b47c-7453-4e63-9366-5025118e35e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae43e512ec44294920f6de050c98073'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:15.614782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1030/2069] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:15.615522 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0dd7b47c-7453-4e63-9366-5025118e35e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae43e512ec44294920f6de050c98073'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:15.616027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a146c5-a0f8-4a8e-9e40-048d9d19b437 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:15.630073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a146c5-a0f8-4a8e-9e40-048d9d19b437 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:15.630572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0dd7b47c-7453-4e63-9366-5025118e35e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae43e512ec44294920f6de050c98073'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:15.636037 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb3186-8146-41d6-bcec-59a08bcbb338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:15.636923 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb3186-8146-41d6-bcec-59a08bcbb338 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:15.637210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb3186-8146-41d6-bcec-59a08bcbb338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:15.637468 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb3186-8146-41d6-bcec-59a08bcbb338 admin admin] PATH_INFO: `/v3/projects/27c040cca4354317a6bbffc2a716f586/users/d9b7d903200744c589f9f37d9aca29d9/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:15.643748 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1040/2070] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:07:15 2022] DELETE /identity/v3/users/5ae43e512ec44294920f6de050c98073 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:07:15.645712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9473a-070a-4a27-a682-dc7fdceb4a58 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:15.646117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9473a-070a-4a27-a682-dc7fdceb4a58 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:15.646509 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9473a-070a-4a27-a682-dc7fdceb4a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:15.655340 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb3186-8146-41d6-bcec-59a08bcbb338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c040cca4354317a6bbffc2a716f586, user_id=d9b7d903200744c589f9f37d9aca29d9, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:15.658164 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb3186-8146-41d6-bcec-59a08bcbb338 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:15.667083 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8db9473a-070a-4a27-a682-dc7fdceb4a58 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:15.669021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:15.669153 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8db9473a-070a-4a27-a682-dc7fdceb4a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:15.675408 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1031/2071] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:15 2022] PUT /identity/v3/projects/27c040cca4354317a6bbffc2a716f586/users/d9b7d903200744c589f9f37d9aca29d9/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:07:15.686547 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c6066-a4f9-456d-bf58-678dd5229e57 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:15.687494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c6066-a4f9-456d-bf58-678dd5229e57 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:15.687761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c6066-a4f9-456d-bf58-678dd5229e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:15.721918 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-046c6066-a4f9-456d-bf58-678dd5229e57 None None] MFA Rules not processed for user `d9b7d903200744c589f9f37d9aca29d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:15.723584 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-046c6066-a4f9-456d-bf58-678dd5229e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:15.748767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1041/2072] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:15.760493 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9473a-070a-4a27-a682-dc7fdceb4a58 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:15.762127 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8db9473a-070a-4a27-a682-dc7fdceb4a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:15.821832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1032/2073] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:07:15.833469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c6066-a4f9-456d-bf58-678dd5229e57 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:15.835427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-046c6066-a4f9-456d-bf58-678dd5229e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:15.837499 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9473a-070a-4a27-a682-dc7fdceb4a58 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:15.842886 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ceecc-c931-472d-a301-681bd546c7e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:15.843620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ceecc-c931-472d-a301-681bd546c7e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:15.843902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ceecc-c931-472d-a301-681bd546c7e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:15.844175 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ceecc-c931-472d-a301-681bd546c7e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:15.853322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c6066-a4f9-456d-bf58-678dd5229e57 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:15.858486 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ceecc-c931-472d-a301-681bd546c7e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:15.860468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ceecc-c931-472d-a301-681bd546c7e5 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:15.861574 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e62c6-2d7b-41cf-94b8-cf17d19d01e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:15.862390 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e62c6-2d7b-41cf-94b8-cf17d19d01e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:15.862683 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e62c6-2d7b-41cf-94b8-cf17d19d01e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:15.862966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e62c6-2d7b-41cf-94b8-cf17d19d01e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:15.863671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e62c6-2d7b-41cf-94b8-cf17d19d01e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:15.865976 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e62c6-2d7b-41cf-94b8-cf17d19d01e4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:15.877697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1042/2074] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:15.900965 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1033/2075] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:07:15 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:15.905457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ceecc-c931-472d-a301-681bd546c7e5 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:15.918519 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ceecc-c931-472d-a301-681bd546c7e5 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:15.974441 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:15.992831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b92e7-ea1e-4909-a43d-385b7cdb3562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:15.994150 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b92e7-ea1e-4909-a43d-385b7cdb3562 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:15.994444 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b92e7-ea1e-4909-a43d-385b7cdb3562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:15.994875 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b92e7-ea1e-4909-a43d-385b7cdb3562 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:15.996655 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b92e7-ea1e-4909-a43d-385b7cdb3562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:15.998385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b92e7-ea1e-4909-a43d-385b7cdb3562 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:16.032540 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1043/2076] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:07:15 2022] POST /identity/v3/users => generated 297 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:07:16.034449 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e62c6-2d7b-41cf-94b8-cf17d19d01e4 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:16.053479 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e62c6-2d7b-41cf-94b8-cf17d19d01e4 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:16.071324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a40752-8135-484d-b831-dcc1636a818a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:16.071990 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a40752-8135-484d-b831-dcc1636a818a admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:16.072279 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a40752-8135-484d-b831-dcc1636a818a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:16.072559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a40752-8135-484d-b831-dcc1636a818a admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:16.073483 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a40752-8135-484d-b831-dcc1636a818a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:16.075170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a40752-8135-484d-b831-dcc1636a818a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:16.086930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1034/2077] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:07:16.093090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b92e7-ea1e-4909-a43d-385b7cdb3562 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:16.104208 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b92e7-ea1e-4909-a43d-385b7cdb3562 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:16.109841 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82086fee-00a8-418e-af22-fa9da7888a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:16.112930 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82086fee-00a8-418e-af22-fa9da7888a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:16.112930 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82086fee-00a8-418e-af22-fa9da7888a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:16.112930 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82086fee-00a8-418e-af22-fa9da7888a9e admin admin] PATH_INFO: `/v3/projects/669317825eec471cbc063261c7105a70/users/13b405ae5958475babf8e8d2e094cad9/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:16.136182 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82086fee-00a8-418e-af22-fa9da7888a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=669317825eec471cbc063261c7105a70, user_id=13b405ae5958475babf8e8d2e094cad9, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:16.139253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82086fee-00a8-418e-af22-fa9da7888a9e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:16.157969 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1044/2078] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:16 2022] PUT /identity/v3/projects/669317825eec471cbc063261c7105a70/users/13b405ae5958475babf8e8d2e094cad9/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:16.160280 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a40752-8135-484d-b831-dcc1636a818a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:16.180596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a40752-8135-484d-b831-dcc1636a818a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:16.203501 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82086fee-00a8-418e-af22-fa9da7888a9e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:16.205950 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-82086fee-00a8-418e-af22-fa9da7888a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:16.268920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175c22d-8832-4cce-ac4e-41c3c293d73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:16.269608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175c22d-8832-4cce-ac4e-41c3c293d73a admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:16.269924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175c22d-8832-4cce-ac4e-41c3c293d73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:16.270204 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175c22d-8832-4cce-ac4e-41c3c293d73a admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:16.271269 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175c22d-8832-4cce-ac4e-41c3c293d73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:16.272553 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175c22d-8832-4cce-ac4e-41c3c293d73a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:16.283975 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1035/2079] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:16.288395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175c22d-8832-4cce-ac4e-41c3c293d73a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:16.300659 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175c22d-8832-4cce-ac4e-41c3c293d73a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:16.304767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82086fee-00a8-418e-af22-fa9da7888a9e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:16.305822 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da934d7-c50a-4ad3-aaad-60b84e79e350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:16.306786 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da934d7-c50a-4ad3-aaad-60b84e79e350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:16.307139 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da934d7-c50a-4ad3-aaad-60b84e79e350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:16.308118 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da934d7-c50a-4ad3-aaad-60b84e79e350 admin admin] PATH_INFO: `/v3/projects/669317825eec471cbc063261c7105a70/users/13b405ae5958475babf8e8d2e094cad9/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:16.310507 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da934d7-c50a-4ad3-aaad-60b84e79e350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=669317825eec471cbc063261c7105a70, user_id=13b405ae5958475babf8e8d2e094cad9, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:16.312302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4ed33-00f6-4b74-8bef-0228476d859e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:16.313327 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ed33-00f6-4b74-8bef-0228476d859e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:16.313575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da934d7-c50a-4ad3-aaad-60b84e79e350 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:16.313956 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ed33-00f6-4b74-8bef-0228476d859e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:16.314415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ed33-00f6-4b74-8bef-0228476d859e admin admin] PATH_INFO: `/v3/projects/f4a93c36a49d4a29a764888b224c85cd` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:16.315645 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4ed33-00f6-4b74-8bef-0228476d859e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4a93c36a49d4a29a764888b224c85cd)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:16.317565 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4ed33-00f6-4b74-8bef-0228476d859e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:16.325711 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1036/2080] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:16 2022] PUT /identity/v3/projects/669317825eec471cbc063261c7105a70/users/13b405ae5958475babf8e8d2e094cad9/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:16.336649 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bd0f7-7e2e-4561-b0a2-8e1676d0b6d7 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:16.337201 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bd0f7-7e2e-4561-b0a2-8e1676d0b6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:16.337201 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bd0f7-7e2e-4561-b0a2-8e1676d0b6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:16.368417 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5c2bd0f7-7e2e-4561-b0a2-8e1676d0b6d7 None None] MFA Rules not processed for user `13b405ae5958475babf8e8d2e094cad9`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:16.370370 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5c2bd0f7-7e2e-4561-b0a2-8e1676d0b6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:16.382016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-14d4ed33-00f6-4b74-8bef-0228476d859e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4a93c36a49d4a29a764888b224c85cd', 'request_id': 'req-14d4ed33-00f6-4b74-8bef-0228476d859e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:16.391323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-14d4ed33-00f6-4b74-8bef-0228476d859e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4a93c36a49d4a29a764888b224c85cd', 'request_id': 'req-14d4ed33-00f6-4b74-8bef-0228476d859e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:16.398925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-14d4ed33-00f6-4b74-8bef-0228476d859e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4a93c36a49d4a29a764888b224c85cd', 'request_id': 'req-14d4ed33-00f6-4b74-8bef-0228476d859e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:16.411089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:16.415554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-14d4ed33-00f6-4b74-8bef-0228476d859e admin admin] The token cache is being invalidate because project f4a93c36a49d4a29a764888b224c85cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:07:16.416197 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-14d4ed33-00f6-4b74-8bef-0228476d859e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:16.418429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-14d4ed33-00f6-4b74-8bef-0228476d859e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:16.421505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1045/2081] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:07:16 2022] DELETE /identity/v3/projects/f4a93c36a49d4a29a764888b224c85cd => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:16.425222 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4ed33-00f6-4b74-8bef-0228476d859e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:16.428674 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-14d4ed33-00f6-4b74-8bef-0228476d859e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:16.468754 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1037/2082] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:07:16.480302 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bd0f7-7e2e-4561-b0a2-8e1676d0b6d7 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:16.482508 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5c2bd0f7-7e2e-4561-b0a2-8e1676d0b6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:16.518433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:16.548910 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4ed33-00f6-4b74-8bef-0228476d859e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:16.560516 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a3de1-89b6-4ed0-a135-09190823eafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:16.561509 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a3de1-89b6-4ed0-a135-09190823eafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:16.561894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a3de1-89b6-4ed0-a135-09190823eafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:16.562280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a3de1-89b6-4ed0-a135-09190823eafa admin admin] PATH_INFO: `/v3/users/589e236f411d4c5cba9d9690407e66be` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:16.563656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a3de1-89b6-4ed0-a135-09190823eafa admin admin] RBAC: Authorizing `identity:delete_user(user_id=589e236f411d4c5cba9d9690407e66be)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:16.565409 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bd0f7-7e2e-4561-b0a2-8e1676d0b6d7 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:16.566204 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a3de1-89b6-4ed0-a135-09190823eafa admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:16.570852 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f2d26-ba5d-4d2b-92cd-ed0123e02c38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:16.571702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f2d26-ba5d-4d2b-92cd-ed0123e02c38 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:16.572318 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f2d26-ba5d-4d2b-92cd-ed0123e02c38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:16.572741 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f2d26-ba5d-4d2b-92cd-ed0123e02c38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:16.576096 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d38f2d26-ba5d-4d2b-92cd-ed0123e02c38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:16.660639 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-690a3de1-89b6-4ed0-a135-09190823eafa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '589e236f411d4c5cba9d9690407e66be'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:16.661841 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-690a3de1-89b6-4ed0-a135-09190823eafa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '589e236f411d4c5cba9d9690407e66be'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:16.674587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-690a3de1-89b6-4ed0-a135-09190823eafa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '589e236f411d4c5cba9d9690407e66be'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:16.686205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f2d26-ba5d-4d2b-92cd-ed0123e02c38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:16.686450 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-690a3de1-89b6-4ed0-a135-09190823eafa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '589e236f411d4c5cba9d9690407e66be'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:16.687689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f2d26-ba5d-4d2b-92cd-ed0123e02c38 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:16.698942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1038/2083] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:07:16.705686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-690a3de1-89b6-4ed0-a135-09190823eafa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '589e236f411d4c5cba9d9690407e66be'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:16.719790 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1046/2084] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:07:16 2022] DELETE /identity/v3/users/589e236f411d4c5cba9d9690407e66be => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:17.048444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f2d26-ba5d-4d2b-92cd-ed0123e02c38 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:17.074654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f2d26-ba5d-4d2b-92cd-ed0123e02c38 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:17.159895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ae054-ad60-44ec-84df-3369346742ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:17.160799 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ae054-ad60-44ec-84df-3369346742ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:17.161456 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ae054-ad60-44ec-84df-3369346742ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:17.162199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ae054-ad60-44ec-84df-3369346742ec admin admin] PATH_INFO: `/v3/projects/f95cc6d9818341518d0af021972555b0` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:17.163715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ae054-ad60-44ec-84df-3369346742ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95cc6d9818341518d0af021972555b0)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:17.165954 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ae054-ad60-44ec-84df-3369346742ec admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:17.201442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:17.231866 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b30ae054-ad60-44ec-84df-3369346742ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95cc6d9818341518d0af021972555b0', 'request_id': 'req-b30ae054-ad60-44ec-84df-3369346742ec'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:17.239622 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b30ae054-ad60-44ec-84df-3369346742ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95cc6d9818341518d0af021972555b0', 'request_id': 'req-b30ae054-ad60-44ec-84df-3369346742ec'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:17.247579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b30ae054-ad60-44ec-84df-3369346742ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95cc6d9818341518d0af021972555b0', 'request_id': 'req-b30ae054-ad60-44ec-84df-3369346742ec'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:17.263985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b30ae054-ad60-44ec-84df-3369346742ec admin admin] The token cache is being invalidate because project f95cc6d9818341518d0af021972555b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:07:17.264584 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b30ae054-ad60-44ec-84df-3369346742ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:17.265258 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-b30ae054-ad60-44ec-84df-3369346742ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:17.267828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1039/2085] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:07:17 2022] DELETE /identity/v3/projects/f95cc6d9818341518d0af021972555b0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:17.272945 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad0841-dd3c-4a96-89dd-75e96391fcec None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:17.273410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad0841-dd3c-4a96-89dd-75e96391fcec None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:17.273736 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad0841-dd3c-4a96-89dd-75e96391fcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:17.293582 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c9ad0841-dd3c-4a96-89dd-75e96391fcec None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:17.294814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c9ad0841-dd3c-4a96-89dd-75e96391fcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:17.356083 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1047/2086] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:17.364930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567720c6-47b6-4007-9f85-42591167e662 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:17.365613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567720c6-47b6-4007-9f85-42591167e662 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:17.365926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567720c6-47b6-4007-9f85-42591167e662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:17.386712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-567720c6-47b6-4007-9f85-42591167e662 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:17.387935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-567720c6-47b6-4007-9f85-42591167e662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:17.396420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1040/2087] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:17.400855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad0841-dd3c-4a96-89dd-75e96391fcec None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:17.411049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad0841-dd3c-4a96-89dd-75e96391fcec None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:17.415968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c29846-9426-408d-b16d-1dcc04cfac6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:17.417118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c29846-9426-408d-b16d-1dcc04cfac6f admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:17.417959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c29846-9426-408d-b16d-1dcc04cfac6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:17.418243 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c29846-9426-408d-b16d-1dcc04cfac6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:17.419008 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c29846-9426-408d-b16d-1dcc04cfac6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:07:17.419313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c29846-9426-408d-b16d-1dcc04cfac6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:17.420955 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c29846-9426-408d-b16d-1dcc04cfac6f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:17.433858 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1048/2088] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:07:17.438229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567720c6-47b6-4007-9f85-42591167e662 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:17.447690 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567720c6-47b6-4007-9f85-42591167e662 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:17.452675 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae949a98-919a-4583-8654-c358819c3b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:17.453335 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae949a98-919a-4583-8654-c358819c3b23 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:17.453622 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae949a98-919a-4583-8654-c358819c3b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:17.453920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae949a98-919a-4583-8654-c358819c3b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:17.454620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae949a98-919a-4583-8654-c358819c3b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:17.456555 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae949a98-919a-4583-8654-c358819c3b23 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:17.484649 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1041/2089] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:07:17 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:17.488957 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c29846-9426-408d-b16d-1dcc04cfac6f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:17.499596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c29846-9426-408d-b16d-1dcc04cfac6f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:17.542651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:17.562080 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3078b2-e5f8-452a-897b-dafe227e8756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:17.562880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3078b2-e5f8-452a-897b-dafe227e8756 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:17.563256 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3078b2-e5f8-452a-897b-dafe227e8756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:17.563644 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3078b2-e5f8-452a-897b-dafe227e8756 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:17.564441 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3078b2-e5f8-452a-897b-dafe227e8756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:17.566619 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3078b2-e5f8-452a-897b-dafe227e8756 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:17.586612 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1049/2090] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:07:17 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:17.591558 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae949a98-919a-4583-8654-c358819c3b23 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:17.601896 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae949a98-919a-4583-8654-c358819c3b23 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:17.607419 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec0982-326a-4d93-af0a-ff1d98d4b13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:17.608156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec0982-326a-4d93-af0a-ff1d98d4b13f admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:17.608717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec0982-326a-4d93-af0a-ff1d98d4b13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:17.609027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec0982-326a-4d93-af0a-ff1d98d4b13f admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:17.609795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec0982-326a-4d93-af0a-ff1d98d4b13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:17.611412 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec0982-326a-4d93-af0a-ff1d98d4b13f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:17.622088 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1042/2091] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:17.626181 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3078b2-e5f8-452a-897b-dafe227e8756 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:17.637009 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3078b2-e5f8-452a-897b-dafe227e8756 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:17.641640 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058ad4c-9074-451b-b396-45ac597acfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:17.642317 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058ad4c-9074-451b-b396-45ac597acfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:17.642605 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058ad4c-9074-451b-b396-45ac597acfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:17.642892 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058ad4c-9074-451b-b396-45ac597acfb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:17.643622 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058ad4c-9074-451b-b396-45ac597acfb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:17.645217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058ad4c-9074-451b-b396-45ac597acfb5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:17.656668 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1050/2092] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:17.660970 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec0982-326a-4d93-af0a-ff1d98d4b13f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:17.672158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec0982-326a-4d93-af0a-ff1d98d4b13f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:17.677155 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def37b57-00f1-4ca4-9887-f7fc08811fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:17.678075 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def37b57-00f1-4ca4-9887-f7fc08811fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:17.678353 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def37b57-00f1-4ca4-9887-f7fc08811fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:17.678622 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def37b57-00f1-4ca4-9887-f7fc08811fa8 admin admin] PATH_INFO: `/v3/projects/626a488e4e104e07a8641eaac9453182/users/a1ee5eb91ce14affa154913f8d7af84b/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:17.695104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def37b57-00f1-4ca4-9887-f7fc08811fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=626a488e4e104e07a8641eaac9453182, user_id=a1ee5eb91ce14affa154913f8d7af84b, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:17.697906 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def37b57-00f1-4ca4-9887-f7fc08811fa8 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:17.713169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1043/2093] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:17 2022] PUT /identity/v3/projects/626a488e4e104e07a8641eaac9453182/users/a1ee5eb91ce14affa154913f8d7af84b/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:17.725402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfaf6e-786d-4d56-aa32-f2b27f159839 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:17.725921 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfaf6e-786d-4d56-aa32-f2b27f159839 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:17.726210 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfaf6e-786d-4d56-aa32-f2b27f159839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:17.792867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8adfaf6e-786d-4d56-aa32-f2b27f159839 None None] MFA Rules not processed for user `a1ee5eb91ce14affa154913f8d7af84b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:17.794556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8adfaf6e-786d-4d56-aa32-f2b27f159839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:17.887729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1051/2094] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:17.892637 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def37b57-00f1-4ca4-9887-f7fc08811fa8 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:17.973871 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def37b57-00f1-4ca4-9887-f7fc08811fa8 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:17.978687 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b3a3a-3b86-467d-915a-0b396cbd9613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:17.979374 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b3a3a-3b86-467d-915a-0b396cbd9613 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:17.979658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b3a3a-3b86-467d-915a-0b396cbd9613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:17.980092 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b3a3a-3b86-467d-915a-0b396cbd9613 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:17.980796 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b3a3a-3b86-467d-915a-0b396cbd9613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:17.982867 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b3a3a-3b86-467d-915a-0b396cbd9613 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:18.009703 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1044/2095] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:07:17 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:18.014293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfaf6e-786d-4d56-aa32-f2b27f159839 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:18.026913 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfaf6e-786d-4d56-aa32-f2b27f159839 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:18.086728 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b1787-61bf-44ec-9ae1-9bea68cf24d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:18.087704 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b1787-61bf-44ec-9ae1-9bea68cf24d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:18.087994 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b1787-61bf-44ec-9ae1-9bea68cf24d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:18.088305 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b1787-61bf-44ec-9ae1-9bea68cf24d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:18.089934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b1787-61bf-44ec-9ae1-9bea68cf24d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:18.092007 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b1787-61bf-44ec-9ae1-9bea68cf24d3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:18.113418 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1052/2096] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:07:18 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:18.117466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b3a3a-3b86-467d-915a-0b396cbd9613 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:18.128088 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b3a3a-3b86-467d-915a-0b396cbd9613 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:18.132750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d684a9-cbf0-40ed-9838-62da9da87a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:18.133399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d684a9-cbf0-40ed-9838-62da9da87a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:18.133715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d684a9-cbf0-40ed-9838-62da9da87a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:18.133995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d684a9-cbf0-40ed-9838-62da9da87a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:18.134720 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d684a9-cbf0-40ed-9838-62da9da87a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:18.137089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d684a9-cbf0-40ed-9838-62da9da87a64 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:18.147738 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1045/2097] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:18.152442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b1787-61bf-44ec-9ae1-9bea68cf24d3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:18.163246 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b1787-61bf-44ec-9ae1-9bea68cf24d3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:18.168657 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29b4eb-8feb-4382-a779-99eb6012521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:18.169619 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29b4eb-8feb-4382-a779-99eb6012521e admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:18.169994 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29b4eb-8feb-4382-a779-99eb6012521e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:18.170342 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29b4eb-8feb-4382-a779-99eb6012521e admin admin] PATH_INFO: `/v3/projects/5584dd2b6ead4692ad9e756344ff4be5/users/c08497a73f274e8eac9c7728756f8ddb/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:18.187744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29b4eb-8feb-4382-a779-99eb6012521e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5584dd2b6ead4692ad9e756344ff4be5, user_id=c08497a73f274e8eac9c7728756f8ddb, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:18.190596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29b4eb-8feb-4382-a779-99eb6012521e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:18.204767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1053/2098] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:18 2022] PUT /identity/v3/projects/5584dd2b6ead4692ad9e756344ff4be5/users/c08497a73f274e8eac9c7728756f8ddb/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:18.209013 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d684a9-cbf0-40ed-9838-62da9da87a64 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:18.219709 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d684a9-cbf0-40ed-9838-62da9da87a64 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:18.239285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:18.281454 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9b56d-c0d5-484a-924f-efc459b98ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:18.282159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9b56d-c0d5-484a-924f-efc459b98ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:18.282444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9b56d-c0d5-484a-924f-efc459b98ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:18.282719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9b56d-c0d5-484a-924f-efc459b98ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:18.283442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9b56d-c0d5-484a-924f-efc459b98ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:18.285051 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9b56d-c0d5-484a-924f-efc459b98ae9 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:18.298428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1046/2099] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:18.299933 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29b4eb-8feb-4382-a779-99eb6012521e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:18.312125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29b4eb-8feb-4382-a779-99eb6012521e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:18.317226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d8d68-d544-40e1-937d-8aa5445746b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:18.318201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d8d68-d544-40e1-937d-8aa5445746b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:18.318489 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d8d68-d544-40e1-937d-8aa5445746b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:18.318762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d8d68-d544-40e1-937d-8aa5445746b7 admin admin] PATH_INFO: `/v3/projects/5584dd2b6ead4692ad9e756344ff4be5/users/c08497a73f274e8eac9c7728756f8ddb/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:18.320872 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d8d68-d544-40e1-937d-8aa5445746b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5584dd2b6ead4692ad9e756344ff4be5, user_id=c08497a73f274e8eac9c7728756f8ddb, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:18.324002 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d8d68-d544-40e1-937d-8aa5445746b7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:18.335092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1054/2100] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:18 2022] PUT /identity/v3/projects/5584dd2b6ead4692ad9e756344ff4be5/users/c08497a73f274e8eac9c7728756f8ddb/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:18.345901 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f7d56-d31b-4481-b5b8-4aafe78af756 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:18.346198 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f7d56-d31b-4481-b5b8-4aafe78af756 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:18.346484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f7d56-d31b-4481-b5b8-4aafe78af756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:18.373752 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c63f7d56-d31b-4481-b5b8-4aafe78af756 None None] MFA Rules not processed for user `c08497a73f274e8eac9c7728756f8ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:18.374983 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c63f7d56-d31b-4481-b5b8-4aafe78af756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:18.445037 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1047/2101] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:18 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:18.456589 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d8d68-d544-40e1-937d-8aa5445746b7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:18.458341 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8b9d8d68-d544-40e1-937d-8aa5445746b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:18.466010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:18.524763 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d8d68-d544-40e1-937d-8aa5445746b7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:18.529464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c101d5-8d2b-4ff3-808c-c1821cf84aec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:18.530152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c101d5-8d2b-4ff3-808c-c1821cf84aec service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:18.530440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c101d5-8d2b-4ff3-808c-c1821cf84aec service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:18.530723 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c101d5-8d2b-4ff3-808c-c1821cf84aec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:18.540919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c101d5-8d2b-4ff3-808c-c1821cf84aec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:18.543001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c101d5-8d2b-4ff3-808c-c1821cf84aec service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:18.552793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1055/2102] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:18.638233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f7d56-d31b-4481-b5b8-4aafe78af756 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:18.647881 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f7d56-d31b-4481-b5b8-4aafe78af756 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:18.651799 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d193b69-cb88-4d49-87a9-edb4b2db3674 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:18.652443 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d193b69-cb88-4d49-87a9-edb4b2db3674 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:18.652768 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d193b69-cb88-4d49-87a9-edb4b2db3674 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:18.653045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d193b69-cb88-4d49-87a9-edb4b2db3674 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:18.710472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d193b69-cb88-4d49-87a9-edb4b2db3674 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:18.711918 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d193b69-cb88-4d49-87a9-edb4b2db3674 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:18.721761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1048/2103] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:23.181224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c101d5-8d2b-4ff3-808c-c1821cf84aec service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:23.191953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c101d5-8d2b-4ff3-808c-c1821cf84aec service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:23.195833 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784a857-ef4a-4fb2-8e89-1ddc8d763d47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:23.196534 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784a857-ef4a-4fb2-8e89-1ddc8d763d47 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:23.196883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784a857-ef4a-4fb2-8e89-1ddc8d763d47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:23.197240 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784a857-ef4a-4fb2-8e89-1ddc8d763d47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:23.200490 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5784a857-ef4a-4fb2-8e89-1ddc8d763d47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:23.269045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784a857-ef4a-4fb2-8e89-1ddc8d763d47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:23.270588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784a857-ef4a-4fb2-8e89-1ddc8d763d47 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:23.284811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1056/2104] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:24.583656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d193b69-cb88-4d49-87a9-edb4b2db3674 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:24.632119 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:24.657084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d193b69-cb88-4d49-87a9-edb4b2db3674 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:24.662134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d8b8c-4ce0-4062-979d-31272b6818ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:24.663005 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d8b8c-4ce0-4062-979d-31272b6818ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:24.663289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d8b8c-4ce0-4062-979d-31272b6818ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:24.663569 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d8b8c-4ce0-4062-979d-31272b6818ce admin admin] PATH_INFO: `/v3/users/a1ee5eb91ce14affa154913f8d7af84b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:24.664753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d8b8c-4ce0-4062-979d-31272b6818ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ee5eb91ce14affa154913f8d7af84b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:24.667308 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d8b8c-4ce0-4062-979d-31272b6818ce admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:24.715728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7f8d8b8c-4ce0-4062-979d-31272b6818ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ee5eb91ce14affa154913f8d7af84b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:24.722941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7f8d8b8c-4ce0-4062-979d-31272b6818ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ee5eb91ce14affa154913f8d7af84b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:24.734795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7f8d8b8c-4ce0-4062-979d-31272b6818ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ee5eb91ce14affa154913f8d7af84b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:24.735489 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7f8d8b8c-4ce0-4062-979d-31272b6818ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ee5eb91ce14affa154913f8d7af84b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:24.736088 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7f8d8b8c-4ce0-4062-979d-31272b6818ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ee5eb91ce14affa154913f8d7af84b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:24.749634 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1049/2105] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:07:24 2022] DELETE /identity/v3/users/a1ee5eb91ce14affa154913f8d7af84b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:24.754235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbba6ec-d98a-4dea-8f09-61da00d512e3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:24.754719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbba6ec-d98a-4dea-8f09-61da00d512e3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:24.754820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbba6ec-d98a-4dea-8f09-61da00d512e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:24.773338 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-bcbba6ec-d98a-4dea-8f09-61da00d512e3 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:24.774623 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bcbba6ec-d98a-4dea-8f09-61da00d512e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:24.839425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1057/2106] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:24.849373 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d8b8c-4ce0-4062-979d-31272b6818ce admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:24.850862 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7f8d8b8c-4ce0-4062-979d-31272b6818ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:24.936171 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d8b8c-4ce0-4062-979d-31272b6818ce admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:24.940122 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8789357-e2be-4198-9cb4-5c06dda02bb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:24.940780 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8789357-e2be-4198-9cb4-5c06dda02bb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:24.941061 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8789357-e2be-4198-9cb4-5c06dda02bb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:24.941709 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8789357-e2be-4198-9cb4-5c06dda02bb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:24.958106 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8789357-e2be-4198-9cb4-5c06dda02bb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:24.959942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8789357-e2be-4198-9cb4-5c06dda02bb5 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:24.971933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1050/2107] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:25.341451 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbba6ec-d98a-4dea-8f09-61da00d512e3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:25.345944 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bcbba6ec-d98a-4dea-8f09-61da00d512e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:25.362569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbba6ec-d98a-4dea-8f09-61da00d512e3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:25.368219 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72b1fe-4a13-461c-af46-33b97740b809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:25.369293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72b1fe-4a13-461c-af46-33b97740b809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:25.369698 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72b1fe-4a13-461c-af46-33b97740b809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:25.370208 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72b1fe-4a13-461c-af46-33b97740b809 admin admin] PATH_INFO: `/v3/projects/626a488e4e104e07a8641eaac9453182` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:25.371701 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72b1fe-4a13-461c-af46-33b97740b809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=626a488e4e104e07a8641eaac9453182)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:25.374020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72b1fe-4a13-461c-af46-33b97740b809 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:25.419886 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:25.430492 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0d72b1fe-4a13-461c-af46-33b97740b809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '626a488e4e104e07a8641eaac9453182', 'request_id': 'req-0d72b1fe-4a13-461c-af46-33b97740b809'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:25.438629 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0d72b1fe-4a13-461c-af46-33b97740b809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '626a488e4e104e07a8641eaac9453182', 'request_id': 'req-0d72b1fe-4a13-461c-af46-33b97740b809'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:25.445449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0d72b1fe-4a13-461c-af46-33b97740b809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '626a488e4e104e07a8641eaac9453182', 'request_id': 'req-0d72b1fe-4a13-461c-af46-33b97740b809'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:25.464381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0d72b1fe-4a13-461c-af46-33b97740b809 admin admin] The token cache is being invalidate because project 626a488e4e104e07a8641eaac9453182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:07:25.464683 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0d72b1fe-4a13-461c-af46-33b97740b809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:25.465347 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0d72b1fe-4a13-461c-af46-33b97740b809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:25.467149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1058/2108] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:07:25 2022] DELETE /identity/v3/projects/626a488e4e104e07a8641eaac9453182 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:25.471124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8789357-e2be-4198-9cb4-5c06dda02bb5 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:25.482760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8789357-e2be-4198-9cb4-5c06dda02bb5 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:25.544067 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed8685-238f-4a97-95d6-472e7d0ecadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:25.544933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed8685-238f-4a97-95d6-472e7d0ecadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:25.545250 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed8685-238f-4a97-95d6-472e7d0ecadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:25.545546 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed8685-238f-4a97-95d6-472e7d0ecadb admin admin] PATH_INFO: `/v3/users/c08497a73f274e8eac9c7728756f8ddb` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:25.546788 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed8685-238f-4a97-95d6-472e7d0ecadb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c08497a73f274e8eac9c7728756f8ddb)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:25.548743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed8685-238f-4a97-95d6-472e7d0ecadb admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:25.551098 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:25.599298 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f7ed8685-238f-4a97-95d6-472e7d0ecadb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c08497a73f274e8eac9c7728756f8ddb'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:25.610706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f7ed8685-238f-4a97-95d6-472e7d0ecadb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c08497a73f274e8eac9c7728756f8ddb'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:25.623251 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f7ed8685-238f-4a97-95d6-472e7d0ecadb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c08497a73f274e8eac9c7728756f8ddb'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:25.624057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f7ed8685-238f-4a97-95d6-472e7d0ecadb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c08497a73f274e8eac9c7728756f8ddb'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:25.624718 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f7ed8685-238f-4a97-95d6-472e7d0ecadb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c08497a73f274e8eac9c7728756f8ddb'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:25.638649 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1051/2109] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:07:25 2022] DELETE /identity/v3/users/c08497a73f274e8eac9c7728756f8ddb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:25.926483 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72b1fe-4a13-461c-af46-33b97740b809 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:25.928359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0d72b1fe-4a13-461c-af46-33b97740b809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:25.947131 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72b1fe-4a13-461c-af46-33b97740b809 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:26.010895 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baff7b0-685c-4245-a56b-227d42fb00ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:26.011814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baff7b0-685c-4245-a56b-227d42fb00ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:26.012096 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baff7b0-685c-4245-a56b-227d42fb00ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:26.012371 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baff7b0-685c-4245-a56b-227d42fb00ae admin admin] PATH_INFO: `/v3/projects/5584dd2b6ead4692ad9e756344ff4be5` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:26.013552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baff7b0-685c-4245-a56b-227d42fb00ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=5584dd2b6ead4692ad9e756344ff4be5)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:26.015492 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baff7b0-685c-4245-a56b-227d42fb00ae admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:26.067064 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3baff7b0-685c-4245-a56b-227d42fb00ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5584dd2b6ead4692ad9e756344ff4be5', 'request_id': 'req-3baff7b0-685c-4245-a56b-227d42fb00ae'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:26.074966 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3baff7b0-685c-4245-a56b-227d42fb00ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5584dd2b6ead4692ad9e756344ff4be5', 'request_id': 'req-3baff7b0-685c-4245-a56b-227d42fb00ae'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:26.081939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3baff7b0-685c-4245-a56b-227d42fb00ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5584dd2b6ead4692ad9e756344ff4be5', 'request_id': 'req-3baff7b0-685c-4245-a56b-227d42fb00ae'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:26.092729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3baff7b0-685c-4245-a56b-227d42fb00ae admin admin] The token cache is being invalidate because project 5584dd2b6ead4692ad9e756344ff4be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:07:26.093012 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3baff7b0-685c-4245-a56b-227d42fb00ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:26.093643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3baff7b0-685c-4245-a56b-227d42fb00ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:26.095264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1059/2110] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:07:25 2022] DELETE /identity/v3/projects/5584dd2b6ead4692ad9e756344ff4be5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:26.100282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2195bcd-c24f-4591-92bc-1b829f535a19 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:26.100572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2195bcd-c24f-4591-92bc-1b829f535a19 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:26.100847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2195bcd-c24f-4591-92bc-1b829f535a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:26.132588 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d2195bcd-c24f-4591-92bc-1b829f535a19 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:26.134159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d2195bcd-c24f-4591-92bc-1b829f535a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:26.205112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1052/2111] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:07:26.215072 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694928ad-a1f5-40c6-8890-efabe1fc7f2e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:26.215373 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694928ad-a1f5-40c6-8890-efabe1fc7f2e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:26.215786 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694928ad-a1f5-40c6-8890-efabe1fc7f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:26.242202 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-694928ad-a1f5-40c6-8890-efabe1fc7f2e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:26.243563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-694928ad-a1f5-40c6-8890-efabe1fc7f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:26.253879 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1060/2112] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:26.258254 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2195bcd-c24f-4591-92bc-1b829f535a19 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:26.272371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2195bcd-c24f-4591-92bc-1b829f535a19 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:26.279084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83eaaa-2254-422a-ba30-ca1c254e1092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:26.279765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83eaaa-2254-422a-ba30-ca1c254e1092 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:26.280055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83eaaa-2254-422a-ba30-ca1c254e1092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:26.280417 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83eaaa-2254-422a-ba30-ca1c254e1092 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:26.281167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83eaaa-2254-422a-ba30-ca1c254e1092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:07:26.281479 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83eaaa-2254-422a-ba30-ca1c254e1092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:26.283245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83eaaa-2254-422a-ba30-ca1c254e1092 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:26.299030 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1053/2113] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:07:26.301920 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694928ad-a1f5-40c6-8890-efabe1fc7f2e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:26.314921 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694928ad-a1f5-40c6-8890-efabe1fc7f2e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:26.321472 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b524a-f090-45fa-b1c7-8fb6ac149672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:26.322298 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b524a-f090-45fa-b1c7-8fb6ac149672 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:26.323299 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b524a-f090-45fa-b1c7-8fb6ac149672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:26.324415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b524a-f090-45fa-b1c7-8fb6ac149672 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:26.324743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b524a-f090-45fa-b1c7-8fb6ac149672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:26.327639 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b524a-f090-45fa-b1c7-8fb6ac149672 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:26.370076 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1061/2114] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:07:26 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:26.371599 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83eaaa-2254-422a-ba30-ca1c254e1092 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:26.382562 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83eaaa-2254-422a-ba30-ca1c254e1092 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:26.446858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527b3cc-75f9-4ea2-a393-06f8dc35d184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:26.450040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527b3cc-75f9-4ea2-a393-06f8dc35d184 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:26.450040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527b3cc-75f9-4ea2-a393-06f8dc35d184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:26.450040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527b3cc-75f9-4ea2-a393-06f8dc35d184 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:26.450040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527b3cc-75f9-4ea2-a393-06f8dc35d184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:26.451429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527b3cc-75f9-4ea2-a393-06f8dc35d184 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:26.459085 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:26.476287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1054/2115] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:07:26 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:26.480176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b524a-f090-45fa-b1c7-8fb6ac149672 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:26.492242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b524a-f090-45fa-b1c7-8fb6ac149672 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:26.498225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a782503-3af1-46da-8ba2-44e3576c091e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:26.499330 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a782503-3af1-46da-8ba2-44e3576c091e admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:26.499330 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a782503-3af1-46da-8ba2-44e3576c091e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:26.499533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a782503-3af1-46da-8ba2-44e3576c091e admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:26.500282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a782503-3af1-46da-8ba2-44e3576c091e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:26.501915 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a782503-3af1-46da-8ba2-44e3576c091e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:26.513702 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1062/2116] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:07:26.518079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527b3cc-75f9-4ea2-a393-06f8dc35d184 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:26.529706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527b3cc-75f9-4ea2-a393-06f8dc35d184 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:26.536538 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cd7ad-86c0-43f2-88f9-f2cfa390d2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:26.537408 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cd7ad-86c0-43f2-88f9-f2cfa390d2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:26.537725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cd7ad-86c0-43f2-88f9-f2cfa390d2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:26.539973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cd7ad-86c0-43f2-88f9-f2cfa390d2d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:26.540663 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cd7ad-86c0-43f2-88f9-f2cfa390d2d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:26.543164 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cd7ad-86c0-43f2-88f9-f2cfa390d2d7 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:26.560272 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1055/2117] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:07:26.562629 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a782503-3af1-46da-8ba2-44e3576c091e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:26.580693 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a782503-3af1-46da-8ba2-44e3576c091e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:26.586326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72476f9-2481-4619-9e4c-df55a4c7edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:26.587567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72476f9-2481-4619-9e4c-df55a4c7edb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:26.588738 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72476f9-2481-4619-9e4c-df55a4c7edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:26.589512 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72476f9-2481-4619-9e4c-df55a4c7edb0 admin admin] PATH_INFO: `/v3/projects/b18dcb61ba13496faa96461218972138/users/2a3b0665dfdd47ba9d0bb28ca2dc22c2/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:26.608173 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:26.612022 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72476f9-2481-4619-9e4c-df55a4c7edb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b18dcb61ba13496faa96461218972138, user_id=2a3b0665dfdd47ba9d0bb28ca2dc22c2, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:26.614928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72476f9-2481-4619-9e4c-df55a4c7edb0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:26.646070 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1063/2118] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:26 2022] PUT /identity/v3/projects/b18dcb61ba13496faa96461218972138/users/2a3b0665dfdd47ba9d0bb28ca2dc22c2/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:26.667946 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab6a11-7410-45eb-9de7-b78c218bb806 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:26.668500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab6a11-7410-45eb-9de7-b78c218bb806 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:26.668500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab6a11-7410-45eb-9de7-b78c218bb806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:26.720053 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f3ab6a11-7410-45eb-9de7-b78c218bb806 None None] MFA Rules not processed for user `2a3b0665dfdd47ba9d0bb28ca2dc22c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:26.720053 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f3ab6a11-7410-45eb-9de7-b78c218bb806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:26.789967 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1056/2119] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:26.802666 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72476f9-2481-4619-9e4c-df55a4c7edb0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:26.804502 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f72476f9-2481-4619-9e4c-df55a4c7edb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:26.866125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72476f9-2481-4619-9e4c-df55a4c7edb0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:26.870665 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d153b-1611-496f-a92a-192b6cb25dad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d69d99d980744fba12a6b38586e7bf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:26.872243 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d153b-1611-496f-a92a-192b6cb25dad service glance] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:26.872243 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d153b-1611-496f-a92a-192b6cb25dad service glance] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:26.872243 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d153b-1611-496f-a92a-192b6cb25dad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:26.882118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d153b-1611-496f-a92a-192b6cb25dad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:26.884067 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d153b-1611-496f-a92a-192b6cb25dad service glance] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:26.895905 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1064/2120] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:29.306235 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab6a11-7410-45eb-9de7-b78c218bb806 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:29.308219 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f3ab6a11-7410-45eb-9de7-b78c218bb806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:29.376853 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab6a11-7410-45eb-9de7-b78c218bb806 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:29.381559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfbf0e-ba52-4856-b5bd-f5fb703cb673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:29.382458 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfbf0e-ba52-4856-b5bd-f5fb703cb673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:29.382747 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfbf0e-ba52-4856-b5bd-f5fb703cb673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:29.383026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfbf0e-ba52-4856-b5bd-f5fb703cb673 admin admin] PATH_INFO: `/v3/users/d9b7d903200744c589f9f37d9aca29d9` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:29.384225 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfbf0e-ba52-4856-b5bd-f5fb703cb673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9b7d903200744c589f9f37d9aca29d9)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:29.386659 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfbf0e-ba52-4856-b5bd-f5fb703cb673 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:29.434970 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e3bfbf0e-ba52-4856-b5bd-f5fb703cb673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9b7d903200744c589f9f37d9aca29d9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:29.442528 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e3bfbf0e-ba52-4856-b5bd-f5fb703cb673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9b7d903200744c589f9f37d9aca29d9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:29.452537 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:29.454862 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e3bfbf0e-ba52-4856-b5bd-f5fb703cb673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9b7d903200744c589f9f37d9aca29d9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:29.456446 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e3bfbf0e-ba52-4856-b5bd-f5fb703cb673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9b7d903200744c589f9f37d9aca29d9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:29.457124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e3bfbf0e-ba52-4856-b5bd-f5fb703cb673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9b7d903200744c589f9f37d9aca29d9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:29.472004 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1057/2121] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:07:29 2022] DELETE /identity/v3/users/d9b7d903200744c589f9f37d9aca29d9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:29.476615 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c8e64-b864-4613-a739-d13d177fdee3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:29.477212 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c8e64-b864-4613-a739-d13d177fdee3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:29.477212 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c8e64-b864-4613-a739-d13d177fdee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:29.496614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-aa2c8e64-b864-4613-a739-d13d177fdee3 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:29.497891 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-aa2c8e64-b864-4613-a739-d13d177fdee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:29.565867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1065/2122] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:29.575540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfbf0e-ba52-4856-b5bd-f5fb703cb673 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:29.577157 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e3bfbf0e-ba52-4856-b5bd-f5fb703cb673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:29.639096 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfbf0e-ba52-4856-b5bd-f5fb703cb673 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:29.642954 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e722df0-d24f-426f-9c43-46fec3ebba44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:29.643605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e722df0-d24f-426f-9c43-46fec3ebba44 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:29.643892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e722df0-d24f-426f-9c43-46fec3ebba44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:29.644174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e722df0-d24f-426f-9c43-46fec3ebba44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:29.656270 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e722df0-d24f-426f-9c43-46fec3ebba44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:29.657975 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e722df0-d24f-426f-9c43-46fec3ebba44 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:29.670695 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1058/2123] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:30.046847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c8e64-b864-4613-a739-d13d177fdee3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:30.048682 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-aa2c8e64-b864-4613-a739-d13d177fdee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:30.064127 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c8e64-b864-4613-a739-d13d177fdee3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:30.072798 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a69ee6-95c2-4989-a88d-9925ae915570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:30.072798 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a69ee6-95c2-4989-a88d-9925ae915570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:30.073926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a69ee6-95c2-4989-a88d-9925ae915570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:30.074449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a69ee6-95c2-4989-a88d-9925ae915570 admin admin] PATH_INFO: `/v3/projects/27c040cca4354317a6bbffc2a716f586` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:30.076780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a69ee6-95c2-4989-a88d-9925ae915570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27c040cca4354317a6bbffc2a716f586)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:30.078614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a69ee6-95c2-4989-a88d-9925ae915570 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:30.161320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-69a69ee6-95c2-4989-a88d-9925ae915570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27c040cca4354317a6bbffc2a716f586', 'request_id': 'req-69a69ee6-95c2-4989-a88d-9925ae915570'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:30.175720 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-69a69ee6-95c2-4989-a88d-9925ae915570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27c040cca4354317a6bbffc2a716f586', 'request_id': 'req-69a69ee6-95c2-4989-a88d-9925ae915570'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:30.187394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-69a69ee6-95c2-4989-a88d-9925ae915570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27c040cca4354317a6bbffc2a716f586', 'request_id': 'req-69a69ee6-95c2-4989-a88d-9925ae915570'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:30.215085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-69a69ee6-95c2-4989-a88d-9925ae915570 admin admin] The token cache is being invalidate because project 27c040cca4354317a6bbffc2a716f586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:07:30.215463 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-69a69ee6-95c2-4989-a88d-9925ae915570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:30.216249 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-69a69ee6-95c2-4989-a88d-9925ae915570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:30.218024 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1066/2124] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:07:30 2022] DELETE /identity/v3/projects/27c040cca4354317a6bbffc2a716f586 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:30.224362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e722df0-d24f-426f-9c43-46fec3ebba44 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:30.243783 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e722df0-d24f-426f-9c43-46fec3ebba44 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:30.324107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cd92b-d171-4ad1-bdcc-38d662c0dd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:30.325007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cd92b-d171-4ad1-bdcc-38d662c0dd8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:30.325365 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cd92b-d171-4ad1-bdcc-38d662c0dd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:30.325896 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cd92b-d171-4ad1-bdcc-38d662c0dd8d admin admin] PATH_INFO: `/v3/users/13b405ae5958475babf8e8d2e094cad9` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:30.327460 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cd92b-d171-4ad1-bdcc-38d662c0dd8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b405ae5958475babf8e8d2e094cad9)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:30.329517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cd92b-d171-4ad1-bdcc-38d662c0dd8d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:30.390989 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bc7cd92b-d171-4ad1-bdcc-38d662c0dd8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b405ae5958475babf8e8d2e094cad9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:30.400509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bc7cd92b-d171-4ad1-bdcc-38d662c0dd8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b405ae5958475babf8e8d2e094cad9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:30.413164 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bc7cd92b-d171-4ad1-bdcc-38d662c0dd8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b405ae5958475babf8e8d2e094cad9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:30.413915 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bc7cd92b-d171-4ad1-bdcc-38d662c0dd8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b405ae5958475babf8e8d2e094cad9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:30.414508 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bc7cd92b-d171-4ad1-bdcc-38d662c0dd8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b405ae5958475babf8e8d2e094cad9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:30.431818 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1059/2125] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:07:30 2022] DELETE /identity/v3/users/13b405ae5958475babf8e8d2e094cad9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:30.834858 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a69ee6-95c2-4989-a88d-9925ae915570 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:30.837082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-69a69ee6-95c2-4989-a88d-9925ae915570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:30.867490 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a69ee6-95c2-4989-a88d-9925ae915570 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:30.883982 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:30.939840 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1d5cb-3a53-46df-b870-ecb5834e1113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:30.940624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1d5cb-3a53-46df-b870-ecb5834e1113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:30.940908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1d5cb-3a53-46df-b870-ecb5834e1113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:30.941184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1d5cb-3a53-46df-b870-ecb5834e1113 admin admin] PATH_INFO: `/v3/projects/669317825eec471cbc063261c7105a70` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:30.942618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1d5cb-3a53-46df-b870-ecb5834e1113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=669317825eec471cbc063261c7105a70)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:30.944617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1d5cb-3a53-46df-b870-ecb5834e1113 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:31.003131 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6eb1d5cb-3a53-46df-b870-ecb5834e1113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '669317825eec471cbc063261c7105a70', 'request_id': 'req-6eb1d5cb-3a53-46df-b870-ecb5834e1113'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:31.013843 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6eb1d5cb-3a53-46df-b870-ecb5834e1113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '669317825eec471cbc063261c7105a70', 'request_id': 'req-6eb1d5cb-3a53-46df-b870-ecb5834e1113'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:31.024087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6eb1d5cb-3a53-46df-b870-ecb5834e1113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '669317825eec471cbc063261c7105a70', 'request_id': 'req-6eb1d5cb-3a53-46df-b870-ecb5834e1113'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:31.035874 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6eb1d5cb-3a53-46df-b870-ecb5834e1113 admin admin] The token cache is being invalidate because project 669317825eec471cbc063261c7105a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:07:31.036264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6eb1d5cb-3a53-46df-b870-ecb5834e1113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:31.036929 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6eb1d5cb-3a53-46df-b870-ecb5834e1113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:31.038524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1067/2126] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:07:30 2022] DELETE /identity/v3/projects/669317825eec471cbc063261c7105a70 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:31.045788 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe11755-d783-43bf-a315-7d6f050a8c42 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:31.046159 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe11755-d783-43bf-a315-7d6f050a8c42 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:31.046612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe11755-d783-43bf-a315-7d6f050a8c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:31.083268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-afe11755-d783-43bf-a315-7d6f050a8c42 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:31.084497 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-afe11755-d783-43bf-a315-7d6f050a8c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:31.093314 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:31.165473 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1060/2127] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:31.175885 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c53141-f590-490f-b132-714696245276 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:31.175885 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c53141-f590-490f-b132-714696245276 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:31.175885 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c53141-f590-490f-b132-714696245276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:31.195012 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-56c53141-f590-490f-b132-714696245276 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:31.196219 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-56c53141-f590-490f-b132-714696245276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:31.205830 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1068/2128] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:31.211310 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe11755-d783-43bf-a315-7d6f050a8c42 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:31.228073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe11755-d783-43bf-a315-7d6f050a8c42 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:31.233877 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dffe9-4252-44ad-b4de-7106c36852a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:31.234551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dffe9-4252-44ad-b4de-7106c36852a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:31.234832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dffe9-4252-44ad-b4de-7106c36852a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:31.235109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dffe9-4252-44ad-b4de-7106c36852a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:31.235857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dffe9-4252-44ad-b4de-7106c36852a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:07:31.236228 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dffe9-4252-44ad-b4de-7106c36852a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:31.237884 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dffe9-4252-44ad-b4de-7106c36852a7 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:31.256069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1061/2129] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:07:31.257450 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c53141-f590-490f-b132-714696245276 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:31.268087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c53141-f590-490f-b132-714696245276 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:31.272818 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb50efa-1b1f-4245-863e-f61c37c5b1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:31.273434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb50efa-1b1f-4245-863e-f61c37c5b1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:31.273829 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb50efa-1b1f-4245-863e-f61c37c5b1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:31.274130 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb50efa-1b1f-4245-863e-f61c37c5b1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:31.274927 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb50efa-1b1f-4245-863e-f61c37c5b1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:31.277011 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb50efa-1b1f-4245-863e-f61c37c5b1a8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:31.309731 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1069/2130] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:07:31 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:31.312645 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dffe9-4252-44ad-b4de-7106c36852a7 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:31.324382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dffe9-4252-44ad-b4de-7106c36852a7 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:31.404696 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90840069-22c0-4bf4-84f7-9cd1fde02e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:31.405393 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90840069-22c0-4bf4-84f7-9cd1fde02e70 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:31.405781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90840069-22c0-4bf4-84f7-9cd1fde02e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:31.406066 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90840069-22c0-4bf4-84f7-9cd1fde02e70 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:31.406767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90840069-22c0-4bf4-84f7-9cd1fde02e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:31.408864 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90840069-22c0-4bf4-84f7-9cd1fde02e70 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:31.435822 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1062/2131] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:07:31 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:31.440780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb50efa-1b1f-4245-863e-f61c37c5b1a8 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:31.458473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb50efa-1b1f-4245-863e-f61c37c5b1a8 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:31.465507 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f679902-1e9b-4cde-ba0a-ba00bacf46df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:31.466168 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f679902-1e9b-4cde-ba0a-ba00bacf46df admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:31.466458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f679902-1e9b-4cde-ba0a-ba00bacf46df admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:31.466787 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f679902-1e9b-4cde-ba0a-ba00bacf46df admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:31.467517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f679902-1e9b-4cde-ba0a-ba00bacf46df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:31.469228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f679902-1e9b-4cde-ba0a-ba00bacf46df admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:31.483100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1070/2132] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:31.487558 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90840069-22c0-4bf4-84f7-9cd1fde02e70 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:31.504877 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90840069-22c0-4bf4-84f7-9cd1fde02e70 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:31.520593 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4317c4-08bd-4595-aa48-1e8dfee2408f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:31.521284 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4317c4-08bd-4595-aa48-1e8dfee2408f admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:31.521571 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4317c4-08bd-4595-aa48-1e8dfee2408f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:31.521889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4317c4-08bd-4595-aa48-1e8dfee2408f admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:31.522634 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4317c4-08bd-4595-aa48-1e8dfee2408f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:31.524448 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4317c4-08bd-4595-aa48-1e8dfee2408f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:31.540644 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1063/2133] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:31.545456 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f679902-1e9b-4cde-ba0a-ba00bacf46df admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:31.558629 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f679902-1e9b-4cde-ba0a-ba00bacf46df admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:31.565010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabcbd2-45fe-43d0-bc8b-4f7004b6c2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:31.565970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabcbd2-45fe-43d0-bc8b-4f7004b6c2b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:31.566255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabcbd2-45fe-43d0-bc8b-4f7004b6c2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:31.566563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabcbd2-45fe-43d0-bc8b-4f7004b6c2b4 admin admin] PATH_INFO: `/v3/projects/10568aeb4aba423585e0668a4a5e05d9/users/edf6a4f02eb34720b0126d17db1c1b86/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:31.583395 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabcbd2-45fe-43d0-bc8b-4f7004b6c2b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10568aeb4aba423585e0668a4a5e05d9, user_id=edf6a4f02eb34720b0126d17db1c1b86, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:31.587589 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabcbd2-45fe-43d0-bc8b-4f7004b6c2b4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:31.603942 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1071/2134] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:31 2022] PUT /identity/v3/projects/10568aeb4aba423585e0668a4a5e05d9/users/edf6a4f02eb34720b0126d17db1c1b86/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:07:31.609577 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd0e07-8138-4b83-855a-c52d4910efea None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:31.609915 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd0e07-8138-4b83-855a-c52d4910efea None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:31.610202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd0e07-8138-4b83-855a-c52d4910efea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:31.628859 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-10dd0e07-8138-4b83-855a-c52d4910efea None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:31.630129 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-10dd0e07-8138-4b83-855a-c52d4910efea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:31.691742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1064/2135] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:31.701786 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabcbd2-45fe-43d0-bc8b-4f7004b6c2b4 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:31.703504 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ebabcbd2-45fe-43d0-bc8b-4f7004b6c2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:31.751912 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:31.765142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabcbd2-45fe-43d0-bc8b-4f7004b6c2b4 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:31.769460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0629c-753f-481d-bec1-ec6c9804e5df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:31.770149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0629c-753f-481d-bec1-ec6c9804e5df service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:31.770436 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0629c-753f-481d-bec1-ec6c9804e5df service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:31.770715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0629c-753f-481d-bec1-ec6c9804e5df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:31.782219 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0629c-753f-481d-bec1-ec6c9804e5df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:31.783663 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0629c-753f-481d-bec1-ec6c9804e5df service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:31.793716 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1072/2136] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:32.754400 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e056b2-dd82-4900-8090-f1fad3e6e9a0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:32.754996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e056b2-dd82-4900-8090-f1fad3e6e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:32.754996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e056b2-dd82-4900-8090-f1fad3e6e9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:32.793174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:32.799503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-44e056b2-dd82-4900-8090-f1fad3e6e9a0 None None] MFA Rules not processed for user `9692d55c8c924544a1bff62054731ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:32.800754 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-44e056b2-dd82-4900-8090-f1fad3e6e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:32.872516 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1065/2137] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 18 17:07:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:32.934970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0629c-753f-481d-bec1-ec6c9804e5df service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:32.937002 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-95a0629c-753f-481d-bec1-ec6c9804e5df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:33.055492 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0629c-753f-481d-bec1-ec6c9804e5df service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:33.061940 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ff933-2bcc-4362-bb68-3951594e869f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b712c7f5fce54fe2a89d63863f3845f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:33.062710 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ff933-2bcc-4362-bb68-3951594e869f service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:33.062998 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ff933-2bcc-4362-bb68-3951594e869f service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:33.063444 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ff933-2bcc-4362-bb68-3951594e869f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:33.074603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ff933-2bcc-4362-bb68-3951594e869f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:33.076345 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ff933-2bcc-4362-bb68-3951594e869f service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:33.115534 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1073/2138] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 18 17:07:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 17:07:33.814558 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e056b2-dd82-4900-8090-f1fad3e6e9a0 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:33.817140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-44e056b2-dd82-4900-8090-f1fad3e6e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:33.843746 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e056b2-dd82-4900-8090-f1fad3e6e9a0 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:33.849724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27994acd-8815-4561-8911-32c2052767ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:33.850969 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27994acd-8815-4561-8911-32c2052767ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:33.851420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27994acd-8815-4561-8911-32c2052767ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:33.852185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27994acd-8815-4561-8911-32c2052767ee admin admin] PATH_INFO: `/v3/users/69ca0baaf3854917bf6fc02883b0b949` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:33.854472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27994acd-8815-4561-8911-32c2052767ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ca0baaf3854917bf6fc02883b0b949)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:33.857242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27994acd-8815-4561-8911-32c2052767ee admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:33.982061 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-27994acd-8815-4561-8911-32c2052767ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ca0baaf3854917bf6fc02883b0b949'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:33.993995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-27994acd-8815-4561-8911-32c2052767ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ca0baaf3854917bf6fc02883b0b949'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:34.023147 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-27994acd-8815-4561-8911-32c2052767ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ca0baaf3854917bf6fc02883b0b949'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:34.024207 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-27994acd-8815-4561-8911-32c2052767ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ca0baaf3854917bf6fc02883b0b949'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:34.025130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-27994acd-8815-4561-8911-32c2052767ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ca0baaf3854917bf6fc02883b0b949'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:34.068970 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1066/2139] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:07:33 2022] DELETE /identity/v3/users/69ca0baaf3854917bf6fc02883b0b949 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:34.117555 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523b072-465f-4023-bc1b-7094c834fcda None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:34.118611 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523b072-465f-4023-bc1b-7094c834fcda None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:34.119080 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523b072-465f-4023-bc1b-7094c834fcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:34.146642 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c523b072-465f-4023-bc1b-7094c834fcda None None] MFA Rules not processed for user `9692d55c8c924544a1bff62054731ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:34.148018 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c523b072-465f-4023-bc1b-7094c834fcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:34.229769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1074/2140] 10.222.0.49 () {58 vars in 967 bytes} [Wed May 18 17:07:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:34.244308 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27994acd-8815-4561-8911-32c2052767ee admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:34.247571 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-27994acd-8815-4561-8911-32c2052767ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:34.342545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523b072-465f-4023-bc1b-7094c834fcda None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:34.344066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c523b072-465f-4023-bc1b-7094c834fcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:34.386003 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27994acd-8815-4561-8911-32c2052767ee admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:34.392631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7e2cb-f849-4814-914d-da7251d4b124 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b712c7f5fce54fe2a89d63863f3845f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:34.393680 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7e2cb-f849-4814-914d-da7251d4b124 service swift] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:34.394186 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7e2cb-f849-4814-914d-da7251d4b124 service swift] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:34.394644 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7e2cb-f849-4814-914d-da7251d4b124 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:34.405492 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7e2cb-f849-4814-914d-da7251d4b124 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:34.414820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7e2cb-f849-4814-914d-da7251d4b124 service swift] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:34.436448 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1067/2141] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 18 17:07:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 17:07:34.469114 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523b072-465f-4023-bc1b-7094c834fcda None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:34.474410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78deb6-110d-49d1-b1dc-b8b8c4550d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:34.475553 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78deb6-110d-49d1-b1dc-b8b8c4550d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:34.476030 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78deb6-110d-49d1-b1dc-b8b8c4550d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:34.476305 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78deb6-110d-49d1-b1dc-b8b8c4550d84 admin admin] PATH_INFO: `/v3/projects/0f0e2176993f4c61bd976aa95fe55346` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:34.478099 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78deb6-110d-49d1-b1dc-b8b8c4550d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f0e2176993f4c61bd976aa95fe55346)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:34.480963 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78deb6-110d-49d1-b1dc-b8b8c4550d84 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:34.508845 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:34.566748 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ee78deb6-110d-49d1-b1dc-b8b8c4550d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f0e2176993f4c61bd976aa95fe55346', 'request_id': 'req-ee78deb6-110d-49d1-b1dc-b8b8c4550d84'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:34.576921 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ee78deb6-110d-49d1-b1dc-b8b8c4550d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f0e2176993f4c61bd976aa95fe55346', 'request_id': 'req-ee78deb6-110d-49d1-b1dc-b8b8c4550d84'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:34.585527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ee78deb6-110d-49d1-b1dc-b8b8c4550d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f0e2176993f4c61bd976aa95fe55346', 'request_id': 'req-ee78deb6-110d-49d1-b1dc-b8b8c4550d84'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:34.606709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ee78deb6-110d-49d1-b1dc-b8b8c4550d84 admin admin] The token cache is being invalidate because project 0f0e2176993f4c61bd976aa95fe55346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:07:34.607001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ee78deb6-110d-49d1-b1dc-b8b8c4550d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:34.607679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ee78deb6-110d-49d1-b1dc-b8b8c4550d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:34.609559 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1075/2142] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:07:34 2022] DELETE /identity/v3/projects/0f0e2176993f4c61bd976aa95fe55346 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:07:34.616536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2db7e-6109-4d29-bcbe-d553f04a162d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:34.617145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2db7e-6109-4d29-bcbe-d553f04a162d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:34.617524 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2db7e-6109-4d29-bcbe-d553f04a162d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:34.650408 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-0ac2db7e-6109-4d29-bcbe-d553f04a162d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:34.652636 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0ac2db7e-6109-4d29-bcbe-d553f04a162d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:34.671151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:34.797488 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1068/2143] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:34.799432 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b3a1b-4778-4e5c-80d3-1d76835aa14c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:34.799731 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b3a1b-4778-4e5c-80d3-1d76835aa14c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:34.800043 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b3a1b-4778-4e5c-80d3-1d76835aa14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:34.801485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821b299-ff4a-42d9-8722-e4160e93724a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:34.804419 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821b299-ff4a-42d9-8722-e4160e93724a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:34.804419 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821b299-ff4a-42d9-8722-e4160e93724a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:34.824751 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b17b3a1b-4778-4e5c-80d3-1d76835aa14c None None] MFA Rules not processed for user `9692d55c8c924544a1bff62054731ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:34.826604 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b17b3a1b-4778-4e5c-80d3-1d76835aa14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:34.859498 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b821b299-ff4a-42d9-8722-e4160e93724a None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:34.862051 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b821b299-ff4a-42d9-8722-e4160e93724a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:34.891197 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1069/2144] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:34.892640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821b299-ff4a-42d9-8722-e4160e93724a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:34.907339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821b299-ff4a-42d9-8722-e4160e93724a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:34.921712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece3acd-d22c-48fb-baf7-4c8749b9ba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:34.922521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece3acd-d22c-48fb-baf7-4c8749b9ba09 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:34.922735 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece3acd-d22c-48fb-baf7-4c8749b9ba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:34.923017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece3acd-d22c-48fb-baf7-4c8749b9ba09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:34.924508 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece3acd-d22c-48fb-baf7-4c8749b9ba09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:07:34.924781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece3acd-d22c-48fb-baf7-4c8749b9ba09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:34.926443 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece3acd-d22c-48fb-baf7-4c8749b9ba09 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:34.944778 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1076/2145] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 18 17:07:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:34.957439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1070/2146] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 17:07:34.958744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b3a1b-4778-4e5c-80d3-1d76835aa14c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:34.978477 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece3acd-d22c-48fb-baf7-4c8749b9ba09 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:34.984121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b3a1b-4778-4e5c-80d3-1d76835aa14c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:34.987764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0ece3acd-d22c-48fb-baf7-4c8749b9ba09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:35.006689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d712bea-be13-4d89-a511-7f7ad4a28c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:35.006971 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d712bea-be13-4d89-a511-7f7ad4a28c60 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:35.007193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d712bea-be13-4d89-a511-7f7ad4a28c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:35.007523 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d712bea-be13-4d89-a511-7f7ad4a28c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:35.008300 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d712bea-be13-4d89-a511-7f7ad4a28c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:35.013940 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d712bea-be13-4d89-a511-7f7ad4a28c60 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:35.048512 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1077/2147] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:07:34 2022] POST /identity/v3/projects => generated 389 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:35.052315 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d712bea-be13-4d89-a511-7f7ad4a28c60 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:35.149056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece3acd-d22c-48fb-baf7-4c8749b9ba09 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:35.167783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d712bea-be13-4d89-a511-7f7ad4a28c60 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:35.174544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e99cff-a584-40a2-95e6-5ac52621ec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:35.175503 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e99cff-a584-40a2-95e6-5ac52621ec9a admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:35.175937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e99cff-a584-40a2-95e6-5ac52621ec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:35.176409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e99cff-a584-40a2-95e6-5ac52621ec9a admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:35.177265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e99cff-a584-40a2-95e6-5ac52621ec9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:35.180645 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e99cff-a584-40a2-95e6-5ac52621ec9a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:35.210356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1078/2148] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:07:35 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:07:35.211627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e99cff-a584-40a2-95e6-5ac52621ec9a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:35.225924 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e99cff-a584-40a2-95e6-5ac52621ec9a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:35.232766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e38f2-e76b-4b61-ac64-11a8c081c35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:35.233954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e38f2-e76b-4b61-ac64-11a8c081c35c admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:35.234527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e38f2-e76b-4b61-ac64-11a8c081c35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:35.235006 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e38f2-e76b-4b61-ac64-11a8c081c35c admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:35.236124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e38f2-e76b-4b61-ac64-11a8c081c35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:35.239000 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e38f2-e76b-4b61-ac64-11a8c081c35c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:35.255390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1079/2149] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:35.261530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e38f2-e76b-4b61-ac64-11a8c081c35c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:35.272539 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e38f2-e76b-4b61-ac64-11a8c081c35c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:35.285427 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0f9c0-1968-4150-9af0-6ee28742a993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:35.286104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb4241-e438-4bf9-b9c0-934545669bda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b712c7f5fce54fe2a89d63863f3845f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:35.286385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0f9c0-1968-4150-9af0-6ee28742a993 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:35.286768 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb4241-e438-4bf9-b9c0-934545669bda service swift] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:35.286974 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0f9c0-1968-4150-9af0-6ee28742a993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:35.287135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb4241-e438-4bf9-b9c0-934545669bda service swift] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:35.287322 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0f9c0-1968-4150-9af0-6ee28742a993 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:35.287444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb4241-e438-4bf9-b9c0-934545669bda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:35.288238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0f9c0-1968-4150-9af0-6ee28742a993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:35.293989 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0f9c0-1968-4150-9af0-6ee28742a993 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:35.295985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:35.313952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1080/2150] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:35.315387 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0f9c0-1968-4150-9af0-6ee28742a993 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:35.332289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0f9c0-1968-4150-9af0-6ee28742a993 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:35.343600 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83651219-8fd0-4ef1-8756-9ee24a55e77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:35.344817 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83651219-8fd0-4ef1-8756-9ee24a55e77e admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:35.345201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83651219-8fd0-4ef1-8756-9ee24a55e77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:35.345604 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83651219-8fd0-4ef1-8756-9ee24a55e77e admin admin] PATH_INFO: `/v3/projects/6fe001ad764a40839c0a87e48dedb14f/users/13b9ab17cee74e8282cd86a37eaf19aa/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:35.390059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:35.390547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83651219-8fd0-4ef1-8756-9ee24a55e77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe001ad764a40839c0a87e48dedb14f, user_id=13b9ab17cee74e8282cd86a37eaf19aa, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:35.395127 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83651219-8fd0-4ef1-8756-9ee24a55e77e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:35.423828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1081/2151] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:35 2022] PUT /identity/v3/projects/6fe001ad764a40839c0a87e48dedb14f/users/13b9ab17cee74e8282cd86a37eaf19aa/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:35.428002 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf870d-9100-414b-b9f6-250c3ae6d28e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:35.428292 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf870d-9100-414b-b9f6-250c3ae6d28e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:35.428573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf870d-9100-414b-b9f6-250c3ae6d28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:35.441149 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb4241-e438-4bf9-b9c0-934545669bda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:35.442401 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb4241-e438-4bf9-b9c0-934545669bda service swift] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:35.468593 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-78bf870d-9100-414b-b9f6-250c3ae6d28e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:35.477502 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-78bf870d-9100-414b-b9f6-250c3ae6d28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:35.480744 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1071/2152] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 18 17:07:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 17:07:35.562177 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1082/2153] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:35.574355 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb4241-e438-4bf9-b9c0-934545669bda service swift] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:35.575819 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5abb4241-e438-4bf9-b9c0-934545669bda service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:35.693697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb4241-e438-4bf9-b9c0-934545669bda service swift] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:35.803137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56048789-b055-4b99-b5ae-36b7ea7cd253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:35.803964 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56048789-b055-4b99-b5ae-36b7ea7cd253 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:35.804419 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56048789-b055-4b99-b5ae-36b7ea7cd253 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:35.804804 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56048789-b055-4b99-b5ae-36b7ea7cd253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:35.828379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56048789-b055-4b99-b5ae-36b7ea7cd253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:35.830735 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56048789-b055-4b99-b5ae-36b7ea7cd253 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:35.843237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1072/2154] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:36.046978 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133d542-bf1a-43d9-85e9-51b82d79dbb1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:36.047298 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133d542-bf1a-43d9-85e9-51b82d79dbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:36.047604 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133d542-bf1a-43d9-85e9-51b82d79dbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:36.089746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4133d542-bf1a-43d9-85e9-51b82d79dbb1 None None] MFA Rules not processed for user `9692d55c8c924544a1bff62054731ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:36.093682 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4133d542-bf1a-43d9-85e9-51b82d79dbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:36.267261 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1083/2155] 10.222.0.49 () {58 vars in 967 bytes} [Wed May 18 17:07:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:36.276879 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56048789-b055-4b99-b5ae-36b7ea7cd253 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:36.454121 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56048789-b055-4b99-b5ae-36b7ea7cd253 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:36.469899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c4d71-8891-4d11-9739-9e0990e40cf2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b712c7f5fce54fe2a89d63863f3845f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:36.472181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c4d71-8891-4d11-9739-9e0990e40cf2 service swift] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:36.477647 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c4d71-8891-4d11-9739-9e0990e40cf2 service swift] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:36.480759 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c4d71-8891-4d11-9739-9e0990e40cf2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:36.504775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c4d71-8891-4d11-9739-9e0990e40cf2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:36.514191 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c4d71-8891-4d11-9739-9e0990e40cf2 service swift] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:36.545957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1073/2156] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 18 17:07:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 17:07:38.012979 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c148b-7763-4cbc-a8ae-34ad07c5c491 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:38.013529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c148b-7763-4cbc-a8ae-34ad07c5c491 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:38.013529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c148b-7763-4cbc-a8ae-34ad07c5c491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:38.092498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-be7c148b-7763-4cbc-a8ae-34ad07c5c491 None None] MFA Rules not processed for user `edf6a4f02eb34720b0126d17db1c1b86`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:38.094039 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-be7c148b-7763-4cbc-a8ae-34ad07c5c491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:38.278681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1084/2157] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:38.283013 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c4d71-8891-4d11-9739-9e0990e40cf2 service swift] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:38.285899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-132c4d71-8891-4d11-9739-9e0990e40cf2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:38.312729 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c4d71-8891-4d11-9739-9e0990e40cf2 service swift] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:38.318455 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a646ce-7d2a-4656-bb30-e3c5282ee168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:38.319357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a646ce-7d2a-4656-bb30-e3c5282ee168 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:38.319982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a646ce-7d2a-4656-bb30-e3c5282ee168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:38.320463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a646ce-7d2a-4656-bb30-e3c5282ee168 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:38.321334 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a646ce-7d2a-4656-bb30-e3c5282ee168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:38.323881 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a646ce-7d2a-4656-bb30-e3c5282ee168 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:38.360559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1074/2158] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:07:38 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:07:38.364407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c148b-7763-4cbc-a8ae-34ad07c5c491 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:38.382724 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c148b-7763-4cbc-a8ae-34ad07c5c491 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:38.392335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:38.513313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ef497-1c64-44e7-8d21-b1989cec1486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:38.514069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ef497-1c64-44e7-8d21-b1989cec1486 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:38.514351 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ef497-1c64-44e7-8d21-b1989cec1486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:38.514804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ef497-1c64-44e7-8d21-b1989cec1486 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:38.515512 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ef497-1c64-44e7-8d21-b1989cec1486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:38.517454 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ef497-1c64-44e7-8d21-b1989cec1486 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:38.548973 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1085/2159] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:07:38 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:38.553430 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a646ce-7d2a-4656-bb30-e3c5282ee168 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:38.566634 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:38.572543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a646ce-7d2a-4656-bb30-e3c5282ee168 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:38.580822 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b4050-2b67-48f4-a00a-5bafadd9fbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:38.581536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b4050-2b67-48f4-a00a-5bafadd9fbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:38.582881 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b4050-2b67-48f4-a00a-5bafadd9fbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:38.583166 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b4050-2b67-48f4-a00a-5bafadd9fbc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:38.583926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b4050-2b67-48f4-a00a-5bafadd9fbc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:38.586401 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b4050-2b67-48f4-a00a-5bafadd9fbc8 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:38.608706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1075/2160] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:38.610469 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ef497-1c64-44e7-8d21-b1989cec1486 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:38.625121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ef497-1c64-44e7-8d21-b1989cec1486 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:38.630930 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcd47b-2172-4a49-821b-d78d3a401c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:38.632001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcd47b-2172-4a49-821b-d78d3a401c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:38.632001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcd47b-2172-4a49-821b-d78d3a401c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:38.632383 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcd47b-2172-4a49-821b-d78d3a401c51 admin admin] PATH_INFO: `/v3/projects/e96a5638e2ff4acabb3b01d1938dd498/users/f1e1d900d4394e80a62feac59bde10c3/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:38.657998 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcd47b-2172-4a49-821b-d78d3a401c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e96a5638e2ff4acabb3b01d1938dd498, user_id=f1e1d900d4394e80a62feac59bde10c3, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:38.661963 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcd47b-2172-4a49-821b-d78d3a401c51 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:38.694150 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1086/2161] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:38 2022] PUT /identity/v3/projects/e96a5638e2ff4acabb3b01d1938dd498/users/f1e1d900d4394e80a62feac59bde10c3/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:38.696347 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b4050-2b67-48f4-a00a-5bafadd9fbc8 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:38.712680 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b4050-2b67-48f4-a00a-5bafadd9fbc8 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:38.849627 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e72202-af4f-4170-ad95-1974e2c6601e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:38.850591 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e72202-af4f-4170-ad95-1974e2c6601e admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:38.851053 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e72202-af4f-4170-ad95-1974e2c6601e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:38.853113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e72202-af4f-4170-ad95-1974e2c6601e admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:38.854289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e72202-af4f-4170-ad95-1974e2c6601e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:38.855953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e72202-af4f-4170-ad95-1974e2c6601e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:38.878988 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1076/2162] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:38.882237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcd47b-2172-4a49-821b-d78d3a401c51 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:38.900255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcd47b-2172-4a49-821b-d78d3a401c51 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:38.909798 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6eb99-277e-4e96-89f9-b6cc1685f094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:38.913473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6eb99-277e-4e96-89f9-b6cc1685f094 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:38.913473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6eb99-277e-4e96-89f9-b6cc1685f094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:38.913473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6eb99-277e-4e96-89f9-b6cc1685f094 admin admin] PATH_INFO: `/v3/projects/e96a5638e2ff4acabb3b01d1938dd498/users/f1e1d900d4394e80a62feac59bde10c3/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:38.913473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6eb99-277e-4e96-89f9-b6cc1685f094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e96a5638e2ff4acabb3b01d1938dd498, user_id=f1e1d900d4394e80a62feac59bde10c3, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:38.915980 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6eb99-277e-4e96-89f9-b6cc1685f094 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:38.939424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1087/2163] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:38 2022] PUT /identity/v3/projects/e96a5638e2ff4acabb3b01d1938dd498/users/f1e1d900d4394e80a62feac59bde10c3/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:39.348968 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e72202-af4f-4170-ad95-1974e2c6601e admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:39.351745 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-20e72202-af4f-4170-ad95-1974e2c6601e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:39.371746 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e72202-af4f-4170-ad95-1974e2c6601e admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:39.505349 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd8042-59d9-44ba-85be-c9b899716a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:39.506775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd8042-59d9-44ba-85be-c9b899716a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:39.507220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd8042-59d9-44ba-85be-c9b899716a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:39.507739 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd8042-59d9-44ba-85be-c9b899716a2d admin admin] PATH_INFO: `/v3/users/816046b774504e6fabbe136e42335b82` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:39.511581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd8042-59d9-44ba-85be-c9b899716a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=816046b774504e6fabbe136e42335b82)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:39.520425 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd8042-59d9-44ba-85be-c9b899716a2d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:39.634627 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-98fd8042-59d9-44ba-85be-c9b899716a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816046b774504e6fabbe136e42335b82'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:39.646783 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-98fd8042-59d9-44ba-85be-c9b899716a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816046b774504e6fabbe136e42335b82'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:39.679859 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-98fd8042-59d9-44ba-85be-c9b899716a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816046b774504e6fabbe136e42335b82'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:39.680624 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-98fd8042-59d9-44ba-85be-c9b899716a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816046b774504e6fabbe136e42335b82'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:39.681247 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-98fd8042-59d9-44ba-85be-c9b899716a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816046b774504e6fabbe136e42335b82'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:39.708248 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1077/2164] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:07:39 2022] DELETE /identity/v3/users/816046b774504e6fabbe136e42335b82 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:39.712766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfed9fa-810e-4580-bc3c-eab30a0d6492 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:39.714414 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfed9fa-810e-4580-bc3c-eab30a0d6492 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:39.714709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfed9fa-810e-4580-bc3c-eab30a0d6492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:39.733707 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3dfed9fa-810e-4580-bc3c-eab30a0d6492 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:39.734659 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3dfed9fa-810e-4580-bc3c-eab30a0d6492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:39.833364 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1088/2165] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:39.848875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd8042-59d9-44ba-85be-c9b899716a2d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:39.850757 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-98fd8042-59d9-44ba-85be-c9b899716a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:39.874527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:39.938066 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd8042-59d9-44ba-85be-c9b899716a2d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:39.944940 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba495d-fde7-49c4-a8c0-dc3afa851ad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:39.945614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba495d-fde7-49c4-a8c0-dc3afa851ad5 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:39.948001 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba495d-fde7-49c4-a8c0-dc3afa851ad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:39.948282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba495d-fde7-49c4-a8c0-dc3afa851ad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:39.960227 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba495d-fde7-49c4-a8c0-dc3afa851ad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:39.962022 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba495d-fde7-49c4-a8c0-dc3afa851ad5 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:39.974970 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1078/2166] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:40.539595 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfed9fa-810e-4580-bc3c-eab30a0d6492 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:40.542871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3dfed9fa-810e-4580-bc3c-eab30a0d6492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:40.594292 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfed9fa-810e-4580-bc3c-eab30a0d6492 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:40.609831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad427559-921b-4163-b96b-f077c4dc722d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:40.611833 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad427559-921b-4163-b96b-f077c4dc722d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:40.612842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad427559-921b-4163-b96b-f077c4dc722d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:40.613171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad427559-921b-4163-b96b-f077c4dc722d admin admin] PATH_INFO: `/v3/projects/9720855c0c984b038348a02ce872b7ae` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:40.615371 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad427559-921b-4163-b96b-f077c4dc722d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9720855c0c984b038348a02ce872b7ae)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:40.618694 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad427559-921b-4163-b96b-f077c4dc722d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:40.733121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ad427559-921b-4163-b96b-f077c4dc722d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9720855c0c984b038348a02ce872b7ae', 'request_id': 'req-ad427559-921b-4163-b96b-f077c4dc722d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:40.753033 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:40.764838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ad427559-921b-4163-b96b-f077c4dc722d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9720855c0c984b038348a02ce872b7ae', 'request_id': 'req-ad427559-921b-4163-b96b-f077c4dc722d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:40.804844 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ad427559-921b-4163-b96b-f077c4dc722d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9720855c0c984b038348a02ce872b7ae', 'request_id': 'req-ad427559-921b-4163-b96b-f077c4dc722d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:40.847807 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ad427559-921b-4163-b96b-f077c4dc722d admin admin] The token cache is being invalidate because project 9720855c0c984b038348a02ce872b7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:07:40.848404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ad427559-921b-4163-b96b-f077c4dc722d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:40.849306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ad427559-921b-4163-b96b-f077c4dc722d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:07:40.856046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1089/2167] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:07:40 2022] DELETE /identity/v3/projects/9720855c0c984b038348a02ce872b7ae => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:40.857584 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d6caf-616b-409d-92ea-a2ff3c11eb66 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:40.859290 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d6caf-616b-409d-92ea-a2ff3c11eb66 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:40.859290 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d6caf-616b-409d-92ea-a2ff3c11eb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:40.891269 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6f6d6caf-616b-409d-92ea-a2ff3c11eb66 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:40.893213 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6f6d6caf-616b-409d-92ea-a2ff3c11eb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:40.987790 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1079/2168] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:07:40.989703 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff058471-4c57-4006-8c21-d5420802795c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:40.990014 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff058471-4c57-4006-8c21-d5420802795c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:40.990295 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff058471-4c57-4006-8c21-d5420802795c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:41.015242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ff058471-4c57-4006-8c21-d5420802795c None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:41.018657 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ff058471-4c57-4006-8c21-d5420802795c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:41.039063 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1090/2169] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:41.045692 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d6caf-616b-409d-92ea-a2ff3c11eb66 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:41.075948 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d6caf-616b-409d-92ea-a2ff3c11eb66 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:41.081966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28566840-fee7-4bb4-b003-b417ae299c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:41.082934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28566840-fee7-4bb4-b003-b417ae299c01 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:41.083428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28566840-fee7-4bb4-b003-b417ae299c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:41.084617 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28566840-fee7-4bb4-b003-b417ae299c01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:41.085570 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28566840-fee7-4bb4-b003-b417ae299c01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:07:41.086743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28566840-fee7-4bb4-b003-b417ae299c01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:41.089272 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28566840-fee7-4bb4-b003-b417ae299c01 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:41.105263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1080/2170] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:07:41.109457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff058471-4c57-4006-8c21-d5420802795c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:41.128620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff058471-4c57-4006-8c21-d5420802795c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:41.133908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d09772-c690-4adb-a73a-5de3de2688f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:41.137567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d09772-c690-4adb-a73a-5de3de2688f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:41.138069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d09772-c690-4adb-a73a-5de3de2688f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:41.138498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d09772-c690-4adb-a73a-5de3de2688f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:41.144165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d09772-c690-4adb-a73a-5de3de2688f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:41.149498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d09772-c690-4adb-a73a-5de3de2688f7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:41.217028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1091/2171] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:07:41 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:41.217981 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28566840-fee7-4bb4-b003-b417ae299c01 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:41.236864 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28566840-fee7-4bb4-b003-b417ae299c01 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:41.350331 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f1b2e-cf21-470d-b164-0e9a27b60c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:41.351218 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f1b2e-cf21-470d-b164-0e9a27b60c64 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:41.351611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f1b2e-cf21-470d-b164-0e9a27b60c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:41.351995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f1b2e-cf21-470d-b164-0e9a27b60c64 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:41.352807 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f1b2e-cf21-470d-b164-0e9a27b60c64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:41.357592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f1b2e-cf21-470d-b164-0e9a27b60c64 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:41.394889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1081/2172] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:07:41 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:07:41.398663 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d09772-c690-4adb-a73a-5de3de2688f7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:41.412255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d09772-c690-4adb-a73a-5de3de2688f7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:41.419813 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448f11a-5d0a-43d2-9b91-a1a607792aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:41.420817 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448f11a-5d0a-43d2-9b91-a1a607792aef admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:41.421249 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448f11a-5d0a-43d2-9b91-a1a607792aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:41.421743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448f11a-5d0a-43d2-9b91-a1a607792aef admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:41.422669 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448f11a-5d0a-43d2-9b91-a1a607792aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:41.424730 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448f11a-5d0a-43d2-9b91-a1a607792aef admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:41.443558 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1092/2173] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:07:41.448522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f1b2e-cf21-470d-b164-0e9a27b60c64 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:41.467329 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f1b2e-cf21-470d-b164-0e9a27b60c64 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:41.480859 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a39e88-bfd9-4e7b-a59b-8705cecd944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:41.487126 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a39e88-bfd9-4e7b-a59b-8705cecd944d admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:41.487428 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a39e88-bfd9-4e7b-a59b-8705cecd944d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:41.487713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a39e88-bfd9-4e7b-a59b-8705cecd944d admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:41.493493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a39e88-bfd9-4e7b-a59b-8705cecd944d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:41.500291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a39e88-bfd9-4e7b-a59b-8705cecd944d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:41.524507 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1082/2174] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:07:41.538810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448f11a-5d0a-43d2-9b91-a1a607792aef admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:41.555552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448f11a-5d0a-43d2-9b91-a1a607792aef admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:41.562103 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50a8f3-c18a-435f-8442-450ecbb0f79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:41.563174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50a8f3-c18a-435f-8442-450ecbb0f79a admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:41.563608 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50a8f3-c18a-435f-8442-450ecbb0f79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:41.563988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50a8f3-c18a-435f-8442-450ecbb0f79a admin admin] PATH_INFO: `/v3/projects/66bfab8afd534b8eb9633dd39fcf6bbe/users/20f777b4e9f248bbad77bd72ba51f38d/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:41.585069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50a8f3-c18a-435f-8442-450ecbb0f79a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66bfab8afd534b8eb9633dd39fcf6bbe, user_id=20f777b4e9f248bbad77bd72ba51f38d, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:41.590404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50a8f3-c18a-435f-8442-450ecbb0f79a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:41.624647 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1093/2175] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:07:41 2022] PUT /identity/v3/projects/66bfab8afd534b8eb9633dd39fcf6bbe/users/20f777b4e9f248bbad77bd72ba51f38d/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:07:41.637097 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d369c9e-a78b-4446-9099-9d0ef0e7caad None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:41.637958 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d369c9e-a78b-4446-9099-9d0ef0e7caad None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:41.637958 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d369c9e-a78b-4446-9099-9d0ef0e7caad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:41.701812 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6d369c9e-a78b-4446-9099-9d0ef0e7caad None None] MFA Rules not processed for user `20f777b4e9f248bbad77bd72ba51f38d`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:41.703489 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6d369c9e-a78b-4446-9099-9d0ef0e7caad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:41.719328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:41.861842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1083/2176] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:41.874638 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50a8f3-c18a-435f-8442-450ecbb0f79a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:41.876512 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-de50a8f3-c18a-435f-8442-450ecbb0f79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:42.004085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50a8f3-c18a-435f-8442-450ecbb0f79a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:42.013867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81a194-1ce8-4ef2-955b-6d3bf28e448d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:42.014876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81a194-1ce8-4ef2-955b-6d3bf28e448d service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:42.015342 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81a194-1ce8-4ef2-955b-6d3bf28e448d service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:42.015763 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81a194-1ce8-4ef2-955b-6d3bf28e448d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:42.028670 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81a194-1ce8-4ef2-955b-6d3bf28e448d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:42.046032 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81a194-1ce8-4ef2-955b-6d3bf28e448d service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:42.086107 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1094/2177] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:43.350573 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd4466-b7ae-4d87-b2ba-749aef4ebcfd None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:43.351699 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd4466-b7ae-4d87-b2ba-749aef4ebcfd None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:43.352141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd4466-b7ae-4d87-b2ba-749aef4ebcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:43.388780 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c4fd4466-b7ae-4d87-b2ba-749aef4ebcfd None None] MFA Rules not processed for user `13b9ab17cee74e8282cd86a37eaf19aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:43.390234 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c4fd4466-b7ae-4d87-b2ba-749aef4ebcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:43.486713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1084/2178] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:43.502099 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81a194-1ce8-4ef2-955b-6d3bf28e448d service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:43.503616 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-5a81a194-1ce8-4ef2-955b-6d3bf28e448d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:43.624295 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:43.636662 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81a194-1ce8-4ef2-955b-6d3bf28e448d service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:43.644950 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d7047-f22e-4b55-90fc-be6e90b771c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:43.645635 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d7047-f22e-4b55-90fc-be6e90b771c0 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:43.645950 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d7047-f22e-4b55-90fc-be6e90b771c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:43.646222 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d7047-f22e-4b55-90fc-be6e90b771c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:43.656523 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d7047-f22e-4b55-90fc-be6e90b771c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:43.658831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d7047-f22e-4b55-90fc-be6e90b771c0 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:43.672650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1095/2179] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:45.565114 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9abfc9-1ec0-4e33-9cf3-17beaf2c781f None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:45.566017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9abfc9-1ec0-4e33-9cf3-17beaf2c781f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:45.566445 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9abfc9-1ec0-4e33-9cf3-17beaf2c781f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:45.601761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-1e9abfc9-1ec0-4e33-9cf3-17beaf2c781f None None] MFA Rules not processed for user `f1e1d900d4394e80a62feac59bde10c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:45.604279 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1e9abfc9-1ec0-4e33-9cf3-17beaf2c781f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:45.643277 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41853d-086f-4b08-a8e1-e44c3578a5e9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:45.643821 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41853d-086f-4b08-a8e1-e44c3578a5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:45.644179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41853d-086f-4b08-a8e1-e44c3578a5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:45.665601 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-2e41853d-086f-4b08-a8e1-e44c3578a5e9 None None] MFA Rules not processed for user `13b9ab17cee74e8282cd86a37eaf19aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:45.667248 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2e41853d-086f-4b08-a8e1-e44c3578a5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:45.676291 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1096/2180] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:07:45.723788 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1085/2181] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:45.732098 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41853d-086f-4b08-a8e1-e44c3578a5e9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:07:45.748753 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41853d-086f-4b08-a8e1-e44c3578a5e9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:07:45.755776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630d104-8eea-4603-a3a8-67c013f519d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:07:45.756697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630d104-8eea-4603-a3a8-67c013f519d4 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:45.757073 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630d104-8eea-4603-a3a8-67c013f519d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:45.757580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630d104-8eea-4603-a3a8-67c013f519d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:45.760838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6630d104-8eea-4603-a3a8-67c013f519d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:45.899623 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630d104-8eea-4603-a3a8-67c013f519d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:07:45.902963 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630d104-8eea-4603-a3a8-67c013f519d4 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:07:45.923571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1097/2182] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:07:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:07:47.878624 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfbaa5-68ae-42b3-9d3a-0411caaa936d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:07:47.879117 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfbaa5-68ae-42b3-9d3a-0411caaa936d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:07:47.879799 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfbaa5-68ae-42b3-9d3a-0411caaa936d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:07:47.898394 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f7bfbaa5-68ae-42b3-9d3a-0411caaa936d None None] MFA Rules not processed for user `edf6a4f02eb34720b0126d17db1c1b86`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:07:47.899527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f7bfbaa5-68ae-42b3-9d3a-0411caaa936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:07:47.906946 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1086/2183] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:07:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:07:55.912262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=37 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:57.892957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=93 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:17.117934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630d104-8eea-4603-a3a8-67c013f519d4 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:17.119387 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6630d104-8eea-4603-a3a8-67c013f519d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:17.183724 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630d104-8eea-4603-a3a8-67c013f519d4 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:17.188863 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef363bba-6a54-4c2a-a7a0-73af836699c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:17.189763 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef363bba-6a54-4c2a-a7a0-73af836699c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:17.190048 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef363bba-6a54-4c2a-a7a0-73af836699c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:17.190324 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef363bba-6a54-4c2a-a7a0-73af836699c0 admin admin] PATH_INFO: `/v3/users/2a3b0665dfdd47ba9d0bb28ca2dc22c2` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:17.191551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef363bba-6a54-4c2a-a7a0-73af836699c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3b0665dfdd47ba9d0bb28ca2dc22c2)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:17.193458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef363bba-6a54-4c2a-a7a0-73af836699c0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:17.239940 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ef363bba-6a54-4c2a-a7a0-73af836699c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3b0665dfdd47ba9d0bb28ca2dc22c2'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:17.240682 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ef363bba-6a54-4c2a-a7a0-73af836699c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3b0665dfdd47ba9d0bb28ca2dc22c2'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:17.250198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ef363bba-6a54-4c2a-a7a0-73af836699c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3b0665dfdd47ba9d0bb28ca2dc22c2'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:17.257764 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ef363bba-6a54-4c2a-a7a0-73af836699c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3b0665dfdd47ba9d0bb28ca2dc22c2'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:17.270678 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-ef363bba-6a54-4c2a-a7a0-73af836699c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3b0665dfdd47ba9d0bb28ca2dc22c2'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:17.276649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1098/2184] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:08:17 2022] DELETE /identity/v3/users/2a3b0665dfdd47ba9d0bb28ca2dc22c2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:08:17.281589 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e919bad-3865-4fa4-ade8-88be02209eb5 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:17.282138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e919bad-3865-4fa4-ade8-88be02209eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:17.282244 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e919bad-3865-4fa4-ade8-88be02209eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:17.299717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-1e919bad-3865-4fa4-ade8-88be02209eb5 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:08:17.300925 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1e919bad-3865-4fa4-ade8-88be02209eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:17.364384 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1087/2185] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:08:17.375125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef363bba-6a54-4c2a-a7a0-73af836699c0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:17.376746 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ef363bba-6a54-4c2a-a7a0-73af836699c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:17.435187 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef363bba-6a54-4c2a-a7a0-73af836699c0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:17.439618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e24f9-8aea-41fb-9e2c-b9c94285cb5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:17.440260 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e24f9-8aea-41fb-9e2c-b9c94285cb5d service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:17.440542 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e24f9-8aea-41fb-9e2c-b9c94285cb5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:17.440815 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e24f9-8aea-41fb-9e2c-b9c94285cb5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:17.450032 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e24f9-8aea-41fb-9e2c-b9c94285cb5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:17.451486 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e24f9-8aea-41fb-9e2c-b9c94285cb5d service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:17.461650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1099/2186] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:08:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:08:17.987770 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e919bad-3865-4fa4-ade8-88be02209eb5 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:17.989201 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1e919bad-3865-4fa4-ade8-88be02209eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:18.002631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e919bad-3865-4fa4-ade8-88be02209eb5 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:18.007424 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bac3e7-332e-442d-8458-c8acdb8ab9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:18.008285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bac3e7-332e-442d-8458-c8acdb8ab9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:18.008730 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bac3e7-332e-442d-8458-c8acdb8ab9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:18.008980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bac3e7-332e-442d-8458-c8acdb8ab9b5 admin admin] PATH_INFO: `/v3/projects/b18dcb61ba13496faa96461218972138` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:18.010216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bac3e7-332e-442d-8458-c8acdb8ab9b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b18dcb61ba13496faa96461218972138)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:18.012197 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bac3e7-332e-442d-8458-c8acdb8ab9b5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:18.072789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a0bac3e7-332e-442d-8458-c8acdb8ab9b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b18dcb61ba13496faa96461218972138', 'request_id': 'req-a0bac3e7-332e-442d-8458-c8acdb8ab9b5'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:18.081533 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a0bac3e7-332e-442d-8458-c8acdb8ab9b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b18dcb61ba13496faa96461218972138', 'request_id': 'req-a0bac3e7-332e-442d-8458-c8acdb8ab9b5'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:18.089575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a0bac3e7-332e-442d-8458-c8acdb8ab9b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b18dcb61ba13496faa96461218972138', 'request_id': 'req-a0bac3e7-332e-442d-8458-c8acdb8ab9b5'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:18.108106 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a0bac3e7-332e-442d-8458-c8acdb8ab9b5 admin admin] The token cache is being invalidate because project b18dcb61ba13496faa96461218972138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:08:18.108764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a0bac3e7-332e-442d-8458-c8acdb8ab9b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:18.109589 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-a0bac3e7-332e-442d-8458-c8acdb8ab9b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:18.111475 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1088/2187] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:08:17 2022] DELETE /identity/v3/projects/b18dcb61ba13496faa96461218972138 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:08:18.116855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5e185-65aa-4b3b-9c49-bad8b5dddea1 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:18.117146 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5e185-65aa-4b3b-9c49-bad8b5dddea1 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:18.117423 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5e185-65aa-4b3b-9c49-bad8b5dddea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:18.136286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e5c5e185-65aa-4b3b-9c49-bad8b5dddea1 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:08:18.137427 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e5c5e185-65aa-4b3b-9c49-bad8b5dddea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:18.158126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:18.221811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1100/2188] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:08:18.227987 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cc18c-6640-44d4-b3c7-2d43a6f45843 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:18.228275 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cc18c-6640-44d4-b3c7-2d43a6f45843 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:18.228553 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cc18c-6640-44d4-b3c7-2d43a6f45843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:18.247919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-902cc18c-6640-44d4-b3c7-2d43a6f45843 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:08:18.249131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-902cc18c-6640-44d4-b3c7-2d43a6f45843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:18.258431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1089/2189] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:08:18.262874 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5e185-65aa-4b3b-9c49-bad8b5dddea1 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:18.273460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5e185-65aa-4b3b-9c49-bad8b5dddea1 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:18.278594 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7fa4d-ffab-4770-9e24-5088101f3cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:18.279259 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7fa4d-ffab-4770-9e24-5088101f3cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:18.279542 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7fa4d-ffab-4770-9e24-5088101f3cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:18.279809 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7fa4d-ffab-4770-9e24-5088101f3cf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:18.280581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7fa4d-ffab-4770-9e24-5088101f3cf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:08:18.280886 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7fa4d-ffab-4770-9e24-5088101f3cf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:18.282530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7fa4d-ffab-4770-9e24-5088101f3cf0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:18.298678 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1101/2190] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:08:18.299798 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cc18c-6640-44d4-b3c7-2d43a6f45843 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:18.310497 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cc18c-6640-44d4-b3c7-2d43a6f45843 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:18.315923 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa84dd-2b70-4bef-8e87-bb1b36f40960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:18.316626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa84dd-2b70-4bef-8e87-bb1b36f40960 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:18.316907 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa84dd-2b70-4bef-8e87-bb1b36f40960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:18.317180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa84dd-2b70-4bef-8e87-bb1b36f40960 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:18.317917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa84dd-2b70-4bef-8e87-bb1b36f40960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:18.319851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa84dd-2b70-4bef-8e87-bb1b36f40960 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:18.346016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1090/2191] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:08:18 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:08:18.350712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7fa4d-ffab-4770-9e24-5088101f3cf0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:18.361430 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7fa4d-ffab-4770-9e24-5088101f3cf0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:18.421632 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b57ca-ec20-4501-993e-0d062f239ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:18.422408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b57ca-ec20-4501-993e-0d062f239ebc admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:18.422701 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b57ca-ec20-4501-993e-0d062f239ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:18.422976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b57ca-ec20-4501-993e-0d062f239ebc admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:18.423681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b57ca-ec20-4501-993e-0d062f239ebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:18.425590 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b57ca-ec20-4501-993e-0d062f239ebc admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:18.446366 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1102/2192] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:08:18 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:08:18.450532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa84dd-2b70-4bef-8e87-bb1b36f40960 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:18.461203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa84dd-2b70-4bef-8e87-bb1b36f40960 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:18.466130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da20311-f881-4479-8f40-dea2494b0ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:18.466818 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da20311-f881-4479-8f40-dea2494b0ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:18.467100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da20311-f881-4479-8f40-dea2494b0ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:18.467375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da20311-f881-4479-8f40-dea2494b0ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:18.468274 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da20311-f881-4479-8f40-dea2494b0ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:18.469899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da20311-f881-4479-8f40-dea2494b0ab1 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:18.480802 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1091/2193] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:08:18.485950 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b57ca-ec20-4501-993e-0d062f239ebc admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:18.496300 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b57ca-ec20-4501-993e-0d062f239ebc admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:18.502127 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80d2e0-35c2-47ba-b3a0-72def82eb72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:18.502818 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80d2e0-35c2-47ba-b3a0-72def82eb72f admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:18.503098 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80d2e0-35c2-47ba-b3a0-72def82eb72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:18.503381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80d2e0-35c2-47ba-b3a0-72def82eb72f admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:18.504115 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80d2e0-35c2-47ba-b3a0-72def82eb72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:18.505753 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80d2e0-35c2-47ba-b3a0-72def82eb72f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:18.516028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1103/2194] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:08:18.520234 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da20311-f881-4479-8f40-dea2494b0ab1 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:18.530374 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da20311-f881-4479-8f40-dea2494b0ab1 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:18.535526 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fce6bb-8145-4f26-8c13-e0ff1888cb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:18.536408 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fce6bb-8145-4f26-8c13-e0ff1888cb84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:18.536699 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fce6bb-8145-4f26-8c13-e0ff1888cb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:18.536976 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fce6bb-8145-4f26-8c13-e0ff1888cb84 admin admin] PATH_INFO: `/v3/projects/7f298bb1d04f4810a14fff57d0504cd3/users/9156f3e53ea34ff9a0c8a3123827cdfb/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:18.552287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fce6bb-8145-4f26-8c13-e0ff1888cb84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f298bb1d04f4810a14fff57d0504cd3, user_id=9156f3e53ea34ff9a0c8a3123827cdfb, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:18.554994 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fce6bb-8145-4f26-8c13-e0ff1888cb84 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:18.569215 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1092/2195] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:08:18 2022] PUT /identity/v3/projects/7f298bb1d04f4810a14fff57d0504cd3/users/9156f3e53ea34ff9a0c8a3123827cdfb/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:08:18.579482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab253da-0f75-4a19-986b-5e0b054008a5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:18.579780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab253da-0f75-4a19-986b-5e0b054008a5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:18.580060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab253da-0f75-4a19-986b-5e0b054008a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:18.609371 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4ab253da-0f75-4a19-986b-5e0b054008a5 None None] MFA Rules not processed for user `9156f3e53ea34ff9a0c8a3123827cdfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:08:18.610752 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4ab253da-0f75-4a19-986b-5e0b054008a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:18.679755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1104/2196] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:08:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:08:18.684148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fce6bb-8145-4f26-8c13-e0ff1888cb84 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:18.710561 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:18.757091 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fce6bb-8145-4f26-8c13-e0ff1888cb84 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:18.762140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35adf46-e2f0-4fad-9127-a25251996e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:18.762604 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35adf46-e2f0-4fad-9127-a25251996e34 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:18.762893 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35adf46-e2f0-4fad-9127-a25251996e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:18.763174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35adf46-e2f0-4fad-9127-a25251996e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:18.763870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35adf46-e2f0-4fad-9127-a25251996e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:18.766457 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35adf46-e2f0-4fad-9127-a25251996e34 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:18.792796 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1093/2197] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:08:18 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:08:18.797693 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab253da-0f75-4a19-986b-5e0b054008a5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:18.809082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab253da-0f75-4a19-986b-5e0b054008a5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:18.821933 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:18.867925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58bbb2-66b4-4b44-85c0-7e9f7e4e9441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:18.868589 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58bbb2-66b4-4b44-85c0-7e9f7e4e9441 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:18.868872 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58bbb2-66b4-4b44-85c0-7e9f7e4e9441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:18.869149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58bbb2-66b4-4b44-85c0-7e9f7e4e9441 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:18.869878 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58bbb2-66b4-4b44-85c0-7e9f7e4e9441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:18.871788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58bbb2-66b4-4b44-85c0-7e9f7e4e9441 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:18.891756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1105/2198] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:08:18 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:08:18.895647 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35adf46-e2f0-4fad-9127-a25251996e34 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:18.906979 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35adf46-e2f0-4fad-9127-a25251996e34 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:18.911909 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bf6fd-f3c0-46fb-bfe8-cab1aa77fb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:18.912571 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bf6fd-f3c0-46fb-bfe8-cab1aa77fb07 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:18.912857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bf6fd-f3c0-46fb-bfe8-cab1aa77fb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:18.913138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bf6fd-f3c0-46fb-bfe8-cab1aa77fb07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:18.913897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9bf6fd-f3c0-46fb-bfe8-cab1aa77fb07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:18.915507 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9bf6fd-f3c0-46fb-bfe8-cab1aa77fb07 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:18.930180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1094/2199] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:08:18.932222 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58bbb2-66b4-4b44-85c0-7e9f7e4e9441 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:18.942986 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58bbb2-66b4-4b44-85c0-7e9f7e4e9441 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:18.947786 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55675933-6a5e-4e52-8c39-2f99473f14ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:18.948582 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55675933-6a5e-4e52-8c39-2f99473f14ea admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:18.949040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55675933-6a5e-4e52-8c39-2f99473f14ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:18.949348 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55675933-6a5e-4e52-8c39-2f99473f14ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:18.950119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55675933-6a5e-4e52-8c39-2f99473f14ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:18.951710 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55675933-6a5e-4e52-8c39-2f99473f14ea admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:18.962299 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1106/2200] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:08:18.966906 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bf6fd-f3c0-46fb-bfe8-cab1aa77fb07 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:18.978027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bf6fd-f3c0-46fb-bfe8-cab1aa77fb07 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:18.982879 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b84a4-e21b-4a29-9a5c-169aeb9a30e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:18.984521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b84a4-e21b-4a29-9a5c-169aeb9a30e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:18.985156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b84a4-e21b-4a29-9a5c-169aeb9a30e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:18.985156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b84a4-e21b-4a29-9a5c-169aeb9a30e4 admin admin] PATH_INFO: `/v3/projects/eded06aaf4ce41b08faa960da3f08638/users/1f740c999a3b4e82b6a0cd58bb37d8d7/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:19.003020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b84a4-e21b-4a29-9a5c-169aeb9a30e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eded06aaf4ce41b08faa960da3f08638, user_id=1f740c999a3b4e82b6a0cd58bb37d8d7, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:19.005831 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b84a4-e21b-4a29-9a5c-169aeb9a30e4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:19.025357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1095/2201] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:08:18 2022] PUT /identity/v3/projects/eded06aaf4ce41b08faa960da3f08638/users/1f740c999a3b4e82b6a0cd58bb37d8d7/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:08:19.036354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff88cc-3c34-4c3c-a853-a9f18036c9a6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:19.036644 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff88cc-3c34-4c3c-a853-a9f18036c9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:19.036926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff88cc-3c34-4c3c-a853-a9f18036c9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:19.065377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-07ff88cc-3c34-4c3c-a853-a9f18036c9a6 None None] MFA Rules not processed for user `1f740c999a3b4e82b6a0cd58bb37d8d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:08:19.066811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-07ff88cc-3c34-4c3c-a853-a9f18036c9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:19.139489 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1107/2202] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:08:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:08:19.144858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b84a4-e21b-4a29-9a5c-169aeb9a30e4 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:19.217114 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b84a4-e21b-4a29-9a5c-169aeb9a30e4 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:19.222502 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6808cd-3efa-43e3-85c6-39c038ab988e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:19.223173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6808cd-3efa-43e3-85c6-39c038ab988e admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:19.223457 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6808cd-3efa-43e3-85c6-39c038ab988e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:19.223734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6808cd-3efa-43e3-85c6-39c038ab988e admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:19.224432 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6808cd-3efa-43e3-85c6-39c038ab988e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:19.226651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6808cd-3efa-43e3-85c6-39c038ab988e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:19.254069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1096/2203] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:08:19 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:08:19.258241 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff88cc-3c34-4c3c-a853-a9f18036c9a6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:19.271320 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff88cc-3c34-4c3c-a853-a9f18036c9a6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:19.341897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d1109-39ad-4e36-bc49-5e68d978f27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:19.342670 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d1109-39ad-4e36-bc49-5e68d978f27c admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:19.343054 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d1109-39ad-4e36-bc49-5e68d978f27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:19.344608 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d1109-39ad-4e36-bc49-5e68d978f27c admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:19.344875 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d1109-39ad-4e36-bc49-5e68d978f27c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:19.346985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d1109-39ad-4e36-bc49-5e68d978f27c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:19.369981 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1108/2204] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:08:19 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:08:19.373946 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6808cd-3efa-43e3-85c6-39c038ab988e admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:19.385095 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6808cd-3efa-43e3-85c6-39c038ab988e admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:19.395836 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c274a91-4ede-4437-ab22-f9ecdf2c18a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:19.396749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c274a91-4ede-4437-ab22-f9ecdf2c18a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:19.397212 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c274a91-4ede-4437-ab22-f9ecdf2c18a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:19.397501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c274a91-4ede-4437-ab22-f9ecdf2c18a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:19.398279 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c274a91-4ede-4437-ab22-f9ecdf2c18a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:19.400025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c274a91-4ede-4437-ab22-f9ecdf2c18a2 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:19.416224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1097/2205] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:08:19.417389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d1109-39ad-4e36-bc49-5e68d978f27c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:19.428488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d1109-39ad-4e36-bc49-5e68d978f27c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:19.433198 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad0cbb-aee5-43ee-a40a-c20db4a73a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:19.434122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad0cbb-aee5-43ee-a40a-c20db4a73a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:19.434411 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad0cbb-aee5-43ee-a40a-c20db4a73a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:19.434690 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad0cbb-aee5-43ee-a40a-c20db4a73a2e admin admin] PATH_INFO: `/v3/projects/6e1c1e487015447ba3fc0c526bce1999/users/f8b9e4f71a964d9eb3181141ed749b9b/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:19.448966 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:19.453091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad0cbb-aee5-43ee-a40a-c20db4a73a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e1c1e487015447ba3fc0c526bce1999, user_id=f8b9e4f71a964d9eb3181141ed749b9b, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:19.456553 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad0cbb-aee5-43ee-a40a-c20db4a73a2e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:19.472513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1109/2206] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:08:19 2022] PUT /identity/v3/projects/6e1c1e487015447ba3fc0c526bce1999/users/f8b9e4f71a964d9eb3181141ed749b9b/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:08:19.476694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c274a91-4ede-4437-ab22-f9ecdf2c18a2 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:19.487406 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c274a91-4ede-4437-ab22-f9ecdf2c18a2 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:19.531321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:19.552696 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c752cde-8328-4c58-9849-c44c3138fbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:19.553199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c752cde-8328-4c58-9849-c44c3138fbaa admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:19.553484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c752cde-8328-4c58-9849-c44c3138fbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:19.553793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c752cde-8328-4c58-9849-c44c3138fbaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:19.554533 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c752cde-8328-4c58-9849-c44c3138fbaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:19.556157 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c752cde-8328-4c58-9849-c44c3138fbaa admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:19.566445 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1098/2207] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:08:19.570713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad0cbb-aee5-43ee-a40a-c20db4a73a2e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:19.582713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad0cbb-aee5-43ee-a40a-c20db4a73a2e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:19.587832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc42891-29bd-4928-afdd-774e1378c6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:19.589036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc42891-29bd-4928-afdd-774e1378c6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:19.589475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc42891-29bd-4928-afdd-774e1378c6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:19.590177 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc42891-29bd-4928-afdd-774e1378c6e3 admin admin] PATH_INFO: `/v3/projects/6e1c1e487015447ba3fc0c526bce1999/users/f8b9e4f71a964d9eb3181141ed749b9b/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:19.591986 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc42891-29bd-4928-afdd-774e1378c6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e1c1e487015447ba3fc0c526bce1999, user_id=f8b9e4f71a964d9eb3181141ed749b9b, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:19.595769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc42891-29bd-4928-afdd-774e1378c6e3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:19.608124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1110/2208] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:08:19 2022] PUT /identity/v3/projects/6e1c1e487015447ba3fc0c526bce1999/users/f8b9e4f71a964d9eb3181141ed749b9b/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:08:19.620062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414240d9-3abf-4718-8496-f7989148c511 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:19.620424 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414240d9-3abf-4718-8496-f7989148c511 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:19.620781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414240d9-3abf-4718-8496-f7989148c511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:19.648831 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-414240d9-3abf-4718-8496-f7989148c511 None None] MFA Rules not processed for user `f8b9e4f71a964d9eb3181141ed749b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:08:19.650166 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-414240d9-3abf-4718-8496-f7989148c511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:19.724616 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1099/2209] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:08:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:08:19.732829 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc42891-29bd-4928-afdd-774e1378c6e3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:19.735261 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9cc42891-29bd-4928-afdd-774e1378c6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:19.736780 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414240d9-3abf-4718-8496-f7989148c511 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:19.738427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-414240d9-3abf-4718-8496-f7989148c511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:19.819960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc42891-29bd-4928-afdd-774e1378c6e3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:19.825872 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50656cc7-65f1-4a40-b795-027bd0219b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:19.827325 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50656cc7-65f1-4a40-b795-027bd0219b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:19.828603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50656cc7-65f1-4a40-b795-027bd0219b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:19.829303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50656cc7-65f1-4a40-b795-027bd0219b26 admin admin] PATH_INFO: `/v3/users/20f777b4e9f248bbad77bd72ba51f38d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:19.830934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50656cc7-65f1-4a40-b795-027bd0219b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f777b4e9f248bbad77bd72ba51f38d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:19.831470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414240d9-3abf-4718-8496-f7989148c511 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:19.832898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50656cc7-65f1-4a40-b795-027bd0219b26 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:19.835772 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a58ce-a062-488a-a286-a607d38e1cd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:19.836115 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a58ce-a062-488a-a286-a607d38e1cd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:19.836397 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a58ce-a062-488a-a286-a607d38e1cd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:19.836672 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a58ce-a062-488a-a286-a607d38e1cd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:19.894886 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-50656cc7-65f1-4a40-b795-027bd0219b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f777b4e9f248bbad77bd72ba51f38d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:19.895809 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-50656cc7-65f1-4a40-b795-027bd0219b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f777b4e9f248bbad77bd72ba51f38d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:19.902911 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a58ce-a062-488a-a286-a607d38e1cd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:19.904506 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a58ce-a062-488a-a286-a607d38e1cd0 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:19.909619 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-50656cc7-65f1-4a40-b795-027bd0219b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f777b4e9f248bbad77bd72ba51f38d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:19.910028 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:19.919515 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-50656cc7-65f1-4a40-b795-027bd0219b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f777b4e9f248bbad77bd72ba51f38d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:19.926100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1100/2210] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:08:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:08:19.935373 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-50656cc7-65f1-4a40-b795-027bd0219b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f777b4e9f248bbad77bd72ba51f38d'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:19.942337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1111/2211] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:08:19 2022] DELETE /identity/v3/users/20f777b4e9f248bbad77bd72ba51f38d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:08:19.946853 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b2637-93b3-4c11-991b-cb1f2b5ef9de None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:19.947153 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b2637-93b3-4c11-991b-cb1f2b5ef9de None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:19.947440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b2637-93b3-4c11-991b-cb1f2b5ef9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:19.966773 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4c2b2637-93b3-4c11-991b-cb1f2b5ef9de None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:08:19.968091 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4c2b2637-93b3-4c11-991b-cb1f2b5ef9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:20.032240 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1101/2212] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:08:20.044464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50656cc7-65f1-4a40-b795-027bd0219b26 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:20.046218 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-50656cc7-65f1-4a40-b795-027bd0219b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:20.126954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50656cc7-65f1-4a40-b795-027bd0219b26 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:20.131112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcb7ed-82ac-467b-a351-2cd8aab6499f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:20.131777 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcb7ed-82ac-467b-a351-2cd8aab6499f service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:20.132066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcb7ed-82ac-467b-a351-2cd8aab6499f service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:20.132348 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcb7ed-82ac-467b-a351-2cd8aab6499f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:20.143385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcb7ed-82ac-467b-a351-2cd8aab6499f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:20.144876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcb7ed-82ac-467b-a351-2cd8aab6499f service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:20.150465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:20.158790 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1112/2213] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:08:20.514679 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b2637-93b3-4c11-991b-cb1f2b5ef9de None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:20.516403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4c2b2637-93b3-4c11-991b-cb1f2b5ef9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:20.531373 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b2637-93b3-4c11-991b-cb1f2b5ef9de None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:20.536270 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229d8bf-d95f-4d3a-b8c6-dfe80d2d4167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:20.537237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229d8bf-d95f-4d3a-b8c6-dfe80d2d4167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:20.537412 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229d8bf-d95f-4d3a-b8c6-dfe80d2d4167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:20.543374 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229d8bf-d95f-4d3a-b8c6-dfe80d2d4167 admin admin] PATH_INFO: `/v3/projects/66bfab8afd534b8eb9633dd39fcf6bbe` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:20.544791 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229d8bf-d95f-4d3a-b8c6-dfe80d2d4167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66bfab8afd534b8eb9633dd39fcf6bbe)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:20.547774 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229d8bf-d95f-4d3a-b8c6-dfe80d2d4167 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:20.603270 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7229d8bf-d95f-4d3a-b8c6-dfe80d2d4167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66bfab8afd534b8eb9633dd39fcf6bbe', 'request_id': 'req-7229d8bf-d95f-4d3a-b8c6-dfe80d2d4167'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:20.616209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7229d8bf-d95f-4d3a-b8c6-dfe80d2d4167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66bfab8afd534b8eb9633dd39fcf6bbe', 'request_id': 'req-7229d8bf-d95f-4d3a-b8c6-dfe80d2d4167'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:20.622764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7229d8bf-d95f-4d3a-b8c6-dfe80d2d4167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66bfab8afd534b8eb9633dd39fcf6bbe', 'request_id': 'req-7229d8bf-d95f-4d3a-b8c6-dfe80d2d4167'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:20.636739 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7229d8bf-d95f-4d3a-b8c6-dfe80d2d4167 admin admin] The token cache is being invalidate because project 66bfab8afd534b8eb9633dd39fcf6bbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:08:20.637031 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7229d8bf-d95f-4d3a-b8c6-dfe80d2d4167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:20.637678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7229d8bf-d95f-4d3a-b8c6-dfe80d2d4167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:20.639266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1102/2214] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:08:20 2022] DELETE /identity/v3/projects/66bfab8afd534b8eb9633dd39fcf6bbe => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:08:22.550777 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcb7ed-82ac-467b-a351-2cd8aab6499f service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:22.552260 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e3dcb7ed-82ac-467b-a351-2cd8aab6499f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:22.615715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcb7ed-82ac-467b-a351-2cd8aab6499f service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:22.667233 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b670e-279e-4067-b941-bc6f48c492f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:22.667880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b670e-279e-4067-b941-bc6f48c492f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:22.668165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b670e-279e-4067-b941-bc6f48c492f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:22.668441 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b670e-279e-4067-b941-bc6f48c492f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:22.670292 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7a5b670e-279e-4067-b941-bc6f48c492f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:22.729125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b670e-279e-4067-b941-bc6f48c492f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:22.730594 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b670e-279e-4067-b941-bc6f48c492f9 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:22.741016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1113/2215] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:08:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:08:23.314215 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229d8bf-d95f-4d3a-b8c6-dfe80d2d4167 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:23.315680 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7229d8bf-d95f-4d3a-b8c6-dfe80d2d4167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:23.328680 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229d8bf-d95f-4d3a-b8c6-dfe80d2d4167 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:23.332296 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998c1c9-727d-45fe-810b-044bb84ed2fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:23.332940 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998c1c9-727d-45fe-810b-044bb84ed2fe service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:23.333245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998c1c9-727d-45fe-810b-044bb84ed2fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:23.333523 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998c1c9-727d-45fe-810b-044bb84ed2fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:23.335293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b998c1c9-727d-45fe-810b-044bb84ed2fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:23.398733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998c1c9-727d-45fe-810b-044bb84ed2fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:23.400193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998c1c9-727d-45fe-810b-044bb84ed2fe service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:23.410287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1103/2216] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:08:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:08:28.330483 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b670e-279e-4067-b941-bc6f48c492f9 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:28.332034 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7a5b670e-279e-4067-b941-bc6f48c492f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:28.400505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b670e-279e-4067-b941-bc6f48c492f9 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:28.405748 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979155d-bc0f-45dc-bc7b-a8ba835094ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:28.406856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979155d-bc0f-45dc-bc7b-a8ba835094ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:28.407142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979155d-bc0f-45dc-bc7b-a8ba835094ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:28.407421 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979155d-bc0f-45dc-bc7b-a8ba835094ff admin admin] PATH_INFO: `/v3/users/9156f3e53ea34ff9a0c8a3123827cdfb` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:28.408655 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979155d-bc0f-45dc-bc7b-a8ba835094ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9156f3e53ea34ff9a0c8a3123827cdfb)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:28.410644 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979155d-bc0f-45dc-bc7b-a8ba835094ff admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:28.425510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:28.461036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1979155d-bc0f-45dc-bc7b-a8ba835094ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9156f3e53ea34ff9a0c8a3123827cdfb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:28.461717 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1979155d-bc0f-45dc-bc7b-a8ba835094ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9156f3e53ea34ff9a0c8a3123827cdfb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:28.470411 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1979155d-bc0f-45dc-bc7b-a8ba835094ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9156f3e53ea34ff9a0c8a3123827cdfb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:28.477751 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1979155d-bc0f-45dc-bc7b-a8ba835094ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9156f3e53ea34ff9a0c8a3123827cdfb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:28.492224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1979155d-bc0f-45dc-bc7b-a8ba835094ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9156f3e53ea34ff9a0c8a3123827cdfb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:28.503131 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1114/2217] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:08:28 2022] DELETE /identity/v3/users/9156f3e53ea34ff9a0c8a3123827cdfb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:08:28.509441 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375c260-5494-4132-85ec-8f77dced1dd9 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:28.510236 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375c260-5494-4132-85ec-8f77dced1dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:28.510750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375c260-5494-4132-85ec-8f77dced1dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:28.532130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4375c260-5494-4132-85ec-8f77dced1dd9 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:08:28.533370 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4375c260-5494-4132-85ec-8f77dced1dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:28.546765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:28.599297 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1104/2218] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:08:28.610662 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979155d-bc0f-45dc-bc7b-a8ba835094ff admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:28.612549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1979155d-bc0f-45dc-bc7b-a8ba835094ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:28.682217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979155d-bc0f-45dc-bc7b-a8ba835094ff admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:28.687946 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd53012-282f-4b50-86d8-b3b8b389d381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:28.688099 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd53012-282f-4b50-86d8-b3b8b389d381 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:28.688415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd53012-282f-4b50-86d8-b3b8b389d381 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:28.688687 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd53012-282f-4b50-86d8-b3b8b389d381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:28.699206 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd53012-282f-4b50-86d8-b3b8b389d381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:28.700679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd53012-282f-4b50-86d8-b3b8b389d381 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:28.713846 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1115/2219] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:08:29.070705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375c260-5494-4132-85ec-8f77dced1dd9 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:29.072140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4375c260-5494-4132-85ec-8f77dced1dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:29.086602 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375c260-5494-4132-85ec-8f77dced1dd9 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:29.091784 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae9e0b-8119-48e2-a15b-406a0bf02bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:29.092653 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae9e0b-8119-48e2-a15b-406a0bf02bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:29.093479 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae9e0b-8119-48e2-a15b-406a0bf02bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:29.093806 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae9e0b-8119-48e2-a15b-406a0bf02bdd admin admin] PATH_INFO: `/v3/projects/7f298bb1d04f4810a14fff57d0504cd3` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:29.095231 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae9e0b-8119-48e2-a15b-406a0bf02bdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f298bb1d04f4810a14fff57d0504cd3)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:29.097201 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae9e0b-8119-48e2-a15b-406a0bf02bdd admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:29.147023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1bae9e0b-8119-48e2-a15b-406a0bf02bdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f298bb1d04f4810a14fff57d0504cd3', 'request_id': 'req-1bae9e0b-8119-48e2-a15b-406a0bf02bdd'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:29.152838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1bae9e0b-8119-48e2-a15b-406a0bf02bdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f298bb1d04f4810a14fff57d0504cd3', 'request_id': 'req-1bae9e0b-8119-48e2-a15b-406a0bf02bdd'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:29.159793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1bae9e0b-8119-48e2-a15b-406a0bf02bdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f298bb1d04f4810a14fff57d0504cd3', 'request_id': 'req-1bae9e0b-8119-48e2-a15b-406a0bf02bdd'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:29.176473 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1bae9e0b-8119-48e2-a15b-406a0bf02bdd admin admin] The token cache is being invalidate because project 7f298bb1d04f4810a14fff57d0504cd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:08:29.176764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1bae9e0b-8119-48e2-a15b-406a0bf02bdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:29.177387 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1bae9e0b-8119-48e2-a15b-406a0bf02bdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:29.178947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1105/2220] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:08:29 2022] DELETE /identity/v3/projects/7f298bb1d04f4810a14fff57d0504cd3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:08:29.182897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd53012-282f-4b50-86d8-b3b8b389d381 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:29.192661 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd53012-282f-4b50-86d8-b3b8b389d381 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:29.253474 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e52f11-7484-47cf-82b2-95e9f1b85dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:29.254420 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e52f11-7484-47cf-82b2-95e9f1b85dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:29.254701 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e52f11-7484-47cf-82b2-95e9f1b85dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:29.254987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e52f11-7484-47cf-82b2-95e9f1b85dae admin admin] PATH_INFO: `/v3/users/1f740c999a3b4e82b6a0cd58bb37d8d7` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:29.256315 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e52f11-7484-47cf-82b2-95e9f1b85dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f740c999a3b4e82b6a0cd58bb37d8d7)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:29.258386 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e52f11-7484-47cf-82b2-95e9f1b85dae admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:29.299630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:29.312255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-60e52f11-7484-47cf-82b2-95e9f1b85dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f740c999a3b4e82b6a0cd58bb37d8d7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:29.312902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-60e52f11-7484-47cf-82b2-95e9f1b85dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f740c999a3b4e82b6a0cd58bb37d8d7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:29.319992 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-60e52f11-7484-47cf-82b2-95e9f1b85dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f740c999a3b4e82b6a0cd58bb37d8d7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:29.327698 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-60e52f11-7484-47cf-82b2-95e9f1b85dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f740c999a3b4e82b6a0cd58bb37d8d7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:29.340879 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-60e52f11-7484-47cf-82b2-95e9f1b85dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f740c999a3b4e82b6a0cd58bb37d8d7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:29.347957 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1116/2221] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:08:29 2022] DELETE /identity/v3/users/1f740c999a3b4e82b6a0cd58bb37d8d7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:08:29.632544 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae9e0b-8119-48e2-a15b-406a0bf02bdd admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:29.634929 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1bae9e0b-8119-48e2-a15b-406a0bf02bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:29.663668 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae9e0b-8119-48e2-a15b-406a0bf02bdd admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:29.728170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e96ce0-0724-4994-845e-d8e14e372a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:29.729043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e96ce0-0724-4994-845e-d8e14e372a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:29.729326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e96ce0-0724-4994-845e-d8e14e372a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:29.729603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e96ce0-0724-4994-845e-d8e14e372a4d admin admin] PATH_INFO: `/v3/projects/eded06aaf4ce41b08faa960da3f08638` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:29.730842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e96ce0-0724-4994-845e-d8e14e372a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eded06aaf4ce41b08faa960da3f08638)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:29.732752 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e96ce0-0724-4994-845e-d8e14e372a4d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:29.784422 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:29.789478 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-65e96ce0-0724-4994-845e-d8e14e372a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eded06aaf4ce41b08faa960da3f08638', 'request_id': 'req-65e96ce0-0724-4994-845e-d8e14e372a4d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:29.797292 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-65e96ce0-0724-4994-845e-d8e14e372a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eded06aaf4ce41b08faa960da3f08638', 'request_id': 'req-65e96ce0-0724-4994-845e-d8e14e372a4d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:29.804353 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-65e96ce0-0724-4994-845e-d8e14e372a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eded06aaf4ce41b08faa960da3f08638', 'request_id': 'req-65e96ce0-0724-4994-845e-d8e14e372a4d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:29.818826 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-65e96ce0-0724-4994-845e-d8e14e372a4d admin admin] The token cache is being invalidate because project eded06aaf4ce41b08faa960da3f08638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:08:29.819272 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-65e96ce0-0724-4994-845e-d8e14e372a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:29.820051 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-65e96ce0-0724-4994-845e-d8e14e372a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:29.821716 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1106/2222] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:08:29 2022] DELETE /identity/v3/projects/eded06aaf4ce41b08faa960da3f08638 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:08:29.825680 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e52f11-7484-47cf-82b2-95e9f1b85dae admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:29.827700 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-60e52f11-7484-47cf-82b2-95e9f1b85dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:29.841230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e52f11-7484-47cf-82b2-95e9f1b85dae admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:29.902250 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ec03c-dedb-4473-9f9d-c8facf65da89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:29.903209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ec03c-dedb-4473-9f9d-c8facf65da89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:29.903568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ec03c-dedb-4473-9f9d-c8facf65da89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:29.903909 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ec03c-dedb-4473-9f9d-c8facf65da89 admin admin] PATH_INFO: `/v3/users/f8b9e4f71a964d9eb3181141ed749b9b` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:29.905288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ec03c-dedb-4473-9f9d-c8facf65da89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b9e4f71a964d9eb3181141ed749b9b)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:29.907382 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ec03c-dedb-4473-9f9d-c8facf65da89 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:29.974272 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a3ec03c-dedb-4473-9f9d-c8facf65da89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b9e4f71a964d9eb3181141ed749b9b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:29.975300 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a3ec03c-dedb-4473-9f9d-c8facf65da89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b9e4f71a964d9eb3181141ed749b9b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:29.984639 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a3ec03c-dedb-4473-9f9d-c8facf65da89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b9e4f71a964d9eb3181141ed749b9b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:29.995830 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a3ec03c-dedb-4473-9f9d-c8facf65da89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b9e4f71a964d9eb3181141ed749b9b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:30.014268 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a3ec03c-dedb-4473-9f9d-c8facf65da89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b9e4f71a964d9eb3181141ed749b9b'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:30.022546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1117/2223] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:08:29 2022] DELETE /identity/v3/users/f8b9e4f71a964d9eb3181141ed749b9b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:08:30.342697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e96ce0-0724-4994-845e-d8e14e372a4d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:30.344693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-65e96ce0-0724-4994-845e-d8e14e372a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:30.363085 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e96ce0-0724-4994-845e-d8e14e372a4d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:30.440793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ee770-036a-4033-a406-217e3d216fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:30.441691 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ee770-036a-4033-a406-217e3d216fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:30.441999 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ee770-036a-4033-a406-217e3d216fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:30.442319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ee770-036a-4033-a406-217e3d216fb2 admin admin] PATH_INFO: `/v3/projects/6e1c1e487015447ba3fc0c526bce1999` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:30.443560 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ee770-036a-4033-a406-217e3d216fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e1c1e487015447ba3fc0c526bce1999)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:30.445464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ee770-036a-4033-a406-217e3d216fb2 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:30.508488 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e60ee770-036a-4033-a406-217e3d216fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e1c1e487015447ba3fc0c526bce1999', 'request_id': 'req-e60ee770-036a-4033-a406-217e3d216fb2'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:30.514840 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e60ee770-036a-4033-a406-217e3d216fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e1c1e487015447ba3fc0c526bce1999', 'request_id': 'req-e60ee770-036a-4033-a406-217e3d216fb2'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:30.521606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e60ee770-036a-4033-a406-217e3d216fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e1c1e487015447ba3fc0c526bce1999', 'request_id': 'req-e60ee770-036a-4033-a406-217e3d216fb2'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:30.536192 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e60ee770-036a-4033-a406-217e3d216fb2 admin admin] The token cache is being invalidate because project 6e1c1e487015447ba3fc0c526bce1999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:08:30.536481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e60ee770-036a-4033-a406-217e3d216fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:30.537115 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e60ee770-036a-4033-a406-217e3d216fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:30.538893 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1107/2224] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:08:30 2022] DELETE /identity/v3/projects/6e1c1e487015447ba3fc0c526bce1999 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:08:30.543754 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151939ab-9972-4882-b489-392a825b8bca None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:30.544232 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151939ab-9972-4882-b489-392a825b8bca None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:30.544476 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151939ab-9972-4882-b489-392a825b8bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:30.564377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-151939ab-9972-4882-b489-392a825b8bca None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:08:30.565599 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-151939ab-9972-4882-b489-392a825b8bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:30.594577 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:30.632299 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1118/2225] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:08:30.639861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6d899-940a-47ff-be46-062569648768 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:30.640481 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6d899-940a-47ff-be46-062569648768 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:30.640571 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6d899-940a-47ff-be46-062569648768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:30.659990 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e4a6d899-940a-47ff-be46-062569648768 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:08:30.661507 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e4a6d899-940a-47ff-be46-062569648768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:30.671678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1108/2226] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:08:30.675863 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151939ab-9972-4882-b489-392a825b8bca None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:30.686244 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151939ab-9972-4882-b489-392a825b8bca None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:30.690833 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7edf7f-43e0-4b55-805c-f1884cd57125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:30.691487 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7edf7f-43e0-4b55-805c-f1884cd57125 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:30.691770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7edf7f-43e0-4b55-805c-f1884cd57125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:30.692047 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7edf7f-43e0-4b55-805c-f1884cd57125 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:30.693017 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7edf7f-43e0-4b55-805c-f1884cd57125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:08:30.693304 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7edf7f-43e0-4b55-805c-f1884cd57125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:30.694977 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7edf7f-43e0-4b55-805c-f1884cd57125 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:30.706952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1119/2227] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:08:30.711168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6d899-940a-47ff-be46-062569648768 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:30.722095 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6d899-940a-47ff-be46-062569648768 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:30.727224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffffa8a-308c-4b5d-a5b0-f9a189efca69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:30.727958 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffffa8a-308c-4b5d-a5b0-f9a189efca69 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:30.728313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffffa8a-308c-4b5d-a5b0-f9a189efca69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:30.728648 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffffa8a-308c-4b5d-a5b0-f9a189efca69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:30.729388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffffa8a-308c-4b5d-a5b0-f9a189efca69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:30.731409 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffffa8a-308c-4b5d-a5b0-f9a189efca69 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:30.762463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1109/2228] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:08:30 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:08:30.767106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7edf7f-43e0-4b55-805c-f1884cd57125 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:30.784674 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7edf7f-43e0-4b55-805c-f1884cd57125 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:30.847655 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01618f63-b5af-4e0d-8596-6e5ba808bd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:30.848238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01618f63-b5af-4e0d-8596-6e5ba808bd0e admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:30.848526 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01618f63-b5af-4e0d-8596-6e5ba808bd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:30.848806 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01618f63-b5af-4e0d-8596-6e5ba808bd0e admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:30.849504 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01618f63-b5af-4e0d-8596-6e5ba808bd0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:30.851457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01618f63-b5af-4e0d-8596-6e5ba808bd0e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:30.872259 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1120/2229] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:08:30 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:08:30.876325 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffffa8a-308c-4b5d-a5b0-f9a189efca69 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:30.886766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffffa8a-308c-4b5d-a5b0-f9a189efca69 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:30.891527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bded06d-3b3b-4222-a63d-8a0fcb183f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:30.892191 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bded06d-3b3b-4222-a63d-8a0fcb183f07 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:30.892479 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bded06d-3b3b-4222-a63d-8a0fcb183f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:30.892755 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bded06d-3b3b-4222-a63d-8a0fcb183f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:30.893482 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bded06d-3b3b-4222-a63d-8a0fcb183f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:30.895126 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bded06d-3b3b-4222-a63d-8a0fcb183f07 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:30.906232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1110/2230] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:08:30.910100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01618f63-b5af-4e0d-8596-6e5ba808bd0e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:30.920500 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01618f63-b5af-4e0d-8596-6e5ba808bd0e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:30.926306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1a592-d59a-4082-9c3d-425cb94dc857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:30.926968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1a592-d59a-4082-9c3d-425cb94dc857 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:30.927252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1a592-d59a-4082-9c3d-425cb94dc857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:30.927528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1a592-d59a-4082-9c3d-425cb94dc857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:30.928256 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1a592-d59a-4082-9c3d-425cb94dc857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:30.929881 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1a592-d59a-4082-9c3d-425cb94dc857 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:30.940393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1121/2231] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:08:30.944566 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bded06d-3b3b-4222-a63d-8a0fcb183f07 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:30.954969 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bded06d-3b3b-4222-a63d-8a0fcb183f07 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:30.960170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff6cde-b4e3-4c9a-b0d1-ac51ad08b4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:30.961045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff6cde-b4e3-4c9a-b0d1-ac51ad08b4b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:30.961333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff6cde-b4e3-4c9a-b0d1-ac51ad08b4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:30.961606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff6cde-b4e3-4c9a-b0d1-ac51ad08b4b2 admin admin] PATH_INFO: `/v3/projects/bf514a57f964458693cccf96e14ff209/users/93e18568775b4ce0ad5e36570f34664f/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:30.977006 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff6cde-b4e3-4c9a-b0d1-ac51ad08b4b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf514a57f964458693cccf96e14ff209, user_id=93e18568775b4ce0ad5e36570f34664f, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:30.979685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff6cde-b4e3-4c9a-b0d1-ac51ad08b4b2 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:30.988041 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:30.994977 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1111/2232] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:08:30 2022] PUT /identity/v3/projects/bf514a57f964458693cccf96e14ff209/users/93e18568775b4ce0ad5e36570f34664f/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:08:31.006488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f7210-71bb-4925-8314-0f52deb409e4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:31.006782 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f7210-71bb-4925-8314-0f52deb409e4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:31.007061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f7210-71bb-4925-8314-0f52deb409e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:31.034851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-ea7f7210-71bb-4925-8314-0f52deb409e4 None None] MFA Rules not processed for user `93e18568775b4ce0ad5e36570f34664f`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:08:31.036126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ea7f7210-71bb-4925-8314-0f52deb409e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:31.100794 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1122/2233] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:08:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:08:31.113584 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff6cde-b4e3-4c9a-b0d1-ac51ad08b4b2 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:31.115321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-41ff6cde-b4e3-4c9a-b0d1-ac51ad08b4b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:31.183106 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff6cde-b4e3-4c9a-b0d1-ac51ad08b4b2 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:31.187596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548c82d-aa6f-44e2-8619-9dc2bbde6398 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:31.188261 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548c82d-aa6f-44e2-8619-9dc2bbde6398 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:31.188541 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548c82d-aa6f-44e2-8619-9dc2bbde6398 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:31.188813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548c82d-aa6f-44e2-8619-9dc2bbde6398 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:31.198784 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548c82d-aa6f-44e2-8619-9dc2bbde6398 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:31.200233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548c82d-aa6f-44e2-8619-9dc2bbde6398 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:31.209849 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1112/2234] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:08:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:08:34.962679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f7210-71bb-4925-8314-0f52deb409e4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:35.007744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:35.045532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f7210-71bb-4925-8314-0f52deb409e4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:35.052092 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6532983-8dad-464c-a7aa-584b258d196c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:35.053067 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6532983-8dad-464c-a7aa-584b258d196c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:35.053528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6532983-8dad-464c-a7aa-584b258d196c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:35.054020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6532983-8dad-464c-a7aa-584b258d196c admin admin] PATH_INFO: `/v3/users/93e18568775b4ce0ad5e36570f34664f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:35.055591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6532983-8dad-464c-a7aa-584b258d196c admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e18568775b4ce0ad5e36570f34664f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:35.057826 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6532983-8dad-464c-a7aa-584b258d196c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:35.125829 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b6532983-8dad-464c-a7aa-584b258d196c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e18568775b4ce0ad5e36570f34664f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:35.127136 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b6532983-8dad-464c-a7aa-584b258d196c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e18568775b4ce0ad5e36570f34664f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:35.144644 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b6532983-8dad-464c-a7aa-584b258d196c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e18568775b4ce0ad5e36570f34664f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:35.154045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b6532983-8dad-464c-a7aa-584b258d196c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e18568775b4ce0ad5e36570f34664f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:35.170594 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b6532983-8dad-464c-a7aa-584b258d196c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e18568775b4ce0ad5e36570f34664f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:35.181735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1123/2235] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:08:34 2022] DELETE /identity/v3/users/93e18568775b4ce0ad5e36570f34664f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:08:35.183597 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239a730-7cbf-4bd5-b456-2b8c53cecfbb None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:35.184115 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239a730-7cbf-4bd5-b456-2b8c53cecfbb None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:35.184208 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239a730-7cbf-4bd5-b456-2b8c53cecfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:35.205272 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9239a730-7cbf-4bd5-b456-2b8c53cecfbb None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:08:35.206943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9239a730-7cbf-4bd5-b456-2b8c53cecfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:35.283043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1113/2236] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:08:35.316949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6532983-8dad-464c-a7aa-584b258d196c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:35.318793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b6532983-8dad-464c-a7aa-584b258d196c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:35.404890 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6532983-8dad-464c-a7aa-584b258d196c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:35.408908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ca597-0b82-41db-8796-7de656273bd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:35.409519 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ca597-0b82-41db-8796-7de656273bd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:35.409851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ca597-0b82-41db-8796-7de656273bd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:35.410191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ca597-0b82-41db-8796-7de656273bd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:35.420333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ca597-0b82-41db-8796-7de656273bd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:35.421931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ca597-0b82-41db-8796-7de656273bd3 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:35.435244 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1124/2237] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:08:35.798625 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239a730-7cbf-4bd5-b456-2b8c53cecfbb None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:35.800108 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9239a730-7cbf-4bd5-b456-2b8c53cecfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:35.814588 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239a730-7cbf-4bd5-b456-2b8c53cecfbb None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:35.819356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb27d8b-e441-4456-8567-cb0550d9dcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:35.820240 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb27d8b-e441-4456-8567-cb0550d9dcd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:35.820527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb27d8b-e441-4456-8567-cb0550d9dcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:35.820799 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb27d8b-e441-4456-8567-cb0550d9dcd3 admin admin] PATH_INFO: `/v3/projects/bf514a57f964458693cccf96e14ff209` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:35.822062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb27d8b-e441-4456-8567-cb0550d9dcd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf514a57f964458693cccf96e14ff209)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:35.823988 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb27d8b-e441-4456-8567-cb0550d9dcd3 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:35.873564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-cbb27d8b-e441-4456-8567-cb0550d9dcd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf514a57f964458693cccf96e14ff209', 'request_id': 'req-cbb27d8b-e441-4456-8567-cb0550d9dcd3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:35.879972 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-cbb27d8b-e441-4456-8567-cb0550d9dcd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf514a57f964458693cccf96e14ff209', 'request_id': 'req-cbb27d8b-e441-4456-8567-cb0550d9dcd3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:35.886127 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-cbb27d8b-e441-4456-8567-cb0550d9dcd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf514a57f964458693cccf96e14ff209', 'request_id': 'req-cbb27d8b-e441-4456-8567-cb0550d9dcd3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:35.900002 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-cbb27d8b-e441-4456-8567-cb0550d9dcd3 admin admin] The token cache is being invalidate because project bf514a57f964458693cccf96e14ff209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:08:35.900332 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-cbb27d8b-e441-4456-8567-cb0550d9dcd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:35.901040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-cbb27d8b-e441-4456-8567-cb0550d9dcd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:08:35.902819 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1114/2238] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:08:35 2022] DELETE /identity/v3/projects/bf514a57f964458693cccf96e14ff209 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:08:45.428429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=67,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:45.896333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:46.226686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df60d2-e4df-415e-a219-a264869ecb7a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:46.227070 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df60d2-e4df-415e-a219-a264869ecb7a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:46.227357 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df60d2-e4df-415e-a219-a264869ecb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:46.246106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-37df60d2-e4df-415e-a219-a264869ecb7a None None] MFA Rules not processed for user `5e28c0ca22d143eebe6fc93f85442a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:08:46.247339 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-37df60d2-e4df-415e-a219-a264869ecb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:46.308209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1125/2239] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:08:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:08:51.346400 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb27d8b-e441-4456-8567-cb0550d9dcd3 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:08:51.347850 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cbb27d8b-e441-4456-8567-cb0550d9dcd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:51.408643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb27d8b-e441-4456-8567-cb0550d9dcd3 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:08:51.412311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de9121-13ec-4fe9-bc6b-d548298c25b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:08:51.413001 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de9121-13ec-4fe9-bc6b-d548298c25b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:08:51.413285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de9121-13ec-4fe9-bc6b-d548298c25b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:08:51.413562 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de9121-13ec-4fe9-bc6b-d548298c25b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:08:51.415410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c1de9121-13ec-4fe9-bc6b-d548298c25b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:08:51.485424 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de9121-13ec-4fe9-bc6b-d548298c25b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:08:51.486920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de9121-13ec-4fe9-bc6b-d548298c25b4 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:08:51.497302 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1115/2240] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:08:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:08:56.301318 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=25 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:09:01.493064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=50 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:09:53.934307 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df60d2-e4df-415e-a219-a264869ecb7a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:09:53.935884 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-37df60d2-e4df-415e-a219-a264869ecb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:09:54.029187 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df60d2-e4df-415e-a219-a264869ecb7a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:09:54.034409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047321f-b19a-40f7-926b-7ce3147920ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bebc8414d01a40c8ab34afa9b1312a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:09:54.035766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047321f-b19a-40f7-926b-7ce3147920ec service placement] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:09:54.036043 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047321f-b19a-40f7-926b-7ce3147920ec service placement] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:09:54.036316 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047321f-b19a-40f7-926b-7ce3147920ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:09:54.038162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8047321f-b19a-40f7-926b-7ce3147920ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:09:54.049524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047321f-b19a-40f7-926b-7ce3147920ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:09:54.051251 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047321f-b19a-40f7-926b-7ce3147920ec service placement] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:09:54.061407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1126/2241] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:09:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:10:04.056854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=41 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:10:20.916345 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604093e2-ddf4-4d11-9a21-f67100a99cd8 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:10:20.916908 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604093e2-ddf4-4d11-9a21-f67100a99cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:10:20.916908 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604093e2-ddf4-4d11-9a21-f67100a99cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:10:20.936347 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-604093e2-ddf4-4d11-9a21-f67100a99cd8 None None] MFA Rules not processed for user `01881ccdf756480b8fcc1ac599fdf905`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:10:20.937597 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-604093e2-ddf4-4d11-9a21-f67100a99cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:10:20.999150 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1116/2242] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:10:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:10:30.992215 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=25 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:10:52.424147 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047321f-b19a-40f7-926b-7ce3147920ec service placement] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:10:52.434120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047321f-b19a-40f7-926b-7ce3147920ec service placement] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:10:52.437674 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b6495-c483-46fb-9834-e60f1455be8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:10:52.438314 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b6495-c483-46fb-9834-e60f1455be8c service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:10:52.438594 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b6495-c483-46fb-9834-e60f1455be8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:10:52.438867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b6495-c483-46fb-9834-e60f1455be8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:10:52.440614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-530b6495-c483-46fb-9834-e60f1455be8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:10:52.516295 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b6495-c483-46fb-9834-e60f1455be8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:10:52.517800 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b6495-c483-46fb-9834-e60f1455be8c service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:10:52.528900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1127/2243] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:10:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:10:53.709204 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604093e2-ddf4-4d11-9a21-f67100a99cd8 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:10:53.710792 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-604093e2-ddf4-4d11-9a21-f67100a99cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:10:53.724626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604093e2-ddf4-4d11-9a21-f67100a99cd8 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:10:53.728418 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301913d-94df-46bc-9e8b-d55ef1679a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:10:53.729095 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301913d-94df-46bc-9e8b-d55ef1679a00 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:10:53.729383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301913d-94df-46bc-9e8b-d55ef1679a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:10:53.729709 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301913d-94df-46bc-9e8b-d55ef1679a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:10:53.732100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1301913d-94df-46bc-9e8b-d55ef1679a00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:10:53.755742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301913d-94df-46bc-9e8b-d55ef1679a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:10:53.758060 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301913d-94df-46bc-9e8b-d55ef1679a00 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:10:53.777823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1117/2244] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:10:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:11:02.523985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=34 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:11:03.768455 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=6 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:11:05.463897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b6495-c483-46fb-9834-e60f1455be8c service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:11:05.465583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-530b6495-c483-46fb-9834-e60f1455be8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:11:05.527819 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b6495-c483-46fb-9834-e60f1455be8c service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:11:05.531499 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48329a-74d0-45d3-a981-4a44ba6f84e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:11:05.532173 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48329a-74d0-45d3-a981-4a44ba6f84e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:05.532460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48329a-74d0-45d3-a981-4a44ba6f84e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:05.532738 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48329a-74d0-45d3-a981-4a44ba6f84e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:05.534611 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4c48329a-74d0-45d3-a981-4a44ba6f84e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:11:05.546513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48329a-74d0-45d3-a981-4a44ba6f84e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:11:05.547989 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48329a-74d0-45d3-a981-4a44ba6f84e6 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:11:05.559362 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1128/2245] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:11:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:11:08.492864 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5880d90-d0c9-4c54-bc8b-05c8af5d27b7 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:08.494001 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5880d90-d0c9-4c54-bc8b-05c8af5d27b7 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:08.494001 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5880d90-d0c9-4c54-bc8b-05c8af5d27b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:08.557239 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b5880d90-d0c9-4c54-bc8b-05c8af5d27b7 None None] MFA Rules not processed for user `9692d55c8c924544a1bff62054731ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:11:08.558655 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b5880d90-d0c9-4c54-bc8b-05c8af5d27b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:11:08.640519 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1118/2246] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 18 17:11:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:11:08.696456 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48329a-74d0-45d3-a981-4a44ba6f84e6 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:11:08.697934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4c48329a-74d0-45d3-a981-4a44ba6f84e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:11:08.803319 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48329a-74d0-45d3-a981-4a44ba6f84e6 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:11:08.811611 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcddae9-01e2-4962-93b6-735e33024bf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b712c7f5fce54fe2a89d63863f3845f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:11:08.812745 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcddae9-01e2-4962-93b6-735e33024bf7 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:08.813223 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcddae9-01e2-4962-93b6-735e33024bf7 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:08.813516 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcddae9-01e2-4962-93b6-735e33024bf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:08.829360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcddae9-01e2-4962-93b6-735e33024bf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:11:08.833164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcddae9-01e2-4962-93b6-735e33024bf7 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:11:08.849127 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1129/2247] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 18 17:11:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 18 17:11:18.637089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=40 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:11:18.842629 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=67 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:11:21.264500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5880d90-d0c9-4c54-bc8b-05c8af5d27b7 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:11:21.279412 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5880d90-d0c9-4c54-bc8b-05c8af5d27b7 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:11:21.283134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a1162-35c2-4b8d-9fb8-13210de4a968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:11:21.283800 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a1162-35c2-4b8d-9fb8-13210de4a968 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:21.284086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a1162-35c2-4b8d-9fb8-13210de4a968 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:21.284366 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a1162-35c2-4b8d-9fb8-13210de4a968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:21.288549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-495a1162-35c2-4b8d-9fb8-13210de4a968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:11:21.299148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a1162-35c2-4b8d-9fb8-13210de4a968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:11:21.300958 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a1162-35c2-4b8d-9fb8-13210de4a968 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:11:21.309952 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1119/2248] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:11:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:11:24.815054 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcddae9-01e2-4962-93b6-735e33024bf7 service swift] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:11:24.831745 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcddae9-01e2-4962-93b6-735e33024bf7 service swift] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:11:24.838037 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40db344-91b3-4dd5-8286-2ffb408c24f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:11:24.838960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40db344-91b3-4dd5-8286-2ffb408c24f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:24.839287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40db344-91b3-4dd5-8286-2ffb408c24f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:24.839567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40db344-91b3-4dd5-8286-2ffb408c24f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:24.842091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d40db344-91b3-4dd5-8286-2ffb408c24f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:11:24.854670 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40db344-91b3-4dd5-8286-2ffb408c24f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:11:24.856332 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40db344-91b3-4dd5-8286-2ffb408c24f2 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:11:24.866435 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1130/2249] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:11:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:11:24.981024 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcbc4c-47a1-499d-8012-a2394161d1f7 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:24.982050 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcbc4c-47a1-499d-8012-a2394161d1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:24.982630 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcbc4c-47a1-499d-8012-a2394161d1f7 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:24.985269 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1120/2250] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 18 17:11:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:11:24.992217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e44150-89f6-4f11-a704-b45831b6af7d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:24.992850 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e44150-89f6-4f11-a704-b45831b6af7d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:24.993519 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e44150-89f6-4f11-a704-b45831b6af7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:25.037717 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c4e44150-89f6-4f11-a704-b45831b6af7d None None] MFA Rules not processed for user `c9e3c0ef5ed943d183b064f383fc01f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:11:25.039080 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c4e44150-89f6-4f11-a704-b45831b6af7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:11:25.049957 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1131/2251] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 18 17:11:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:11:25.068105 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcbc4c-47a1-499d-8012-a2394161d1f7 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:11:25.071431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1cdcbc4c-47a1-499d-8012-a2394161d1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:11:25.167323 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcbc4c-47a1-499d-8012-a2394161d1f7 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:11:25.170930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c77fc-b0bf-4278-976f-acfa31741061 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d69d99d980744fba12a6b38586e7bf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:11:25.171574 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c77fc-b0bf-4278-976f-acfa31741061 service glance] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:25.171852 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c77fc-b0bf-4278-976f-acfa31741061 service glance] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:25.172129 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c77fc-b0bf-4278-976f-acfa31741061 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:25.183391 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c77fc-b0bf-4278-976f-acfa31741061 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:11:25.184828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c77fc-b0bf-4278-976f-acfa31741061 service glance] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:11:25.195920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1121/2252] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:11:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:11:25.267851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b3071-0f6e-4504-9ab8-19e498b93c57 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:25.268143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b3071-0f6e-4504-9ab8-19e498b93c57 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:25.268421 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b3071-0f6e-4504-9ab8-19e498b93c57 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:25.269846 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1132/2253] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 18 17:11:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:11:25.275170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38784f43-94d9-4bf2-b3bb-57e0ad4db1c2 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:25.275469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38784f43-94d9-4bf2-b3bb-57e0ad4db1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:25.275774 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38784f43-94d9-4bf2-b3bb-57e0ad4db1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:25.294813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-38784f43-94d9-4bf2-b3bb-57e0ad4db1c2 None None] MFA Rules not processed for user `d35f21c5cc7c433882eb5fbe9a8072f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:11:25.296040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-38784f43-94d9-4bf2-b3bb-57e0ad4db1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:11:25.303260 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1122/2254] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 18 17:11:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:11:25.314952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b3071-0f6e-4504-9ab8-19e498b93c57 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:11:25.326837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b3071-0f6e-4504-9ab8-19e498b93c57 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:11:25.330677 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401e99b-c4ba-400f-a2b1-017f9f46bd76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:11:25.331381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401e99b-c4ba-400f-a2b1-017f9f46bd76 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:25.331708 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401e99b-c4ba-400f-a2b1-017f9f46bd76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:25.332120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401e99b-c4ba-400f-a2b1-017f9f46bd76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:25.339790 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401e99b-c4ba-400f-a2b1-017f9f46bd76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:11:25.341492 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401e99b-c4ba-400f-a2b1-017f9f46bd76 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:11:25.350508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1133/2255] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:11:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:11:25.440366 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97280908-b944-4230-858c-1bb57af31e95 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:25.440659 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97280908-b944-4230-858c-1bb57af31e95 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:25.440940 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97280908-b944-4230-858c-1bb57af31e95 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:25.442934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1123/2256] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 18 17:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 18 17:11:25.448215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e109625-5e13-472a-b178-aa1b40d056cb None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:25.448504 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e109625-5e13-472a-b178-aa1b40d056cb None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:25.448779 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e109625-5e13-472a-b178-aa1b40d056cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:25.469046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9e109625-5e13-472a-b178-aa1b40d056cb None None] MFA Rules not processed for user `c9e3c0ef5ed943d183b064f383fc01f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:11:25.470174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9e109625-5e13-472a-b178-aa1b40d056cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:11:25.480301 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1134/2257] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 18 17:11:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:11:25.491103 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97280908-b944-4230-858c-1bb57af31e95 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:11:25.502429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97280908-b944-4230-858c-1bb57af31e95 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:11:25.506395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beffa35-9384-4755-9cbf-4f338707f01f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:11:25.507033 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beffa35-9384-4755-9cbf-4f338707f01f service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:25.507322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beffa35-9384-4755-9cbf-4f338707f01f service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:25.507602 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beffa35-9384-4755-9cbf-4f338707f01f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:25.518092 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beffa35-9384-4755-9cbf-4f338707f01f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:11:25.520042 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beffa35-9384-4755-9cbf-4f338707f01f service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:11:25.531032 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1124/2258] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:11:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:11:25.594304 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e109625-5e13-472a-b178-aa1b40d056cb None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:11:25.595684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9e109625-5e13-472a-b178-aa1b40d056cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:11:25.610115 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e109625-5e13-472a-b178-aa1b40d056cb None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:11:25.615202 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ef662-5456-4b1e-af80-01dcd4ac0f37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bebc8414d01a40c8ab34afa9b1312a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:11:25.615830 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ef662-5456-4b1e-af80-01dcd4ac0f37 service placement] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:25.616111 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ef662-5456-4b1e-af80-01dcd4ac0f37 service placement] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:25.616385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ef662-5456-4b1e-af80-01dcd4ac0f37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:25.618157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0f6ef662-5456-4b1e-af80-01dcd4ac0f37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:11:25.629149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ef662-5456-4b1e-af80-01dcd4ac0f37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:11:25.630809 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ef662-5456-4b1e-af80-01dcd4ac0f37 service placement] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:11:25.640476 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1135/2259] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:11:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:11:28.669425 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130d04b-ff0b-4cb7-ac10-3ba88fac7825 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:28.669976 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130d04b-ff0b-4cb7-ac10-3ba88fac7825 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:28.669976 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130d04b-ff0b-4cb7-ac10-3ba88fac7825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:28.689893 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f130d04b-ff0b-4cb7-ac10-3ba88fac7825 None None] MFA Rules not processed for user `5e28c0ca22d143eebe6fc93f85442a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:11:28.691135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f130d04b-ff0b-4cb7-ac10-3ba88fac7825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:11:28.698966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1125/2260] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:11:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:11:29.856810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511df2bf-03c0-46c0-8761-737cf0d1aa57 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:29.857385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511df2bf-03c0-46c0-8761-737cf0d1aa57 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:29.857477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511df2bf-03c0-46c0-8761-737cf0d1aa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:29.882628 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-511df2bf-03c0-46c0-8761-737cf0d1aa57 None None] MFA Rules not processed for user `9692d55c8c924544a1bff62054731ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:11:29.883885 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-511df2bf-03c0-46c0-8761-737cf0d1aa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:11:29.891604 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1136/2261] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 18 17:11:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:11:29.908474 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130d04b-ff0b-4cb7-ac10-3ba88fac7825 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:11:29.921799 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130d04b-ff0b-4cb7-ac10-3ba88fac7825 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:11:29.927105 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14c42a-c5e8-4475-994c-a7cfb98c5d9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b712c7f5fce54fe2a89d63863f3845f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:11:29.927730 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14c42a-c5e8-4475-994c-a7cfb98c5d9e service swift] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:29.928009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14c42a-c5e8-4475-994c-a7cfb98c5d9e service swift] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:29.928284 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14c42a-c5e8-4475-994c-a7cfb98c5d9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:29.937598 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14c42a-c5e8-4475-994c-a7cfb98c5d9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:11:29.939238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14c42a-c5e8-4475-994c-a7cfb98c5d9e service swift] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:11:29.948313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1126/2262] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 18 17:11:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 18 17:11:39.872192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=33 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:11:39.944676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=59 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:11:52.921997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511df2bf-03c0-46c0-8761-737cf0d1aa57 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:11:52.923436 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-511df2bf-03c0-46c0-8761-737cf0d1aa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:11:52.940638 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511df2bf-03c0-46c0-8761-737cf0d1aa57 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:11:52.950036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b7e9b-5929-4904-9381-7df2b1583f75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:11:52.950707 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b7e9b-5929-4904-9381-7df2b1583f75 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:52.950996 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b7e9b-5929-4904-9381-7df2b1583f75 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:52.951279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b7e9b-5929-4904-9381-7df2b1583f75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:52.953095 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ec3b7e9b-5929-4904-9381-7df2b1583f75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:11:52.966505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b7e9b-5929-4904-9381-7df2b1583f75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:11:52.968099 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b7e9b-5929-4904-9381-7df2b1583f75 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:11:52.978763 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1137/2263] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:11:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:11:56.363464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14c42a-c5e8-4475-994c-a7cfb98c5d9e service swift] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:11:56.375331 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14c42a-c5e8-4475-994c-a7cfb98c5d9e service swift] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:11:56.380802 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b03be-d977-489e-a381-2ad49254e3df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:11:56.381502 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b03be-d977-489e-a381-2ad49254e3df service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:11:56.381866 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b03be-d977-489e-a381-2ad49254e3df service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:11:56.382148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b03be-d977-489e-a381-2ad49254e3df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:11:56.384050 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-129b03be-d977-489e-a381-2ad49254e3df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:11:56.444141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b03be-d977-489e-a381-2ad49254e3df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:11:56.445862 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b03be-d977-489e-a381-2ad49254e3df service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:11:56.455173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1127/2264] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:11:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:12:02.297847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b7e9b-5929-4904-9381-7df2b1583f75 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:12:02.309358 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b7e9b-5929-4904-9381-7df2b1583f75 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:12:02.319129 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8414a6-4fc8-41ea-ba2e-e268a5246923 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:12:02.320133 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8414a6-4fc8-41ea-ba2e-e268a5246923 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:12:02.320607 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8414a6-4fc8-41ea-ba2e-e268a5246923 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:12:02.321187 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8414a6-4fc8-41ea-ba2e-e268a5246923 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:12:02.323269 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ec8414a6-4fc8-41ea-ba2e-e268a5246923 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:12:02.342890 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8414a6-4fc8-41ea-ba2e-e268a5246923 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:12:02.345186 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8414a6-4fc8-41ea-ba2e-e268a5246923 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:12:02.362127 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1138/2265] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:12:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:12:05.221012 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c872a-9c7a-4784-8328-eb0b6d28a36b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:12:05.221540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c872a-9c7a-4784-8328-eb0b6d28a36b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:12:05.221686 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c872a-9c7a-4784-8328-eb0b6d28a36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:12:05.241782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2e6c872a-9c7a-4784-8328-eb0b6d28a36b None None] MFA Rules not processed for user `9692d55c8c924544a1bff62054731ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:12:05.243039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2e6c872a-9c7a-4784-8328-eb0b6d28a36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:12:05.255050 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1128/2266] 10.222.0.49 () {58 vars in 967 bytes} [Wed May 18 17:12:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:12:05.269445 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8414a6-4fc8-41ea-ba2e-e268a5246923 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:12:05.282767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8414a6-4fc8-41ea-ba2e-e268a5246923 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:12:05.289517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cad14f-43b6-4c54-bf1e-1fc67085d9ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b712c7f5fce54fe2a89d63863f3845f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:12:05.290664 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cad14f-43b6-4c54-bf1e-1fc67085d9ea service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:12:05.290664 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cad14f-43b6-4c54-bf1e-1fc67085d9ea service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:12:05.290864 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cad14f-43b6-4c54-bf1e-1fc67085d9ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:12:05.304695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cad14f-43b6-4c54-bf1e-1fc67085d9ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:12:05.306357 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cad14f-43b6-4c54-bf1e-1fc67085d9ea service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:12:05.315584 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1139/2267] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 18 17:12:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 17:12:09.141489 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6260a41-ec82-4f6b-87a6-4d131db8de19 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:12:09.142478 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6260a41-ec82-4f6b-87a6-4d131db8de19 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:12:09.142478 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6260a41-ec82-4f6b-87a6-4d131db8de19 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:12:09.145264 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1129/2268] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 18 17:12:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:12:09.151655 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f32bf-b26c-4dd7-ad79-ccb39f2a589d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:12:09.152239 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f32bf-b26c-4dd7-ad79-ccb39f2a589d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:12:09.152239 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f32bf-b26c-4dd7-ad79-ccb39f2a589d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:12:09.175695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-cb0f32bf-b26c-4dd7-ad79-ccb39f2a589d None None] MFA Rules not processed for user `d35f21c5cc7c433882eb5fbe9a8072f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:12:09.178882 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cb0f32bf-b26c-4dd7-ad79-ccb39f2a589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:12:09.188828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1140/2269] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 18 17:12:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:12:09.209594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6260a41-ec82-4f6b-87a6-4d131db8de19 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:12:09.228845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6260a41-ec82-4f6b-87a6-4d131db8de19 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:12:09.232593 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e337bc-2bdf-400f-a0e3-57fab4679823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:12:09.233450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e337bc-2bdf-400f-a0e3-57fab4679823 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:12:09.233915 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e337bc-2bdf-400f-a0e3-57fab4679823 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:12:09.234300 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e337bc-2bdf-400f-a0e3-57fab4679823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:12:09.245135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e337bc-2bdf-400f-a0e3-57fab4679823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:12:09.246950 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e337bc-2bdf-400f-a0e3-57fab4679823 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:12:09.256844 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1130/2270] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:12:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:12:09.354233 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc2417-83cb-4486-9806-c8a375280717 None None] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:12:09.354629 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc2417-83cb-4486-9806-c8a375280717 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:12:09.355087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc2417-83cb-4486-9806-c8a375280717 None None] PATH_INFO: `/` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:12:09.356684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1141/2271] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 18 17:12:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:12:09.363230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a64b3-6f44-49df-aebb-f5e2a9281f73 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:12:09.363589 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a64b3-6f44-49df-aebb-f5e2a9281f73 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:12:09.363795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a64b3-6f44-49df-aebb-f5e2a9281f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:12:09.385903 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-971a64b3-6f44-49df-aebb-f5e2a9281f73 None None] MFA Rules not processed for user `c9e3c0ef5ed943d183b064f383fc01f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:12:09.387163 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-971a64b3-6f44-49df-aebb-f5e2a9281f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:12:09.398821 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1131/2272] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 18 17:12:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:12:09.410538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc2417-83cb-4486-9806-c8a375280717 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:12:09.430782 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc2417-83cb-4486-9806-c8a375280717 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:12:09.437760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a209cf-c294-4b71-aa86-6e4558592866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:12:09.438465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a209cf-c294-4b71-aa86-6e4558592866 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:12:09.438743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a209cf-c294-4b71-aa86-6e4558592866 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:12:09.439019 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a209cf-c294-4b71-aa86-6e4558592866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:12:09.451056 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a209cf-c294-4b71-aa86-6e4558592866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:12:09.452521 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a209cf-c294-4b71-aa86-6e4558592866 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:12:09.465307 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1142/2273] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:12:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:12:19.380061 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=40 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:12:19.459972 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=27 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:12:34.257287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a64b3-6f44-49df-aebb-f5e2a9281f73 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:12:34.268874 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a64b3-6f44-49df-aebb-f5e2a9281f73 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:12:34.281603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbc439-470a-4696-92a6-46fbfd2e7c2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:12:34.282309 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbc439-470a-4696-92a6-46fbfd2e7c2f service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:12:34.282618 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbc439-470a-4696-92a6-46fbfd2e7c2f service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:12:34.282879 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbc439-470a-4696-92a6-46fbfd2e7c2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:12:34.284742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cefbc439-470a-4696-92a6-46fbfd2e7c2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:12:34.297276 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbc439-470a-4696-92a6-46fbfd2e7c2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:12:34.298991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbc439-470a-4696-92a6-46fbfd2e7c2f service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:12:34.309299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1132/2274] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:12:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:12:37.847078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a209cf-c294-4b71-aa86-6e4558592866 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:12:37.870914 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a209cf-c294-4b71-aa86-6e4558592866 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:12:37.888206 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd3982-bd59-4fc1-a04c-9c05d2733287 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:12:37.889817 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd3982-bd59-4fc1-a04c-9c05d2733287 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:12:37.890533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd3982-bd59-4fc1-a04c-9c05d2733287 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:12:37.891035 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd3982-bd59-4fc1-a04c-9c05d2733287 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:12:37.894065 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-84cd3982-bd59-4fc1-a04c-9c05d2733287 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:12:37.919584 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd3982-bd59-4fc1-a04c-9c05d2733287 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:12:37.921561 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd3982-bd59-4fc1-a04c-9c05d2733287 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:12:37.936547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1143/2275] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:12:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:12:44.304763 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=6 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:12:47.930562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:12:48.350850 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607bd95-cc11-497f-8d0c-55f7cd0981e3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:12:48.351340 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607bd95-cc11-497f-8d0c-55f7cd0981e3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:12:48.351460 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607bd95-cc11-497f-8d0c-55f7cd0981e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:12:48.368909 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c607bd95-cc11-497f-8d0c-55f7cd0981e3 None None] MFA Rules not processed for user `01881ccdf756480b8fcc1ac599fdf905`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:12:48.370184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c607bd95-cc11-497f-8d0c-55f7cd0981e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:12:48.377198 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1133/2276] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:12:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:12:48.690773 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd3982-bd59-4fc1-a04c-9c05d2733287 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:12:48.700917 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd3982-bd59-4fc1-a04c-9c05d2733287 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:12:48.704542 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3623ed-e36a-4162-8609-aaaa6876e49d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:12:48.705175 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3623ed-e36a-4162-8609-aaaa6876e49d service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:12:48.705458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3623ed-e36a-4162-8609-aaaa6876e49d service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:12:48.705776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3623ed-e36a-4162-8609-aaaa6876e49d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:12:48.707579 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4d3623ed-e36a-4162-8609-aaaa6876e49d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:12:48.717398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3623ed-e36a-4162-8609-aaaa6876e49d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:12:48.718848 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3623ed-e36a-4162-8609-aaaa6876e49d service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:12:48.726955 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1144/2277] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:12:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:12:58.363557 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:12:58.723235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:36.793123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607bd95-cc11-497f-8d0c-55f7cd0981e3 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:36.794674 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c607bd95-cc11-497f-8d0c-55f7cd0981e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:36.810692 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607bd95-cc11-497f-8d0c-55f7cd0981e3 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:36.816168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce8088-8678-4096-a36d-a77e6a248257 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:36.816813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce8088-8678-4096-a36d-a77e6a248257 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:36.817100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce8088-8678-4096-a36d-a77e6a248257 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:36.817402 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce8088-8678-4096-a36d-a77e6a248257 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:36.819203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-edce8088-8678-4096-a36d-a77e6a248257 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:36.889113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce8088-8678-4096-a36d-a77e6a248257 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:36.890778 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce8088-8678-4096-a36d-a77e6a248257 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:36.900503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1134/2278] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:13:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:13:42.631004 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3623ed-e36a-4162-8609-aaaa6876e49d service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:42.640363 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3623ed-e36a-4162-8609-aaaa6876e49d service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:42.644251 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4727dd-44e6-431f-bd99-acd35241364b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:42.644937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4727dd-44e6-431f-bd99-acd35241364b service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:42.645221 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4727dd-44e6-431f-bd99-acd35241364b service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:42.645544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4727dd-44e6-431f-bd99-acd35241364b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:42.647634 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4a4727dd-44e6-431f-bd99-acd35241364b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:42.723576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4727dd-44e6-431f-bd99-acd35241364b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:42.725095 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4727dd-44e6-431f-bd99-acd35241364b service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:42.736202 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1145/2279] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:13:46.471290 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce8088-8678-4096-a36d-a77e6a248257 service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:46.473538 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-edce8088-8678-4096-a36d-a77e6a248257 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:46.492385 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce8088-8678-4096-a36d-a77e6a248257 service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:46.497740 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11044a71-a0db-4605-938e-b8260244d3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:46.498861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11044a71-a0db-4605-938e-b8260244d3f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:46.499147 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11044a71-a0db-4605-938e-b8260244d3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:46.499472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11044a71-a0db-4605-938e-b8260244d3f3 admin admin] PATH_INFO: `/v3/users/5e28c0ca22d143eebe6fc93f85442a7f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:46.500882 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11044a71-a0db-4605-938e-b8260244d3f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e28c0ca22d143eebe6fc93f85442a7f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:46.502940 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11044a71-a0db-4605-938e-b8260244d3f3 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:46.558503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-11044a71-a0db-4605-938e-b8260244d3f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e28c0ca22d143eebe6fc93f85442a7f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:46.566156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-11044a71-a0db-4605-938e-b8260244d3f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e28c0ca22d143eebe6fc93f85442a7f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:46.588899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-11044a71-a0db-4605-938e-b8260244d3f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e28c0ca22d143eebe6fc93f85442a7f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:46.590094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-11044a71-a0db-4605-938e-b8260244d3f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e28c0ca22d143eebe6fc93f85442a7f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:46.590915 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-11044a71-a0db-4605-938e-b8260244d3f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e28c0ca22d143eebe6fc93f85442a7f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:46.591691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00912d-c989-4ef3-b639-69ecbdc9f0b9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:46.592132 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00912d-c989-4ef3-b639-69ecbdc9f0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:46.592256 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00912d-c989-4ef3-b639-69ecbdc9f0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:46.605992 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1135/2280] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:13:46 2022] DELETE /identity/v3/users/5e28c0ca22d143eebe6fc93f85442a7f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:13:46.611576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8e00912d-c989-4ef3-b639-69ecbdc9f0b9 None None] MFA Rules not processed for user `13b9ab17cee74e8282cd86a37eaf19aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:13:46.612823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8e00912d-c989-4ef3-b639-69ecbdc9f0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:46.675762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1146/2281] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:13:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:13:46.845163 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11044a71-a0db-4605-938e-b8260244d3f3 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:46.846785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-11044a71-a0db-4605-938e-b8260244d3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:46.928422 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11044a71-a0db-4605-938e-b8260244d3f3 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:46.933017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88ba5e-3b51-4cbc-b0b3-12604c8e9721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:46.933928 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88ba5e-3b51-4cbc-b0b3-12604c8e9721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:46.934220 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88ba5e-3b51-4cbc-b0b3-12604c8e9721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:46.934499 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88ba5e-3b51-4cbc-b0b3-12604c8e9721 admin admin] PATH_INFO: `/v3/projects/af6df110a2604ba3adab104ec1decf4c` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:46.935707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88ba5e-3b51-4cbc-b0b3-12604c8e9721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af6df110a2604ba3adab104ec1decf4c)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:46.937639 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88ba5e-3b51-4cbc-b0b3-12604c8e9721 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:46.951950 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:46.996379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0f88ba5e-3b51-4cbc-b0b3-12604c8e9721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af6df110a2604ba3adab104ec1decf4c', 'request_id': 'req-0f88ba5e-3b51-4cbc-b0b3-12604c8e9721'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:47.006060 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0f88ba5e-3b51-4cbc-b0b3-12604c8e9721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af6df110a2604ba3adab104ec1decf4c', 'request_id': 'req-0f88ba5e-3b51-4cbc-b0b3-12604c8e9721'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:47.014383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0f88ba5e-3b51-4cbc-b0b3-12604c8e9721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af6df110a2604ba3adab104ec1decf4c', 'request_id': 'req-0f88ba5e-3b51-4cbc-b0b3-12604c8e9721'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:47.035450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0f88ba5e-3b51-4cbc-b0b3-12604c8e9721 admin admin] The token cache is being invalidate because project af6df110a2604ba3adab104ec1decf4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:13:47.035740 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0f88ba5e-3b51-4cbc-b0b3-12604c8e9721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:47.036507 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0f88ba5e-3b51-4cbc-b0b3-12604c8e9721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:47.042018 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1136/2282] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:13:46 2022] DELETE /identity/v3/projects/af6df110a2604ba3adab104ec1decf4c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:13:47.043916 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e3f3d-6a96-418d-b280-608f818969c8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:47.044279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e3f3d-6a96-418d-b280-608f818969c8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:47.044634 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e3f3d-6a96-418d-b280-608f818969c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:47.065399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4d6e3f3d-6a96-418d-b280-608f818969c8 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:13:47.068291 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4d6e3f3d-6a96-418d-b280-608f818969c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:47.141331 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1147/2283] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:13:47.148766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e96a6e-08a7-4c4e-a7a7-fdcfba86f028 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:47.149056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e96a6e-08a7-4c4e-a7a7-fdcfba86f028 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:47.149340 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e96a6e-08a7-4c4e-a7a7-fdcfba86f028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:47.169084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-82e96a6e-08a7-4c4e-a7a7-fdcfba86f028 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:13:47.170364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-82e96a6e-08a7-4c4e-a7a7-fdcfba86f028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:47.179492 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1137/2284] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:13:47.183481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e3f3d-6a96-418d-b280-608f818969c8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:47.194265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e3f3d-6a96-418d-b280-608f818969c8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:47.199055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef56597-a1e6-4f84-9733-c9f2a3884e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:47.199715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef56597-a1e6-4f84-9733-c9f2a3884e41 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:47.199997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef56597-a1e6-4f84-9733-c9f2a3884e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:47.200274 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef56597-a1e6-4f84-9733-c9f2a3884e41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:47.201485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef56597-a1e6-4f84-9733-c9f2a3884e41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:13:47.201838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef56597-a1e6-4f84-9733-c9f2a3884e41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:47.203455 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef56597-a1e6-4f84-9733-c9f2a3884e41 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:47.219779 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1148/2285] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:13:47.221045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e96a6e-08a7-4c4e-a7a7-fdcfba86f028 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:47.231564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e96a6e-08a7-4c4e-a7a7-fdcfba86f028 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:47.238221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efaeb4-b521-4b1f-b795-cfe68a7e5145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:47.238221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efaeb4-b521-4b1f-b795-cfe68a7e5145 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:47.238221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efaeb4-b521-4b1f-b795-cfe68a7e5145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:47.238221 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efaeb4-b521-4b1f-b795-cfe68a7e5145 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:47.238618 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efaeb4-b521-4b1f-b795-cfe68a7e5145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:47.240885 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efaeb4-b521-4b1f-b795-cfe68a7e5145 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:47.298280 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1138/2286] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:13:47 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:13:47.304786 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef56597-a1e6-4f84-9733-c9f2a3884e41 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:47.322488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef56597-a1e6-4f84-9733-c9f2a3884e41 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:47.351089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:47.396049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5334f0-0be8-416f-89d5-2966b2ff8fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:47.396930 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5334f0-0be8-416f-89d5-2966b2ff8fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:47.397262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5334f0-0be8-416f-89d5-2966b2ff8fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:47.397538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5334f0-0be8-416f-89d5-2966b2ff8fb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:47.398265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5334f0-0be8-416f-89d5-2966b2ff8fb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:47.400207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5334f0-0be8-416f-89d5-2966b2ff8fb9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:47.431493 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1149/2287] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:13:47 2022] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:13:47.436199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efaeb4-b521-4b1f-b795-cfe68a7e5145 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:47.458709 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efaeb4-b521-4b1f-b795-cfe68a7e5145 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:47.464389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47c56b-b195-474c-b48b-dd3f4c230779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:47.465073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47c56b-b195-474c-b48b-dd3f4c230779 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:47.465359 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47c56b-b195-474c-b48b-dd3f4c230779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:47.465638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47c56b-b195-474c-b48b-dd3f4c230779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:47.466669 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47c56b-b195-474c-b48b-dd3f4c230779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:47.468281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47c56b-b195-474c-b48b-dd3f4c230779 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:47.481080 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1139/2288] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:13:47.484734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5334f0-0be8-416f-89d5-2966b2ff8fb9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:47.495655 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5334f0-0be8-416f-89d5-2966b2ff8fb9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:47.500674 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361af915-2718-4fe6-ac11-e10ba0a7f603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:47.501424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361af915-2718-4fe6-ac11-e10ba0a7f603 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:47.501828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361af915-2718-4fe6-ac11-e10ba0a7f603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:47.502180 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361af915-2718-4fe6-ac11-e10ba0a7f603 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:47.502991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361af915-2718-4fe6-ac11-e10ba0a7f603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:47.505377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361af915-2718-4fe6-ac11-e10ba0a7f603 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:47.516723 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1150/2289] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:13:47.523458 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47c56b-b195-474c-b48b-dd3f4c230779 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:47.536971 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47c56b-b195-474c-b48b-dd3f4c230779 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:47.542456 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d834e-64c6-49d2-b5a5-43c1572f48d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:47.543842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d834e-64c6-49d2-b5a5-43c1572f48d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:47.543842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d834e-64c6-49d2-b5a5-43c1572f48d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:47.544084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d834e-64c6-49d2-b5a5-43c1572f48d9 admin admin] PATH_INFO: `/v3/projects/038c8eb68961412e9fc3d943fc0bd264/users/a9f667a797ba4a9897a5ccc1eb77952d/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:47.559566 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d834e-64c6-49d2-b5a5-43c1572f48d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=038c8eb68961412e9fc3d943fc0bd264, user_id=a9f667a797ba4a9897a5ccc1eb77952d, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:47.562288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d834e-64c6-49d2-b5a5-43c1572f48d9 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:47.577366 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1140/2290] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:13:47 2022] PUT /identity/v3/projects/038c8eb68961412e9fc3d943fc0bd264/users/a9f667a797ba4a9897a5ccc1eb77952d/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:13:47.588439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32175b-6c8f-48c7-97af-7fc926257874 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:47.588756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32175b-6c8f-48c7-97af-7fc926257874 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:47.589000 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32175b-6c8f-48c7-97af-7fc926257874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:47.618262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-cd32175b-6c8f-48c7-97af-7fc926257874 None None] MFA Rules not processed for user `a9f667a797ba4a9897a5ccc1eb77952d`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:13:47.619496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cd32175b-6c8f-48c7-97af-7fc926257874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:47.696815 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1151/2291] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:13:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:13:47.701626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d834e-64c6-49d2-b5a5-43c1572f48d9 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:47.771110 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d834e-64c6-49d2-b5a5-43c1572f48d9 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:47.776752 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5144b-016a-45c2-a99c-53c7d5617a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:47.777730 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5144b-016a-45c2-a99c-53c7d5617a3d admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:47.778157 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5144b-016a-45c2-a99c-53c7d5617a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:47.778517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5144b-016a-45c2-a99c-53c7d5617a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:47.779554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5144b-016a-45c2-a99c-53c7d5617a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:47.781753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5144b-016a-45c2-a99c-53c7d5617a3d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:47.814882 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1141/2292] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:13:47 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:13:47.816199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32175b-6c8f-48c7-97af-7fc926257874 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:47.831920 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32175b-6c8f-48c7-97af-7fc926257874 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:47.906599 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc708c-988d-4a1d-b779-69754c4e8870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:47.907309 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc708c-988d-4a1d-b779-69754c4e8870 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:47.907591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc708c-988d-4a1d-b779-69754c4e8870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:47.907865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc708c-988d-4a1d-b779-69754c4e8870 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:47.908568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc708c-988d-4a1d-b779-69754c4e8870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:47.910713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc708c-988d-4a1d-b779-69754c4e8870 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:47.932266 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1152/2293] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:13:47 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:13:47.936574 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5144b-016a-45c2-a99c-53c7d5617a3d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:47.947400 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5144b-016a-45c2-a99c-53c7d5617a3d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:47.952017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faa713-3de4-4dd6-ad9d-0659ecef2f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:47.952676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faa713-3de4-4dd6-ad9d-0659ecef2f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:47.952959 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faa713-3de4-4dd6-ad9d-0659ecef2f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:47.953234 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faa713-3de4-4dd6-ad9d-0659ecef2f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:47.953988 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50faa713-3de4-4dd6-ad9d-0659ecef2f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:47.955576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50faa713-3de4-4dd6-ad9d-0659ecef2f6b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:47.967212 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1142/2294] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:13:47.971507 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc708c-988d-4a1d-b779-69754c4e8870 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:47.983355 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc708c-988d-4a1d-b779-69754c4e8870 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:47.988301 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344afb25-bd1e-4ad4-8923-9063587d0500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:47.989262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344afb25-bd1e-4ad4-8923-9063587d0500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:47.989545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344afb25-bd1e-4ad4-8923-9063587d0500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:47.990086 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344afb25-bd1e-4ad4-8923-9063587d0500 admin admin] PATH_INFO: `/v3/projects/03b875532c2246df91a1bbd74e39cf32/users/b7a2bbcf64c44a0b8ac95fae590213b0/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:48.006843 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344afb25-bd1e-4ad4-8923-9063587d0500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b875532c2246df91a1bbd74e39cf32, user_id=b7a2bbcf64c44a0b8ac95fae590213b0, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:48.009541 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344afb25-bd1e-4ad4-8923-9063587d0500 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:48.019578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:48.025709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1153/2295] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:13:47 2022] PUT /identity/v3/projects/03b875532c2246df91a1bbd74e39cf32/users/b7a2bbcf64c44a0b8ac95fae590213b0/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:13:48.030075 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faa713-3de4-4dd6-ad9d-0659ecef2f6b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:48.035850 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:48.043813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faa713-3de4-4dd6-ad9d-0659ecef2f6b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:48.110833 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be228445-856e-4115-852e-4746a100b544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:48.111513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be228445-856e-4115-852e-4746a100b544 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:48.111800 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be228445-856e-4115-852e-4746a100b544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:48.112080 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be228445-856e-4115-852e-4746a100b544 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:48.112821 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be228445-856e-4115-852e-4746a100b544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:48.114560 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be228445-856e-4115-852e-4746a100b544 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:48.124795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1143/2296] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:13:48.128923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344afb25-bd1e-4ad4-8923-9063587d0500 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:48.140044 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344afb25-bd1e-4ad4-8923-9063587d0500 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:48.149597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9df56d-b5f6-4908-b058-2aec8081d4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:48.150617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9df56d-b5f6-4908-b058-2aec8081d4fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:48.150880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9df56d-b5f6-4908-b058-2aec8081d4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:48.151106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9df56d-b5f6-4908-b058-2aec8081d4fe admin admin] PATH_INFO: `/v3/projects/03b875532c2246df91a1bbd74e39cf32/users/b7a2bbcf64c44a0b8ac95fae590213b0/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:48.153108 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9df56d-b5f6-4908-b058-2aec8081d4fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b875532c2246df91a1bbd74e39cf32, user_id=b7a2bbcf64c44a0b8ac95fae590213b0, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:48.155894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9df56d-b5f6-4908-b058-2aec8081d4fe admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:48.167415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1154/2297] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:13:48 2022] PUT /identity/v3/projects/03b875532c2246df91a1bbd74e39cf32/users/b7a2bbcf64c44a0b8ac95fae590213b0/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:13:48.178875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2e9c4-f98b-4784-ac05-a95d891dd4be None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:48.179169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2e9c4-f98b-4784-ac05-a95d891dd4be None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:48.179454 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2e9c4-f98b-4784-ac05-a95d891dd4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:48.206839 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-67e2e9c4-f98b-4784-ac05-a95d891dd4be None None] MFA Rules not processed for user `b7a2bbcf64c44a0b8ac95fae590213b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:13:48.208802 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-67e2e9c4-f98b-4784-ac05-a95d891dd4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:48.278279 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1144/2298] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:13:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:13:48.290759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9df56d-b5f6-4908-b058-2aec8081d4fe admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:48.292479 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6c9df56d-b5f6-4908-b058-2aec8081d4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:48.355873 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9df56d-b5f6-4908-b058-2aec8081d4fe admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:48.359761 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491cab2-eca4-49bf-9373-4392382c865f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:48.360388 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491cab2-eca4-49bf-9373-4392382c865f service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:48.360674 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491cab2-eca4-49bf-9373-4392382c865f service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:48.360957 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491cab2-eca4-49bf-9373-4392382c865f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:48.371640 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491cab2-eca4-49bf-9373-4392382c865f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:48.373226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491cab2-eca4-49bf-9373-4392382c865f service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:48.385509 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1155/2299] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:13:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:13:48.782119 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2e9c4-f98b-4784-ac05-a95d891dd4be None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:48.792038 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2e9c4-f98b-4784-ac05-a95d891dd4be None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:48.796752 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322a39c-9e80-4836-ad9e-a70e7122e243 tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a2bbcf64c44a0b8ac95fae590213b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03b875532c2246df91a1bbd74e39cf32', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:48.797475 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322a39c-9e80-4836-ad9e-a70e7122e243 tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:48.797899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322a39c-9e80-4836-ad9e-a70e7122e243 tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:48.798281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c322a39c-9e80-4836-ad9e-a70e7122e243 tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:48.798933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322a39c-9e80-4836-ad9e-a70e7122e243 tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:13:48.799250 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322a39c-9e80-4836-ad9e-a70e7122e243 tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:48.800875 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c322a39c-9e80-4836-ad9e-a70e7122e243 tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:48.812999 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1145/2300] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:13:48.817120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491cab2-eca4-49bf-9373-4392382c865f service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:48.826856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491cab2-eca4-49bf-9373-4392382c865f service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:48.831538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2b757-f7f6-4667-8247-807260b513ce tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a2bbcf64c44a0b8ac95fae590213b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03b875532c2246df91a1bbd74e39cf32', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:48.832192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2b757-f7f6-4667-8247-807260b513ce tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:48.833159 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2b757-f7f6-4667-8247-807260b513ce tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:48.833624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2b757-f7f6-4667-8247-807260b513ce tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:48.834468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2b757-f7f6-4667-8247-807260b513ce tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:48.836376 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2b757-f7f6-4667-8247-807260b513ce tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:48.862646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1156/2301] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:13:48 2022] POST /identity/v3/projects => generated 355 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:13:48.866837 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322a39c-9e80-4836-ad9e-a70e7122e243 tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:48.876787 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c322a39c-9e80-4836-ad9e-a70e7122e243 tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:48.939345 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31baa58a-4d4a-4183-8f29-176957d0c19d tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a2bbcf64c44a0b8ac95fae590213b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03b875532c2246df91a1bbd74e39cf32', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:48.940218 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31baa58a-4d4a-4183-8f29-176957d0c19d tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:48.940412 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31baa58a-4d4a-4183-8f29-176957d0c19d tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:48.940765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31baa58a-4d4a-4183-8f29-176957d0c19d tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:48.941515 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31baa58a-4d4a-4183-8f29-176957d0c19d tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:13:48.941853 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31baa58a-4d4a-4183-8f29-176957d0c19d tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:48.944352 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31baa58a-4d4a-4183-8f29-176957d0c19d tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:48.960821 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1146/2302] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:13:48.995026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2b757-f7f6-4667-8247-807260b513ce tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:49.006673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2b757-f7f6-4667-8247-807260b513ce tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:49.011373 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a10fa-6e8a-4863-aa3c-04223a3e53dc tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7a2bbcf64c44a0b8ac95fae590213b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '03b875532c2246df91a1bbd74e39cf32', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:49.012263 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a10fa-6e8a-4863-aa3c-04223a3e53dc tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:49.012552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a10fa-6e8a-4863-aa3c-04223a3e53dc tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:49.012827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a10fa-6e8a-4863-aa3c-04223a3e53dc tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] PATH_INFO: `/v3/projects/55f986fd11994121b2c87146530a90bc` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:49.014038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a10fa-6e8a-4863-aa3c-04223a3e53dc tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] RBAC: Authorizing `identity:delete_project(project_id=55f986fd11994121b2c87146530a90bc)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:49.015949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a10fa-6e8a-4863-aa3c-04223a3e53dc tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:49.077042 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-136a10fa-6e8a-4863-aa3c-04223a3e53dc tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55f986fd11994121b2c87146530a90bc', 'request_id': 'req-136a10fa-6e8a-4863-aa3c-04223a3e53dc'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:49.086124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-136a10fa-6e8a-4863-aa3c-04223a3e53dc tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55f986fd11994121b2c87146530a90bc', 'request_id': 'req-136a10fa-6e8a-4863-aa3c-04223a3e53dc'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:49.094519 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-136a10fa-6e8a-4863-aa3c-04223a3e53dc tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55f986fd11994121b2c87146530a90bc', 'request_id': 'req-136a10fa-6e8a-4863-aa3c-04223a3e53dc'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:49.106258 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-136a10fa-6e8a-4863-aa3c-04223a3e53dc tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] The token cache is being invalidate because project 55f986fd11994121b2c87146530a90bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:13:49.106588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-136a10fa-6e8a-4863-aa3c-04223a3e53dc tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:49.107224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-136a10fa-6e8a-4863-aa3c-04223a3e53dc tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:49.108793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1157/2303] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:13:48 2022] DELETE /identity/v3/projects/55f986fd11994121b2c87146530a90bc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:13:49.323450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31baa58a-4d4a-4183-8f29-176957d0c19d tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:49.325156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-31baa58a-4d4a-4183-8f29-176957d0c19d tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:49.332472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:49.408800 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31baa58a-4d4a-4183-8f29-176957d0c19d tempest-VolumeQuotaClassesTest-193986948 tempest-VolumeQuotaClassesTest-193986948-project-admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:49.483041 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81b55c-d88c-4655-9069-6ea3f388b9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:49.484762 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81b55c-d88c-4655-9069-6ea3f388b9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:49.485075 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81b55c-d88c-4655-9069-6ea3f388b9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:49.485350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81b55c-d88c-4655-9069-6ea3f388b9e3 admin admin] PATH_INFO: `/v3/users/a9f667a797ba4a9897a5ccc1eb77952d` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:49.486652 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81b55c-d88c-4655-9069-6ea3f388b9e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f667a797ba4a9897a5ccc1eb77952d)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:49.488656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81b55c-d88c-4655-9069-6ea3f388b9e3 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:49.554962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dd81b55c-d88c-4655-9069-6ea3f388b9e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f667a797ba4a9897a5ccc1eb77952d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:49.566628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dd81b55c-d88c-4655-9069-6ea3f388b9e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f667a797ba4a9897a5ccc1eb77952d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:49.587209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dd81b55c-d88c-4655-9069-6ea3f388b9e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f667a797ba4a9897a5ccc1eb77952d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:49.588404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dd81b55c-d88c-4655-9069-6ea3f388b9e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f667a797ba4a9897a5ccc1eb77952d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:49.589125 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dd81b55c-d88c-4655-9069-6ea3f388b9e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f667a797ba4a9897a5ccc1eb77952d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:49.605122 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1147/2304] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:13:49 2022] DELETE /identity/v3/users/a9f667a797ba4a9897a5ccc1eb77952d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:13:49.609830 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c581f06-983d-40ec-9a4c-a3efab444746 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:49.610128 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c581f06-983d-40ec-9a4c-a3efab444746 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:49.610411 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c581f06-983d-40ec-9a4c-a3efab444746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:49.634040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8c581f06-983d-40ec-9a4c-a3efab444746 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:13:49.635315 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8c581f06-983d-40ec-9a4c-a3efab444746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:49.690354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:49.711917 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1158/2305] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:13:49.743264 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81b55c-d88c-4655-9069-6ea3f388b9e3 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:49.745362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-dd81b55c-d88c-4655-9069-6ea3f388b9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:49.794689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:49.839693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81b55c-d88c-4655-9069-6ea3f388b9e3 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:49.844547 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2feb5fa-ae8d-439a-916f-e435eeb35502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:49.845235 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2feb5fa-ae8d-439a-916f-e435eeb35502 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:49.845737 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2feb5fa-ae8d-439a-916f-e435eeb35502 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:49.846018 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2feb5fa-ae8d-439a-916f-e435eeb35502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:49.859372 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2feb5fa-ae8d-439a-916f-e435eeb35502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:49.861258 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2feb5fa-ae8d-439a-916f-e435eeb35502 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:49.877095 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1148/2306] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:13:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:13:50.184270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c581f06-983d-40ec-9a4c-a3efab444746 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:50.186856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8c581f06-983d-40ec-9a4c-a3efab444746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:50.236053 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c581f06-983d-40ec-9a4c-a3efab444746 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:50.243388 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8eb33-2309-4c07-b130-278972a7f710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:50.244280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8eb33-2309-4c07-b130-278972a7f710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:50.244567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8eb33-2309-4c07-b130-278972a7f710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:50.244849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8eb33-2309-4c07-b130-278972a7f710 admin admin] PATH_INFO: `/v3/projects/038c8eb68961412e9fc3d943fc0bd264` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:50.246287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8eb33-2309-4c07-b130-278972a7f710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=038c8eb68961412e9fc3d943fc0bd264)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:50.248263 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8eb33-2309-4c07-b130-278972a7f710 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:50.325558 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7ed8eb33-2309-4c07-b130-278972a7f710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038c8eb68961412e9fc3d943fc0bd264', 'request_id': 'req-7ed8eb33-2309-4c07-b130-278972a7f710'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:50.336774 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7ed8eb33-2309-4c07-b130-278972a7f710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038c8eb68961412e9fc3d943fc0bd264', 'request_id': 'req-7ed8eb33-2309-4c07-b130-278972a7f710'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:50.345914 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7ed8eb33-2309-4c07-b130-278972a7f710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038c8eb68961412e9fc3d943fc0bd264', 'request_id': 'req-7ed8eb33-2309-4c07-b130-278972a7f710'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:50.359789 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7ed8eb33-2309-4c07-b130-278972a7f710 admin admin] The token cache is being invalidate because project 038c8eb68961412e9fc3d943fc0bd264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:13:50.360174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7ed8eb33-2309-4c07-b130-278972a7f710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:50.360913 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7ed8eb33-2309-4c07-b130-278972a7f710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:50.362884 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1159/2307] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:13:50 2022] DELETE /identity/v3/projects/038c8eb68961412e9fc3d943fc0bd264 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:13:50.366835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2feb5fa-ae8d-439a-916f-e435eeb35502 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:50.377539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2feb5fa-ae8d-439a-916f-e435eeb35502 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:50.468126 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce7836-20cf-4990-bf1d-354e5407c9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:50.469355 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce7836-20cf-4990-bf1d-354e5407c9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:50.469648 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce7836-20cf-4990-bf1d-354e5407c9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:50.470092 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce7836-20cf-4990-bf1d-354e5407c9ff admin admin] PATH_INFO: `/v3/users/b7a2bbcf64c44a0b8ac95fae590213b0` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:50.471407 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce7836-20cf-4990-bf1d-354e5407c9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7a2bbcf64c44a0b8ac95fae590213b0)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:50.473567 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce7836-20cf-4990-bf1d-354e5407c9ff admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:50.549415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1dce7836-20cf-4990-bf1d-354e5407c9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7a2bbcf64c44a0b8ac95fae590213b0'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:50.557902 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1dce7836-20cf-4990-bf1d-354e5407c9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7a2bbcf64c44a0b8ac95fae590213b0'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:50.582193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1dce7836-20cf-4990-bf1d-354e5407c9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7a2bbcf64c44a0b8ac95fae590213b0'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:50.585080 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1dce7836-20cf-4990-bf1d-354e5407c9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7a2bbcf64c44a0b8ac95fae590213b0'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:50.586717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1dce7836-20cf-4990-bf1d-354e5407c9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7a2bbcf64c44a0b8ac95fae590213b0'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:50.612825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1149/2308] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:13:50 2022] DELETE /identity/v3/users/b7a2bbcf64c44a0b8ac95fae590213b0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:13:51.057338 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8eb33-2309-4c07-b130-278972a7f710 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:51.058995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7ed8eb33-2309-4c07-b130-278972a7f710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:51.074132 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8eb33-2309-4c07-b130-278972a7f710 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:51.146978 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7895e3-112f-4b52-ad32-cdbb3dd2176f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:51.147842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7895e3-112f-4b52-ad32-cdbb3dd2176f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:51.148122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7895e3-112f-4b52-ad32-cdbb3dd2176f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:51.148395 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7895e3-112f-4b52-ad32-cdbb3dd2176f admin admin] PATH_INFO: `/v3/projects/03b875532c2246df91a1bbd74e39cf32` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:51.149567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7895e3-112f-4b52-ad32-cdbb3dd2176f admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b875532c2246df91a1bbd74e39cf32)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:51.151510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7895e3-112f-4b52-ad32-cdbb3dd2176f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:51.201905 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2c7895e3-112f-4b52-ad32-cdbb3dd2176f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b875532c2246df91a1bbd74e39cf32', 'request_id': 'req-2c7895e3-112f-4b52-ad32-cdbb3dd2176f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:51.209465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2c7895e3-112f-4b52-ad32-cdbb3dd2176f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b875532c2246df91a1bbd74e39cf32', 'request_id': 'req-2c7895e3-112f-4b52-ad32-cdbb3dd2176f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:51.215907 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2c7895e3-112f-4b52-ad32-cdbb3dd2176f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b875532c2246df91a1bbd74e39cf32', 'request_id': 'req-2c7895e3-112f-4b52-ad32-cdbb3dd2176f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:51.231639 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2c7895e3-112f-4b52-ad32-cdbb3dd2176f admin admin] The token cache is being invalidate because project 03b875532c2246df91a1bbd74e39cf32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:13:51.231923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2c7895e3-112f-4b52-ad32-cdbb3dd2176f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:51.232653 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2c7895e3-112f-4b52-ad32-cdbb3dd2176f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:13:51.234353 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1160/2309] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:13:51 2022] DELETE /identity/v3/projects/03b875532c2246df91a1bbd74e39cf32 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:13:51.239846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eb22c-7b33-4021-a9b7-a2c2738cbb65 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:51.240397 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eb22c-7b33-4021-a9b7-a2c2738cbb65 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:51.240397 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eb22c-7b33-4021-a9b7-a2c2738cbb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:51.258328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d24eb22c-7b33-4021-a9b7-a2c2738cbb65 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:13:51.259592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d24eb22c-7b33-4021-a9b7-a2c2738cbb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:51.310864 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:51.326655 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1150/2310] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:13:51.335191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739cbe8-0fdc-4244-8a77-93a018b6db8f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:51.335482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739cbe8-0fdc-4244-8a77-93a018b6db8f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:51.335759 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739cbe8-0fdc-4244-8a77-93a018b6db8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:51.343324 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:51.358307 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6739cbe8-0fdc-4244-8a77-93a018b6db8f None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:13:51.359543 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6739cbe8-0fdc-4244-8a77-93a018b6db8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:51.368691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1161/2311] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:13:51.373378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eb22c-7b33-4021-a9b7-a2c2738cbb65 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:51.384078 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eb22c-7b33-4021-a9b7-a2c2738cbb65 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:51.389750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6972284-4b2a-4c2c-8670-8621bc03fbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:51.390448 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6972284-4b2a-4c2c-8670-8621bc03fbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:51.390730 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6972284-4b2a-4c2c-8670-8621bc03fbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:51.391004 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6972284-4b2a-4c2c-8670-8621bc03fbf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:51.391741 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6972284-4b2a-4c2c-8670-8621bc03fbf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:13:51.392047 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6972284-4b2a-4c2c-8670-8621bc03fbf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:51.393695 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6972284-4b2a-4c2c-8670-8621bc03fbf0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:51.406651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1151/2312] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:13:51.411367 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739cbe8-0fdc-4244-8a77-93a018b6db8f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:51.422648 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739cbe8-0fdc-4244-8a77-93a018b6db8f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:51.429371 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f76fae-2ca2-4d05-a6c3-69dc6aca93d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:51.430772 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f76fae-2ca2-4d05-a6c3-69dc6aca93d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:51.431064 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f76fae-2ca2-4d05-a6c3-69dc6aca93d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:51.431747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f76fae-2ca2-4d05-a6c3-69dc6aca93d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:51.432725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f76fae-2ca2-4d05-a6c3-69dc6aca93d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:51.434748 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f76fae-2ca2-4d05-a6c3-69dc6aca93d3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:51.476902 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1162/2313] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:13:51 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:13:51.480800 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6972284-4b2a-4c2c-8670-8621bc03fbf0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:51.491730 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6972284-4b2a-4c2c-8670-8621bc03fbf0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:51.550341 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2675d-b50c-4b4e-b0e6-bec756977c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:51.551021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2675d-b50c-4b4e-b0e6-bec756977c1c admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:51.551315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2675d-b50c-4b4e-b0e6-bec756977c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:51.551649 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d2675d-b50c-4b4e-b0e6-bec756977c1c admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:51.552394 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2675d-b50c-4b4e-b0e6-bec756977c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:51.554325 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d2675d-b50c-4b4e-b0e6-bec756977c1c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:51.574311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1152/2314] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:13:51 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:13:51.578372 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f76fae-2ca2-4d05-a6c3-69dc6aca93d3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:51.589314 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f76fae-2ca2-4d05-a6c3-69dc6aca93d3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:51.594427 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211d2a9-5d91-457c-89c7-aab2b69b940d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:51.595084 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211d2a9-5d91-457c-89c7-aab2b69b940d admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:51.595370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211d2a9-5d91-457c-89c7-aab2b69b940d admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:51.595642 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211d2a9-5d91-457c-89c7-aab2b69b940d admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:51.596447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211d2a9-5d91-457c-89c7-aab2b69b940d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:51.597998 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211d2a9-5d91-457c-89c7-aab2b69b940d admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:51.609149 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1163/2315] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:13:51.613307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2675d-b50c-4b4e-b0e6-bec756977c1c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:51.623497 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d2675d-b50c-4b4e-b0e6-bec756977c1c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:51.628122 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa271aca-611d-4d26-9b10-bb812f319618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:51.628778 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa271aca-611d-4d26-9b10-bb812f319618 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:51.629061 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa271aca-611d-4d26-9b10-bb812f319618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:51.629338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa271aca-611d-4d26-9b10-bb812f319618 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:51.630316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa271aca-611d-4d26-9b10-bb812f319618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:51.631905 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa271aca-611d-4d26-9b10-bb812f319618 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:51.641956 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1153/2316] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:13:51.646551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211d2a9-5d91-457c-89c7-aab2b69b940d admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:51.657475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211d2a9-5d91-457c-89c7-aab2b69b940d admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:51.663274 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919ba8f-fdbf-4116-a462-222c031322fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:51.664154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919ba8f-fdbf-4116-a462-222c031322fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:51.664433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919ba8f-fdbf-4116-a462-222c031322fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:51.664705 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919ba8f-fdbf-4116-a462-222c031322fe admin admin] PATH_INFO: `/v3/projects/27fe86388e9f404f92b6b14f9abe8ce9/users/c6a5b88eb99a4bfcb55bd51398887e7e/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:51.679354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919ba8f-fdbf-4116-a462-222c031322fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=27fe86388e9f404f92b6b14f9abe8ce9, user_id=c6a5b88eb99a4bfcb55bd51398887e7e, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:51.682023 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919ba8f-fdbf-4116-a462-222c031322fe admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:51.695614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1164/2317] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:13:51 2022] PUT /identity/v3/projects/27fe86388e9f404f92b6b14f9abe8ce9/users/c6a5b88eb99a4bfcb55bd51398887e7e/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:13:51.700945 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c236d-c1bc-4324-b409-63e02bd4896b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:51.701242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c236d-c1bc-4324-b409-63e02bd4896b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:51.701529 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c236d-c1bc-4324-b409-63e02bd4896b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:51.720591 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-190c236d-c1bc-4324-b409-63e02bd4896b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:13:51.721852 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-190c236d-c1bc-4324-b409-63e02bd4896b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:51.784454 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1154/2318] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:13:51.795331 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919ba8f-fdbf-4116-a462-222c031322fe admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:51.797048 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1919ba8f-fdbf-4116-a462-222c031322fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:51.856969 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919ba8f-fdbf-4116-a462-222c031322fe admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:51.860695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57b79f-58aa-4356-9e89-b62693d3de39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:51.861344 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57b79f-58aa-4356-9e89-b62693d3de39 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:51.861631 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57b79f-58aa-4356-9e89-b62693d3de39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:51.861943 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57b79f-58aa-4356-9e89-b62693d3de39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:51.872566 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57b79f-58aa-4356-9e89-b62693d3de39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:51.874055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57b79f-58aa-4356-9e89-b62693d3de39 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:51.885268 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1165/2319] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:13:52.811393 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6f03a-1155-43c3-af4e-7259d6ec0265 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:52.811987 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6f03a-1155-43c3-af4e-7259d6ec0265 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:52.811987 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6f03a-1155-43c3-af4e-7259d6ec0265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:52.839479 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-89e6f03a-1155-43c3-af4e-7259d6ec0265 None None] MFA Rules not processed for user `c6a5b88eb99a4bfcb55bd51398887e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:13:52.840976 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-89e6f03a-1155-43c3-af4e-7259d6ec0265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:52.892764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:52.912693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1155/2320] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:13:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:13:52.917555 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57b79f-58aa-4356-9e89-b62693d3de39 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:52.928662 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57b79f-58aa-4356-9e89-b62693d3de39 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:52.933240 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435ab1c-d368-424b-bbe5-2d75c3a8143a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:52.933940 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435ab1c-d368-424b-bbe5-2d75c3a8143a admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:52.934225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435ab1c-d368-424b-bbe5-2d75c3a8143a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:52.934498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435ab1c-d368-424b-bbe5-2d75c3a8143a admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:52.935188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435ab1c-d368-424b-bbe5-2d75c3a8143a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:52.937089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435ab1c-d368-424b-bbe5-2d75c3a8143a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:52.969840 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1166/2321] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:13:52 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:13:52.970932 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6f03a-1155-43c3-af4e-7259d6ec0265 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:52.982948 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6f03a-1155-43c3-af4e-7259d6ec0265 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:53.040495 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3073fad-64f1-417c-8fb1-d7d6117f5ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:53.041173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3073fad-64f1-417c-8fb1-d7d6117f5ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:53.041458 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3073fad-64f1-417c-8fb1-d7d6117f5ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:53.041761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3073fad-64f1-417c-8fb1-d7d6117f5ae8 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:53.042865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3073fad-64f1-417c-8fb1-d7d6117f5ae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:53.044415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3073fad-64f1-417c-8fb1-d7d6117f5ae8 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:53.071943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1156/2322] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:13:52 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:13:53.072803 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435ab1c-d368-424b-bbe5-2d75c3a8143a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:53.090156 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435ab1c-d368-424b-bbe5-2d75c3a8143a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:53.096176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a42cf9-847f-4c3d-892a-8444964e5a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:53.096953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a42cf9-847f-4c3d-892a-8444964e5a88 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:53.097245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a42cf9-847f-4c3d-892a-8444964e5a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:53.097589 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a42cf9-847f-4c3d-892a-8444964e5a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:53.099071 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a42cf9-847f-4c3d-892a-8444964e5a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:53.100974 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a42cf9-847f-4c3d-892a-8444964e5a88 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:53.122207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1167/2323] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:13:53.126549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3073fad-64f1-417c-8fb1-d7d6117f5ae8 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:53.138260 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3073fad-64f1-417c-8fb1-d7d6117f5ae8 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:53.144077 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039fb60-bfe9-4527-a411-463c2573d138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:53.144969 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039fb60-bfe9-4527-a411-463c2573d138 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:53.145771 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039fb60-bfe9-4527-a411-463c2573d138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:53.146044 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039fb60-bfe9-4527-a411-463c2573d138 admin admin] PATH_INFO: `/v3/projects/9fc8afe3aa684423afd01eb58060d211/users/91c074c550844af58e87ecafb6a4df56/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:53.165439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039fb60-bfe9-4527-a411-463c2573d138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc8afe3aa684423afd01eb58060d211, user_id=91c074c550844af58e87ecafb6a4df56, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:53.168434 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039fb60-bfe9-4527-a411-463c2573d138 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:53.189072 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1157/2324] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:13:53 2022] PUT /identity/v3/projects/9fc8afe3aa684423afd01eb58060d211/users/91c074c550844af58e87ecafb6a4df56/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:13:53.193304 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a42cf9-847f-4c3d-892a-8444964e5a88 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:53.203727 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a42cf9-847f-4c3d-892a-8444964e5a88 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:53.269887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84a4b6-7386-4787-b283-4855049adce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:53.271243 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84a4b6-7386-4787-b283-4855049adce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:53.271538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84a4b6-7386-4787-b283-4855049adce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:53.271813 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84a4b6-7386-4787-b283-4855049adce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:53.272552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84a4b6-7386-4787-b283-4855049adce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:53.274236 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84a4b6-7386-4787-b283-4855049adce6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:53.285037 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1168/2325] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:13:53.290022 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039fb60-bfe9-4527-a411-463c2573d138 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:53.300614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039fb60-bfe9-4527-a411-463c2573d138 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:53.306900 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd847b-f13c-44e3-b1b1-b42628460183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:53.307805 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd847b-f13c-44e3-b1b1-b42628460183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:53.308090 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd847b-f13c-44e3-b1b1-b42628460183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:53.308370 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd847b-f13c-44e3-b1b1-b42628460183 admin admin] PATH_INFO: `/v3/projects/9fc8afe3aa684423afd01eb58060d211/users/91c074c550844af58e87ecafb6a4df56/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:53.310430 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd847b-f13c-44e3-b1b1-b42628460183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc8afe3aa684423afd01eb58060d211, user_id=91c074c550844af58e87ecafb6a4df56, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:53.313127 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd847b-f13c-44e3-b1b1-b42628460183 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:53.325088 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1158/2326] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:13:53 2022] PUT /identity/v3/projects/9fc8afe3aa684423afd01eb58060d211/users/91c074c550844af58e87ecafb6a4df56/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:13:53.981932 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9ec6c-3325-4499-8ec2-461032048832 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:53.982497 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9ec6c-3325-4499-8ec2-461032048832 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:53.982497 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9ec6c-3325-4499-8ec2-461032048832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:53.994810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:54.010896 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6ba9ec6c-3325-4499-8ec2-461032048832 None None] MFA Rules not processed for user `91c074c550844af58e87ecafb6a4df56`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:13:54.012129 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6ba9ec6c-3325-4499-8ec2-461032048832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:54.096587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1169/2327] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:13:53 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:13:54.108525 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd847b-f13c-44e3-b1b1-b42628460183 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:54.110277 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cefd847b-f13c-44e3-b1b1-b42628460183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:13:54.174418 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd847b-f13c-44e3-b1b1-b42628460183 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:54.179292 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317f70f-9641-4367-ba0f-ed43a654dc25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:54.179941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317f70f-9641-4367-ba0f-ed43a654dc25 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:54.180226 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317f70f-9641-4367-ba0f-ed43a654dc25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:54.180505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317f70f-9641-4367-ba0f-ed43a654dc25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:54.237170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:54.240466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317f70f-9641-4367-ba0f-ed43a654dc25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:54.242439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317f70f-9641-4367-ba0f-ed43a654dc25 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:54.252658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1159/2328] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:13:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:13:56.767294 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9ec6c-3325-4499-8ec2-461032048832 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:13:56.782304 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9ec6c-3325-4499-8ec2-461032048832 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:13:56.790256 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03867e1f-eea4-46bf-a3ac-3707fbff5124 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:13:56.790935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03867e1f-eea4-46bf-a3ac-3707fbff5124 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:56.793141 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03867e1f-eea4-46bf-a3ac-3707fbff5124 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:56.793967 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03867e1f-eea4-46bf-a3ac-3707fbff5124 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:13:56.854228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03867e1f-eea4-46bf-a3ac-3707fbff5124 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:13:56.858571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03867e1f-eea4-46bf-a3ac-3707fbff5124 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:13:56.874786 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1170/2329] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:13:56 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:13:59.983632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e7ec8-0560-4636-8ef9-c443bdd25483 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:13:59.984190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e7ec8-0560-4636-8ef9-c443bdd25483 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:13:59.984305 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e7ec8-0560-4636-8ef9-c443bdd25483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:00.001373 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-df1e7ec8-0560-4636-8ef9-c443bdd25483 None None] MFA Rules not processed for user `9b596d7285294117b826f459a39872c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:14:00.002640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-df1e7ec8-0560-4636-8ef9-c443bdd25483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:00.058580 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1160/2330] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:13:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:14:06.867248 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=37 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:10.052255 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=27 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:12.699554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03867e1f-eea4-46bf-a3ac-3707fbff5124 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:12.770155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03867e1f-eea4-46bf-a3ac-3707fbff5124 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:12.774721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787197e2-ce8f-4de7-a867-3654df91adaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:12.775591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787197e2-ce8f-4de7-a867-3654df91adaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:12.775874 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787197e2-ce8f-4de7-a867-3654df91adaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:12.776152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787197e2-ce8f-4de7-a867-3654df91adaa admin admin] PATH_INFO: `/v3/users/c6a5b88eb99a4bfcb55bd51398887e7e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:12.777342 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787197e2-ce8f-4de7-a867-3654df91adaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a5b88eb99a4bfcb55bd51398887e7e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:12.779379 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787197e2-ce8f-4de7-a867-3654df91adaa admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:12.826162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-787197e2-ce8f-4de7-a867-3654df91adaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a5b88eb99a4bfcb55bd51398887e7e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:12.826842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-787197e2-ce8f-4de7-a867-3654df91adaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a5b88eb99a4bfcb55bd51398887e7e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:12.834088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-787197e2-ce8f-4de7-a867-3654df91adaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a5b88eb99a4bfcb55bd51398887e7e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:12.841870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-787197e2-ce8f-4de7-a867-3654df91adaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a5b88eb99a4bfcb55bd51398887e7e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:12.854275 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-787197e2-ce8f-4de7-a867-3654df91adaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a5b88eb99a4bfcb55bd51398887e7e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:12.860278 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1171/2331] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:14:12 2022] DELETE /identity/v3/users/c6a5b88eb99a4bfcb55bd51398887e7e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:13.052132 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e7ec8-0560-4636-8ef9-c443bdd25483 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:13.065266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e7ec8-0560-4636-8ef9-c443bdd25483 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:13.125083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c3dc7-e2d7-420c-857a-eceddabc2874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:13.126105 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c3dc7-e2d7-420c-857a-eceddabc2874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:13.126350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c3dc7-e2d7-420c-857a-eceddabc2874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:13.126596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c3dc7-e2d7-420c-857a-eceddabc2874 admin admin] PATH_INFO: `/v3/projects/27fe86388e9f404f92b6b14f9abe8ce9` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:13.127932 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c3dc7-e2d7-420c-857a-eceddabc2874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27fe86388e9f404f92b6b14f9abe8ce9)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:13.131586 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c3dc7-e2d7-420c-857a-eceddabc2874 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:13.184884 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5a2c3dc7-e2d7-420c-857a-eceddabc2874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27fe86388e9f404f92b6b14f9abe8ce9', 'request_id': 'req-5a2c3dc7-e2d7-420c-857a-eceddabc2874'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:13.191286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5a2c3dc7-e2d7-420c-857a-eceddabc2874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27fe86388e9f404f92b6b14f9abe8ce9', 'request_id': 'req-5a2c3dc7-e2d7-420c-857a-eceddabc2874'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:13.198565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5a2c3dc7-e2d7-420c-857a-eceddabc2874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27fe86388e9f404f92b6b14f9abe8ce9', 'request_id': 'req-5a2c3dc7-e2d7-420c-857a-eceddabc2874'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:13.212761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5a2c3dc7-e2d7-420c-857a-eceddabc2874 admin admin] The token cache is being invalidate because project 27fe86388e9f404f92b6b14f9abe8ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:14:13.213828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5a2c3dc7-e2d7-420c-857a-eceddabc2874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:13.214487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5a2c3dc7-e2d7-420c-857a-eceddabc2874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:13.216660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1161/2332] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:14:13 2022] DELETE /identity/v3/projects/27fe86388e9f404f92b6b14f9abe8ce9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:14:13.220482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787197e2-ce8f-4de7-a867-3654df91adaa admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:13.222037 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-787197e2-ce8f-4de7-a867-3654df91adaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:13.236286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787197e2-ce8f-4de7-a867-3654df91adaa admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:13.300375 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252892f-9a67-4f6f-b035-9f30df75aa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:13.301301 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252892f-9a67-4f6f-b035-9f30df75aa46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:13.301588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252892f-9a67-4f6f-b035-9f30df75aa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:13.301897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252892f-9a67-4f6f-b035-9f30df75aa46 admin admin] PATH_INFO: `/v3/users/91c074c550844af58e87ecafb6a4df56` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:13.303130 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252892f-9a67-4f6f-b035-9f30df75aa46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c074c550844af58e87ecafb6a4df56)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:13.305133 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252892f-9a67-4f6f-b035-9f30df75aa46 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:13.330453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:13.358815 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0252892f-9a67-4f6f-b035-9f30df75aa46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c074c550844af58e87ecafb6a4df56'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:13.359475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0252892f-9a67-4f6f-b035-9f30df75aa46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c074c550844af58e87ecafb6a4df56'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:13.367897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0252892f-9a67-4f6f-b035-9f30df75aa46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c074c550844af58e87ecafb6a4df56'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:13.376181 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0252892f-9a67-4f6f-b035-9f30df75aa46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c074c550844af58e87ecafb6a4df56'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:13.389972 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0252892f-9a67-4f6f-b035-9f30df75aa46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c074c550844af58e87ecafb6a4df56'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:13.396753 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1172/2333] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:14:13 2022] DELETE /identity/v3/users/91c074c550844af58e87ecafb6a4df56 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:13.590151 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c3dc7-e2d7-420c-857a-eceddabc2874 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:13.592118 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5a2c3dc7-e2d7-420c-857a-eceddabc2874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:13.612528 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c3dc7-e2d7-420c-857a-eceddabc2874 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:13.680097 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dad898-9311-4773-ba7f-d55665fadf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:13.681141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dad898-9311-4773-ba7f-d55665fadf17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:13.681449 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dad898-9311-4773-ba7f-d55665fadf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:13.681760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dad898-9311-4773-ba7f-d55665fadf17 admin admin] PATH_INFO: `/v3/projects/9fc8afe3aa684423afd01eb58060d211` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:13.682958 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dad898-9311-4773-ba7f-d55665fadf17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fc8afe3aa684423afd01eb58060d211)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:13.684870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dad898-9311-4773-ba7f-d55665fadf17 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:13.721859 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:13.737238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-07dad898-9311-4773-ba7f-d55665fadf17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fc8afe3aa684423afd01eb58060d211', 'request_id': 'req-07dad898-9311-4773-ba7f-d55665fadf17'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:13.743588 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-07dad898-9311-4773-ba7f-d55665fadf17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fc8afe3aa684423afd01eb58060d211', 'request_id': 'req-07dad898-9311-4773-ba7f-d55665fadf17'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:13.750153 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-07dad898-9311-4773-ba7f-d55665fadf17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fc8afe3aa684423afd01eb58060d211', 'request_id': 'req-07dad898-9311-4773-ba7f-d55665fadf17'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:13.766545 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-07dad898-9311-4773-ba7f-d55665fadf17 admin admin] The token cache is being invalidate because project 9fc8afe3aa684423afd01eb58060d211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:14:13.766916 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-07dad898-9311-4773-ba7f-d55665fadf17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:13.767473 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-07dad898-9311-4773-ba7f-d55665fadf17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:13.769203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1162/2334] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:14:13 2022] DELETE /identity/v3/projects/9fc8afe3aa684423afd01eb58060d211 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:14:13.774425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ce2ed-918c-47dc-a279-75710149c1a5 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:13.775040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ce2ed-918c-47dc-a279-75710149c1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:13.775040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ce2ed-918c-47dc-a279-75710149c1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:13.793682 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4e4ce2ed-918c-47dc-a279-75710149c1a5 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:14:13.795168 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4e4ce2ed-918c-47dc-a279-75710149c1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:13.859641 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1173/2335] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:14:13.867536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009caf4-4a8b-4543-866d-162217365b51 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:13.867909 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009caf4-4a8b-4543-866d-162217365b51 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:13.868260 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009caf4-4a8b-4543-866d-162217365b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:13.887696 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2009caf4-4a8b-4543-866d-162217365b51 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:14:13.889078 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2009caf4-4a8b-4543-866d-162217365b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:13.898376 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1163/2336] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:14:13.902649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ce2ed-918c-47dc-a279-75710149c1a5 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:13.912825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ce2ed-918c-47dc-a279-75710149c1a5 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:13.917439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8803451-a3a0-4d31-a273-710a4e35fba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:13.918126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8803451-a3a0-4d31-a273-710a4e35fba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:13.918407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8803451-a3a0-4d31-a273-710a4e35fba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:13.918680 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8803451-a3a0-4d31-a273-710a4e35fba2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:13.919407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8803451-a3a0-4d31-a273-710a4e35fba2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:14:13.919711 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8803451-a3a0-4d31-a273-710a4e35fba2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:13.921311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8803451-a3a0-4d31-a273-710a4e35fba2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:13.933418 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1174/2337] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:14:13.937631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009caf4-4a8b-4543-866d-162217365b51 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:13.947936 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009caf4-4a8b-4543-866d-162217365b51 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:13.953128 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d6c3f-a501-4687-ba9f-ea2ea5a6fd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:13.953860 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d6c3f-a501-4687-ba9f-ea2ea5a6fd7a admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:13.954148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d6c3f-a501-4687-ba9f-ea2ea5a6fd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:13.954427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d6c3f-a501-4687-ba9f-ea2ea5a6fd7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:13.955136 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d6c3f-a501-4687-ba9f-ea2ea5a6fd7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:13.957280 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d6c3f-a501-4687-ba9f-ea2ea5a6fd7a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:13.989431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1164/2338] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:14:13 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:14:13.990633 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8803451-a3a0-4d31-a273-710a4e35fba2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:14.000844 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8803451-a3a0-4d31-a273-710a4e35fba2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:14.072857 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f6747-49b4-4ac0-8d9e-4ba152ffcf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:14.073546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f6747-49b4-4ac0-8d9e-4ba152ffcf86 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:14.073883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f6747-49b4-4ac0-8d9e-4ba152ffcf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:14.074165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f6747-49b4-4ac0-8d9e-4ba152ffcf86 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:14.075031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f6747-49b4-4ac0-8d9e-4ba152ffcf86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:14.076989 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f6747-49b4-4ac0-8d9e-4ba152ffcf86 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:14.099071 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1175/2339] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:14:13 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:14:14.103586 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d6c3f-a501-4687-ba9f-ea2ea5a6fd7a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:14.115066 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d6c3f-a501-4687-ba9f-ea2ea5a6fd7a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:14.119871 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cabea-f9c7-4fc1-a28d-b3ec8a7fd1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:14.120649 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cabea-f9c7-4fc1-a28d-b3ec8a7fd1ff admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:14.121048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cabea-f9c7-4fc1-a28d-b3ec8a7fd1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:14.121397 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cabea-f9c7-4fc1-a28d-b3ec8a7fd1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:14.122239 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cabea-f9c7-4fc1-a28d-b3ec8a7fd1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:14.123943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cabea-f9c7-4fc1-a28d-b3ec8a7fd1ff admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:14.135934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1165/2340] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:14:14.140306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f6747-49b4-4ac0-8d9e-4ba152ffcf86 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:14.151557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f6747-49b4-4ac0-8d9e-4ba152ffcf86 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:14.156707 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2773c-77d5-403d-9b11-2e39d330f5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:14.157376 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2773c-77d5-403d-9b11-2e39d330f5bc admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:14.157685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2773c-77d5-403d-9b11-2e39d330f5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:14.157973 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2773c-77d5-403d-9b11-2e39d330f5bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:14.158709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2773c-77d5-403d-9b11-2e39d330f5bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:14.160545 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2773c-77d5-403d-9b11-2e39d330f5bc admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:14.174295 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1176/2341] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:14:14.175727 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cabea-f9c7-4fc1-a28d-b3ec8a7fd1ff admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:14.186615 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cabea-f9c7-4fc1-a28d-b3ec8a7fd1ff admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:14.192382 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c2db3-2acc-4ece-a7c0-d24c4266972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:14.193495 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c2db3-2acc-4ece-a7c0-d24c4266972c admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:14.193827 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c2db3-2acc-4ece-a7c0-d24c4266972c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:14.194108 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c2db3-2acc-4ece-a7c0-d24c4266972c admin admin] PATH_INFO: `/v3/projects/57aa873cae5e410c8256a060e99f00b2/users/7f419af630764c14b54e5639cbbe1f22/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:14.209384 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c2db3-2acc-4ece-a7c0-d24c4266972c admin admin] RBAC: Authorizing `identity:create_grant(project_id=57aa873cae5e410c8256a060e99f00b2, user_id=7f419af630764c14b54e5639cbbe1f22, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:14.212180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c2db3-2acc-4ece-a7c0-d24c4266972c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:14.225802 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1166/2342] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:14:14 2022] PUT /identity/v3/projects/57aa873cae5e410c8256a060e99f00b2/users/7f419af630764c14b54e5639cbbe1f22/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:14.237056 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce3d00-2d0b-4d53-90f8-eaaf159aefea None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:14.237255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce3d00-2d0b-4d53-90f8-eaaf159aefea None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:14.237535 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce3d00-2d0b-4d53-90f8-eaaf159aefea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:14.244878 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:14.268358 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-70ce3d00-2d0b-4d53-90f8-eaaf159aefea None None] MFA Rules not processed for user `7f419af630764c14b54e5639cbbe1f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:14:14.269977 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-70ce3d00-2d0b-4d53-90f8-eaaf159aefea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:14.353011 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1177/2343] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:14:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:14:14.365075 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c2db3-2acc-4ece-a7c0-d24c4266972c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:14.367261 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d58c2db3-2acc-4ece-a7c0-d24c4266972c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:14.435020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c2db3-2acc-4ece-a7c0-d24c4266972c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:14.438959 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75457cd-9991-4ef5-b2c3-3342a13c69e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:14.439706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75457cd-9991-4ef5-b2c3-3342a13c69e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:14.440059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75457cd-9991-4ef5-b2c3-3342a13c69e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:14.440440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75457cd-9991-4ef5-b2c3-3342a13c69e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:14.451477 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75457cd-9991-4ef5-b2c3-3342a13c69e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:14.453162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75457cd-9991-4ef5-b2c3-3342a13c69e7 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:14.464576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1167/2344] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:14:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:14:14.494649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce3d00-2d0b-4d53-90f8-eaaf159aefea None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:14.572031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce3d00-2d0b-4d53-90f8-eaaf159aefea None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:14.579154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e156a-9a41-4326-aebc-eeed098df770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:14.580117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e156a-9a41-4326-aebc-eeed098df770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:14.580400 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e156a-9a41-4326-aebc-eeed098df770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:14.580678 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e156a-9a41-4326-aebc-eeed098df770 admin admin] PATH_INFO: `/v3/users/7f419af630764c14b54e5639cbbe1f22` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:14.581977 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e156a-9a41-4326-aebc-eeed098df770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f419af630764c14b54e5639cbbe1f22)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:14.584995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e156a-9a41-4326-aebc-eeed098df770 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:14.647073 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1b6e156a-9a41-4326-aebc-eeed098df770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f419af630764c14b54e5639cbbe1f22'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:14.647753 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1b6e156a-9a41-4326-aebc-eeed098df770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f419af630764c14b54e5639cbbe1f22'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:14.656809 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1b6e156a-9a41-4326-aebc-eeed098df770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f419af630764c14b54e5639cbbe1f22'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:14.665575 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1b6e156a-9a41-4326-aebc-eeed098df770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f419af630764c14b54e5639cbbe1f22'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:14.687851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1b6e156a-9a41-4326-aebc-eeed098df770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f419af630764c14b54e5639cbbe1f22'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:14.699377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1178/2345] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:14:14 2022] DELETE /identity/v3/users/7f419af630764c14b54e5639cbbe1f22 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:14.704027 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9f7ff-73b5-492c-b8c7-deb8af5c78fc None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:14.704403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9f7ff-73b5-492c-b8c7-deb8af5c78fc None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:14.704666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9f7ff-73b5-492c-b8c7-deb8af5c78fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:14.726600 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-68b9f7ff-73b5-492c-b8c7-deb8af5c78fc None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:14:14.726600 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-68b9f7ff-73b5-492c-b8c7-deb8af5c78fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:14.821858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:14.843443 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1168/2346] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:14:14.854484 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e156a-9a41-4326-aebc-eeed098df770 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:14.856265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1b6e156a-9a41-4326-aebc-eeed098df770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:14.873979 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:14.927792 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e156a-9a41-4326-aebc-eeed098df770 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:14.932006 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f9ffb-0e6b-4a50-aa96-e5ee61ab6934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:14.933026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f9ffb-0e6b-4a50-aa96-e5ee61ab6934 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:14.933311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f9ffb-0e6b-4a50-aa96-e5ee61ab6934 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:14.933589 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f9ffb-0e6b-4a50-aa96-e5ee61ab6934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:14.946356 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f9ffb-0e6b-4a50-aa96-e5ee61ab6934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:14.948254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f9ffb-0e6b-4a50-aa96-e5ee61ab6934 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:14.961501 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1179/2347] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:14:15.305374 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9f7ff-73b5-492c-b8c7-deb8af5c78fc None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:15.307178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-68b9f7ff-73b5-492c-b8c7-deb8af5c78fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:15.327211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9f7ff-73b5-492c-b8c7-deb8af5c78fc None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:15.333762 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188a23c-89c0-4b69-ac1e-94aee7e8675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:15.334623 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188a23c-89c0-4b69-ac1e-94aee7e8675b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:15.334910 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188a23c-89c0-4b69-ac1e-94aee7e8675b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:15.335196 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188a23c-89c0-4b69-ac1e-94aee7e8675b admin admin] PATH_INFO: `/v3/projects/57aa873cae5e410c8256a060e99f00b2` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:15.336497 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188a23c-89c0-4b69-ac1e-94aee7e8675b admin admin] RBAC: Authorizing `identity:delete_project(project_id=57aa873cae5e410c8256a060e99f00b2)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:15.338607 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188a23c-89c0-4b69-ac1e-94aee7e8675b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:15.398608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f188a23c-89c0-4b69-ac1e-94aee7e8675b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57aa873cae5e410c8256a060e99f00b2', 'request_id': 'req-f188a23c-89c0-4b69-ac1e-94aee7e8675b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:15.405491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f188a23c-89c0-4b69-ac1e-94aee7e8675b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57aa873cae5e410c8256a060e99f00b2', 'request_id': 'req-f188a23c-89c0-4b69-ac1e-94aee7e8675b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:15.413347 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f188a23c-89c0-4b69-ac1e-94aee7e8675b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57aa873cae5e410c8256a060e99f00b2', 'request_id': 'req-f188a23c-89c0-4b69-ac1e-94aee7e8675b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:15.429210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f188a23c-89c0-4b69-ac1e-94aee7e8675b admin admin] The token cache is being invalidate because project 57aa873cae5e410c8256a060e99f00b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:14:15.430193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f188a23c-89c0-4b69-ac1e-94aee7e8675b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:15.430448 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f188a23c-89c0-4b69-ac1e-94aee7e8675b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:15.432087 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1169/2348] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:14:15 2022] DELETE /identity/v3/projects/57aa873cae5e410c8256a060e99f00b2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:15.437069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950583-d694-498b-a601-45a8e4d9dcf2 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:15.437369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950583-d694-498b-a601-45a8e4d9dcf2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:15.437671 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950583-d694-498b-a601-45a8e4d9dcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:15.456454 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6d950583-d694-498b-a601-45a8e4d9dcf2 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:14:15.457956 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6d950583-d694-498b-a601-45a8e4d9dcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:15.528996 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1180/2349] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:14:15.530828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae550c-d88b-4565-8e0f-ab917b0495aa None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:15.531129 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae550c-d88b-4565-8e0f-ab917b0495aa None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:15.531405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae550c-d88b-4565-8e0f-ab917b0495aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:15.551179 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-87ae550c-d88b-4565-8e0f-ab917b0495aa None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:14:15.552476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-87ae550c-d88b-4565-8e0f-ab917b0495aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:15.560959 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1170/2350] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:14:15.565204 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d950583-d694-498b-a601-45a8e4d9dcf2 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:15.576404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d950583-d694-498b-a601-45a8e4d9dcf2 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:15.583127 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142479f0-f7d3-43eb-ba3c-857b4a73a25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:15.583894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142479f0-f7d3-43eb-ba3c-857b4a73a25a admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:15.584253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142479f0-f7d3-43eb-ba3c-857b4a73a25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:15.584602 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142479f0-f7d3-43eb-ba3c-857b4a73a25a admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:15.585420 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142479f0-f7d3-43eb-ba3c-857b4a73a25a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:14:15.585843 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142479f0-f7d3-43eb-ba3c-857b4a73a25a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:15.587590 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142479f0-f7d3-43eb-ba3c-857b4a73a25a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:15.601102 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1181/2351] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:14:15.605961 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae550c-d88b-4565-8e0f-ab917b0495aa None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:15.616257 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae550c-d88b-4565-8e0f-ab917b0495aa None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:15.621026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7253c-26f5-459f-af46-7d1a82324ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:15.621734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7253c-26f5-459f-af46-7d1a82324ccb admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:15.622017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7253c-26f5-459f-af46-7d1a82324ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:15.622287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7253c-26f5-459f-af46-7d1a82324ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:15.622994 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7253c-26f5-459f-af46-7d1a82324ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:15.626577 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7253c-26f5-459f-af46-7d1a82324ccb admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:15.653333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1171/2352] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:14:15 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:14:15.657406 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142479f0-f7d3-43eb-ba3c-857b4a73a25a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:15.667920 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142479f0-f7d3-43eb-ba3c-857b4a73a25a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:15.734366 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b73fea-7de1-467c-9a1d-1addaef3fc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:15.735477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b73fea-7de1-467c-9a1d-1addaef3fc5a admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:15.735943 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b73fea-7de1-467c-9a1d-1addaef3fc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:15.736449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b73fea-7de1-467c-9a1d-1addaef3fc5a admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:15.737815 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b73fea-7de1-467c-9a1d-1addaef3fc5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:15.743191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b73fea-7de1-467c-9a1d-1addaef3fc5a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:15.766795 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1182/2353] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:14:15 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:14:15.771725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7253c-26f5-459f-af46-7d1a82324ccb admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:15.782835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7253c-26f5-459f-af46-7d1a82324ccb admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:15.788071 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d3bcc-1e95-4de3-bbab-28dcc4741551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:15.788747 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d3bcc-1e95-4de3-bbab-28dcc4741551 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:15.789030 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d3bcc-1e95-4de3-bbab-28dcc4741551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:15.789307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d3bcc-1e95-4de3-bbab-28dcc4741551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:15.790083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d3bcc-1e95-4de3-bbab-28dcc4741551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:15.791698 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d3bcc-1e95-4de3-bbab-28dcc4741551 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:15.805646 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1172/2354] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:14:15.810154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b73fea-7de1-467c-9a1d-1addaef3fc5a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:15.822614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b73fea-7de1-467c-9a1d-1addaef3fc5a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:15.827821 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0d14a-7bbe-4221-87d4-7b5b5ba3d837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:15.828514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0d14a-7bbe-4221-87d4-7b5b5ba3d837 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:15.828792 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0d14a-7bbe-4221-87d4-7b5b5ba3d837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:15.829068 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0d14a-7bbe-4221-87d4-7b5b5ba3d837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:15.829856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0d14a-7bbe-4221-87d4-7b5b5ba3d837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:15.831469 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0d14a-7bbe-4221-87d4-7b5b5ba3d837 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:15.843663 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1183/2355] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:14:15.848615 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d3bcc-1e95-4de3-bbab-28dcc4741551 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:15.859817 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d3bcc-1e95-4de3-bbab-28dcc4741551 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:15.870129 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b40ed0-cbe9-46ae-bb70-f261722d2516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:15.871628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40ed0-cbe9-46ae-bb70-f261722d2516 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:15.872124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40ed0-cbe9-46ae-bb70-f261722d2516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:15.872540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b40ed0-cbe9-46ae-bb70-f261722d2516 admin admin] PATH_INFO: `/v3/projects/b5905f290f514d7bb6848c8b1fca48ae/users/7ef5cd9490d9472b809b0a347c74047a/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:15.889627 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b40ed0-cbe9-46ae-bb70-f261722d2516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5905f290f514d7bb6848c8b1fca48ae, user_id=7ef5cd9490d9472b809b0a347c74047a, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:15.892446 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b40ed0-cbe9-46ae-bb70-f261722d2516 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:15.908222 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1173/2356] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:14:15 2022] PUT /identity/v3/projects/b5905f290f514d7bb6848c8b1fca48ae/users/7ef5cd9490d9472b809b0a347c74047a/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:15.920263 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a5632-a852-4835-a594-2366a643c902 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:15.920848 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a5632-a852-4835-a594-2366a643c902 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:15.920848 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a5632-a852-4835-a594-2366a643c902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:15.950766 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-922a5632-a852-4835-a594-2366a643c902 None None] MFA Rules not processed for user `7ef5cd9490d9472b809b0a347c74047a`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:14:15.952002 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-922a5632-a852-4835-a594-2366a643c902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:15.963846 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:16.042820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1184/2357] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:14:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:14:16.054445 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b40ed0-cbe9-46ae-bb70-f261722d2516 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:16.056303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-65b40ed0-cbe9-46ae-bb70-f261722d2516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:16.116526 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b40ed0-cbe9-46ae-bb70-f261722d2516 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:16.120090 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be89bb-10dc-4ddd-ab12-9d6dc900108d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:16.120742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be89bb-10dc-4ddd-ab12-9d6dc900108d service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:16.121024 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be89bb-10dc-4ddd-ab12-9d6dc900108d service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:16.121299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be89bb-10dc-4ddd-ab12-9d6dc900108d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:16.130734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be89bb-10dc-4ddd-ab12-9d6dc900108d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:16.132179 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be89bb-10dc-4ddd-ab12-9d6dc900108d service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:16.141681 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1174/2358] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:14:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:14:17.131191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a5632-a852-4835-a594-2366a643c902 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:17.132628 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-922a5632-a852-4835-a594-2366a643c902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:17.198614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a5632-a852-4835-a594-2366a643c902 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:17.202336 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97caaad2-d679-46ee-bc79-0217cd3c959e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:17.202978 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caaad2-d679-46ee-bc79-0217cd3c959e service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:17.203264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caaad2-d679-46ee-bc79-0217cd3c959e service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:17.203543 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caaad2-d679-46ee-bc79-0217cd3c959e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:17.205432 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-97caaad2-d679-46ee-bc79-0217cd3c959e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:17.274761 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97caaad2-d679-46ee-bc79-0217cd3c959e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:17.276262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97caaad2-d679-46ee-bc79-0217cd3c959e service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:17.286308 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1185/2359] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:14:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:14:25.705939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be89bb-10dc-4ddd-ab12-9d6dc900108d service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:25.733590 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:25.777230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be89bb-10dc-4ddd-ab12-9d6dc900108d service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:25.782228 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d9803-338f-4c7f-9e5c-c2b45c27b3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:25.782892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d9803-338f-4c7f-9e5c-c2b45c27b3f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:25.783177 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d9803-338f-4c7f-9e5c-c2b45c27b3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:25.783452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d9803-338f-4c7f-9e5c-c2b45c27b3f0 admin admin] PATH_INFO: `/v3/users/7ef5cd9490d9472b809b0a347c74047a` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:25.784670 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d9803-338f-4c7f-9e5c-c2b45c27b3f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef5cd9490d9472b809b0a347c74047a)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:25.787173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d9803-338f-4c7f-9e5c-c2b45c27b3f0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:25.844665 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-186d9803-338f-4c7f-9e5c-c2b45c27b3f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef5cd9490d9472b809b0a347c74047a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:25.854338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-186d9803-338f-4c7f-9e5c-c2b45c27b3f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef5cd9490d9472b809b0a347c74047a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:25.874852 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-186d9803-338f-4c7f-9e5c-c2b45c27b3f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef5cd9490d9472b809b0a347c74047a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:25.876742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-186d9803-338f-4c7f-9e5c-c2b45c27b3f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef5cd9490d9472b809b0a347c74047a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:25.878069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-186d9803-338f-4c7f-9e5c-c2b45c27b3f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef5cd9490d9472b809b0a347c74047a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:25.905300 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1175/2360] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:14:25 2022] DELETE /identity/v3/users/7ef5cd9490d9472b809b0a347c74047a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:25.909533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acdbaa-4a52-4db4-a93e-3d87a3eb14b0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:25.910157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acdbaa-4a52-4db4-a93e-3d87a3eb14b0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:25.910326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acdbaa-4a52-4db4-a93e-3d87a3eb14b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:25.931389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f8acdbaa-4a52-4db4-a93e-3d87a3eb14b0 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:14:25.932618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f8acdbaa-4a52-4db4-a93e-3d87a3eb14b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:26.004372 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1186/2361] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:14:26.014679 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d9803-338f-4c7f-9e5c-c2b45c27b3f0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:26.017391 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-186d9803-338f-4c7f-9e5c-c2b45c27b3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:26.085116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d9803-338f-4c7f-9e5c-c2b45c27b3f0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:26.088822 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076161b-692d-475a-96a3-941222e5f14e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:26.089588 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076161b-692d-475a-96a3-941222e5f14e service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:26.089945 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076161b-692d-475a-96a3-941222e5f14e service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:26.090264 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076161b-692d-475a-96a3-941222e5f14e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:26.101737 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076161b-692d-475a-96a3-941222e5f14e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:26.103193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076161b-692d-475a-96a3-941222e5f14e service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:26.113537 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1176/2362] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:14:26.405840 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acdbaa-4a52-4db4-a93e-3d87a3eb14b0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:26.407571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f8acdbaa-4a52-4db4-a93e-3d87a3eb14b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:26.427237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acdbaa-4a52-4db4-a93e-3d87a3eb14b0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:26.439480 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986df8d-a8b4-4f84-8c99-9863497dc5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:26.440369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986df8d-a8b4-4f84-8c99-9863497dc5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:26.440983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986df8d-a8b4-4f84-8c99-9863497dc5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:26.440983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986df8d-a8b4-4f84-8c99-9863497dc5ba admin admin] PATH_INFO: `/v3/projects/b5905f290f514d7bb6848c8b1fca48ae` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:26.442920 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986df8d-a8b4-4f84-8c99-9863497dc5ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5905f290f514d7bb6848c8b1fca48ae)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:26.444964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986df8d-a8b4-4f84-8c99-9863497dc5ba admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:26.446770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:26.505440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5986df8d-a8b4-4f84-8c99-9863497dc5ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5905f290f514d7bb6848c8b1fca48ae', 'request_id': 'req-5986df8d-a8b4-4f84-8c99-9863497dc5ba'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:26.513998 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5986df8d-a8b4-4f84-8c99-9863497dc5ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5905f290f514d7bb6848c8b1fca48ae', 'request_id': 'req-5986df8d-a8b4-4f84-8c99-9863497dc5ba'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:26.522439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5986df8d-a8b4-4f84-8c99-9863497dc5ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5905f290f514d7bb6848c8b1fca48ae', 'request_id': 'req-5986df8d-a8b4-4f84-8c99-9863497dc5ba'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:26.532850 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5986df8d-a8b4-4f84-8c99-9863497dc5ba admin admin] The token cache is being invalidate because project b5905f290f514d7bb6848c8b1fca48ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:14:26.533140 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5986df8d-a8b4-4f84-8c99-9863497dc5ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:26.533832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-5986df8d-a8b4-4f84-8c99-9863497dc5ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:26.535538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1187/2363] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:14:26 2022] DELETE /identity/v3/projects/b5905f290f514d7bb6848c8b1fca48ae => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:26.540431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b43e8-4042-4cea-b1ef-9c1678b35bd6 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:26.540714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b43e8-4042-4cea-b1ef-9c1678b35bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:26.541177 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b43e8-4042-4cea-b1ef-9c1678b35bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:26.559778 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-402b43e8-4042-4cea-b1ef-9c1678b35bd6 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:14:26.561101 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-402b43e8-4042-4cea-b1ef-9c1678b35bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:26.603751 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:26.624798 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1177/2364] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:14:26.632965 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ab310-7447-4ff8-b613-b223d826a3f2 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:26.633238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ab310-7447-4ff8-b613-b223d826a3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:26.633514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ab310-7447-4ff8-b613-b223d826a3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:26.652253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c20ab310-7447-4ff8-b613-b223d826a3f2 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:14:26.653443 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c20ab310-7447-4ff8-b613-b223d826a3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:26.661398 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1188/2365] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:14:26.665877 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b43e8-4042-4cea-b1ef-9c1678b35bd6 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:26.676042 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b43e8-4042-4cea-b1ef-9c1678b35bd6 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:26.680956 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27250162-73b8-466e-bd0b-3f9cff2d993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:26.681688 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27250162-73b8-466e-bd0b-3f9cff2d993b admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:26.681953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27250162-73b8-466e-bd0b-3f9cff2d993b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:26.682285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27250162-73b8-466e-bd0b-3f9cff2d993b admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:26.683095 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27250162-73b8-466e-bd0b-3f9cff2d993b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:14:26.683297 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27250162-73b8-466e-bd0b-3f9cff2d993b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:26.684936 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27250162-73b8-466e-bd0b-3f9cff2d993b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:26.699350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1178/2366] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:14:26.703810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ab310-7447-4ff8-b613-b223d826a3f2 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:26.714455 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ab310-7447-4ff8-b613-b223d826a3f2 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:26.719608 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3169a-3ff9-4a4d-8d92-af8b288ef217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:26.720274 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3169a-3ff9-4a4d-8d92-af8b288ef217 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:26.720557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3169a-3ff9-4a4d-8d92-af8b288ef217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:26.720834 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3169a-3ff9-4a4d-8d92-af8b288ef217 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:26.721550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3169a-3ff9-4a4d-8d92-af8b288ef217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:26.723782 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3169a-3ff9-4a4d-8d92-af8b288ef217 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:26.755315 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1189/2367] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:14:26 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:14:26.757817 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27250162-73b8-466e-bd0b-3f9cff2d993b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:26.770010 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27250162-73b8-466e-bd0b-3f9cff2d993b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:26.839651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2aac0-3bd3-474c-af45-49a9ab925634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:26.840348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2aac0-3bd3-474c-af45-49a9ab925634 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:26.840635 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2aac0-3bd3-474c-af45-49a9ab925634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:26.840915 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2aac0-3bd3-474c-af45-49a9ab925634 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:26.842062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2aac0-3bd3-474c-af45-49a9ab925634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:26.844242 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2aac0-3bd3-474c-af45-49a9ab925634 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:26.871778 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1179/2368] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:14:26 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:14:26.873937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3169a-3ff9-4a4d-8d92-af8b288ef217 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:26.893989 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3169a-3ff9-4a4d-8d92-af8b288ef217 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:26.902630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8fe5c-b743-425f-bc6c-6348e7b841e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:26.903765 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8fe5c-b743-425f-bc6c-6348e7b841e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:26.904283 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8fe5c-b743-425f-bc6c-6348e7b841e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:26.904797 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8fe5c-b743-425f-bc6c-6348e7b841e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:26.906261 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8fe5c-b743-425f-bc6c-6348e7b841e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:26.908970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8fe5c-b743-425f-bc6c-6348e7b841e2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:26.927052 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1190/2369] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:14:26.935582 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2aac0-3bd3-474c-af45-49a9ab925634 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:26.958270 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2aac0-3bd3-474c-af45-49a9ab925634 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:26.962044 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8fe5c-b743-425f-bc6c-6348e7b841e2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:26.964413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949c95a-4819-4f6b-8d22-7bbfe72c117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:26.964805 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-09b8fe5c-b743-425f-bc6c-6348e7b841e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:26.965522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949c95a-4819-4f6b-8d22-7bbfe72c117e admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:26.966081 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949c95a-4819-4f6b-8d22-7bbfe72c117e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:26.966286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949c95a-4819-4f6b-8d22-7bbfe72c117e admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:26.967359 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949c95a-4819-4f6b-8d22-7bbfe72c117e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:26.970338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949c95a-4819-4f6b-8d22-7bbfe72c117e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:26.984331 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1180/2370] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:14:26.986066 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949c95a-4819-4f6b-8d22-7bbfe72c117e admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:26.997478 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949c95a-4819-4f6b-8d22-7bbfe72c117e admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:27.002703 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45946ffb-3b0d-4327-a7b1-a134d444cd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:27.004380 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45946ffb-3b0d-4327-a7b1-a134d444cd5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:27.004757 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45946ffb-3b0d-4327-a7b1-a134d444cd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:27.005087 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45946ffb-3b0d-4327-a7b1-a134d444cd5b admin admin] PATH_INFO: `/v3/projects/dcec7f6c8e5747269c7b2dc74162bc9e/users/2ceb8702c948458a8773cfc2a23c7aa5/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:27.022101 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45946ffb-3b0d-4327-a7b1-a134d444cd5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcec7f6c8e5747269c7b2dc74162bc9e, user_id=2ceb8702c948458a8773cfc2a23c7aa5, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:27.025006 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45946ffb-3b0d-4327-a7b1-a134d444cd5b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:27.041262 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1181/2371] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:14:26 2022] PUT /identity/v3/projects/dcec7f6c8e5747269c7b2dc74162bc9e/users/2ceb8702c948458a8773cfc2a23c7aa5/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:27.041473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8fe5c-b743-425f-bc6c-6348e7b841e2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:27.052934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a461661-e0d5-4f31-b69b-b748d4f5c7a0 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:27.053225 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a461661-e0d5-4f31-b69b-b748d4f5c7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:27.053510 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a461661-e0d5-4f31-b69b-b748d4f5c7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:27.082886 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-7a461661-e0d5-4f31-b69b-b748d4f5c7a0 None None] MFA Rules not processed for user `2ceb8702c948458a8773cfc2a23c7aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:14:27.084170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7a461661-e0d5-4f31-b69b-b748d4f5c7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:27.109053 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd145b-e91c-4271-ae6d-cec0e0f01ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:27.110063 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd145b-e91c-4271-ae6d-cec0e0f01ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:27.110460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd145b-e91c-4271-ae6d-cec0e0f01ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:27.110671 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd145b-e91c-4271-ae6d-cec0e0f01ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:27.112798 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e9bd145b-e91c-4271-ae6d-cec0e0f01ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:27.134904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:27.155549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1182/2372] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:14:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:14:27.160943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a461661-e0d5-4f31-b69b-b748d4f5c7a0 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:27.181087 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:27.186357 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd145b-e91c-4271-ae6d-cec0e0f01ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:27.188113 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd145b-e91c-4271-ae6d-cec0e0f01ca0 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:27.199280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1191/2373] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:14:27.233120 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a461661-e0d5-4f31-b69b-b748d4f5c7a0 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:27.237927 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67500e7-bcbe-4fe4-bd05-349df4f9ef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:27.239302 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67500e7-bcbe-4fe4-bd05-349df4f9ef5b admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:27.239587 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67500e7-bcbe-4fe4-bd05-349df4f9ef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:27.239862 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67500e7-bcbe-4fe4-bd05-349df4f9ef5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:27.240560 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67500e7-bcbe-4fe4-bd05-349df4f9ef5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:27.242551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67500e7-bcbe-4fe4-bd05-349df4f9ef5b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:27.277880 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1183/2374] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:14:27 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:14:27.281098 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd145b-e91c-4271-ae6d-cec0e0f01ca0 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:27.293585 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd145b-e91c-4271-ae6d-cec0e0f01ca0 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:27.366302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de2b7f-f64e-4af6-b3f5-47af9b3d4dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:27.366976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de2b7f-f64e-4af6-b3f5-47af9b3d4dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:27.367258 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de2b7f-f64e-4af6-b3f5-47af9b3d4dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:27.367533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de2b7f-f64e-4af6-b3f5-47af9b3d4dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:27.368235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de2b7f-f64e-4af6-b3f5-47af9b3d4dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:27.370191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de2b7f-f64e-4af6-b3f5-47af9b3d4dc0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:27.402072 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1192/2375] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:14:27 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:14:27.404241 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67500e7-bcbe-4fe4-bd05-349df4f9ef5b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:27.417184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67500e7-bcbe-4fe4-bd05-349df4f9ef5b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:27.422327 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b348a-3f78-4ac8-95da-64d51a381af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:27.423081 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b348a-3f78-4ac8-95da-64d51a381af9 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:27.423438 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b348a-3f78-4ac8-95da-64d51a381af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:27.423791 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b348a-3f78-4ac8-95da-64d51a381af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:27.424548 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b348a-3f78-4ac8-95da-64d51a381af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:27.426697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b348a-3f78-4ac8-95da-64d51a381af9 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:27.438389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1184/2376] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:14:27.443082 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de2b7f-f64e-4af6-b3f5-47af9b3d4dc0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:27.454486 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de2b7f-f64e-4af6-b3f5-47af9b3d4dc0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:27.460485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb00225-6d98-4d00-8bb3-7b24c9055c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:27.461406 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb00225-6d98-4d00-8bb3-7b24c9055c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:27.461722 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb00225-6d98-4d00-8bb3-7b24c9055c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:27.462003 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb00225-6d98-4d00-8bb3-7b24c9055c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:27.462775 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb00225-6d98-4d00-8bb3-7b24c9055c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:27.464389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb00225-6d98-4d00-8bb3-7b24c9055c3c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:27.477087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1193/2377] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:14:27.481424 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b348a-3f78-4ac8-95da-64d51a381af9 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:27.492274 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b348a-3f78-4ac8-95da-64d51a381af9 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:27.496940 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17060b7-e74c-4600-b36c-e61200d8c27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:27.497852 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17060b7-e74c-4600-b36c-e61200d8c27e admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:27.498169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17060b7-e74c-4600-b36c-e61200d8c27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:27.498440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17060b7-e74c-4600-b36c-e61200d8c27e admin admin] PATH_INFO: `/v3/projects/e5f287496ed04505a34344ba2d84c448/users/73eb34b127694bc99e31564ccc62261a/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:27.514662 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17060b7-e74c-4600-b36c-e61200d8c27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5f287496ed04505a34344ba2d84c448, user_id=73eb34b127694bc99e31564ccc62261a, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:27.517335 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17060b7-e74c-4600-b36c-e61200d8c27e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:27.531628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1185/2378] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:14:27 2022] PUT /identity/v3/projects/e5f287496ed04505a34344ba2d84c448/users/73eb34b127694bc99e31564ccc62261a/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:27.542838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f5570-ebf5-4239-b213-de12860cbff6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:27.543125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f5570-ebf5-4239-b213-de12860cbff6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:27.543403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f5570-ebf5-4239-b213-de12860cbff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:27.572409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3e0f5570-ebf5-4239-b213-de12860cbff6 None None] MFA Rules not processed for user `73eb34b127694bc99e31564ccc62261a`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:14:27.573629 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3e0f5570-ebf5-4239-b213-de12860cbff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:27.642004 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1194/2379] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:14:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:14:27.647274 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17060b7-e74c-4600-b36c-e61200d8c27e admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:27.718401 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17060b7-e74c-4600-b36c-e61200d8c27e admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:27.723532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a818c-cb68-4eeb-8789-669ad4924629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:27.724203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a818c-cb68-4eeb-8789-669ad4924629 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:27.724490 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a818c-cb68-4eeb-8789-669ad4924629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:27.724765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a818c-cb68-4eeb-8789-669ad4924629 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:27.725455 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a818c-cb68-4eeb-8789-669ad4924629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:27.727505 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a818c-cb68-4eeb-8789-669ad4924629 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:27.754457 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1186/2380] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:14:27 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:14:27.758866 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f5570-ebf5-4239-b213-de12860cbff6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:27.770592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f5570-ebf5-4239-b213-de12860cbff6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:27.792433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:27.834200 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b392ea3-6410-4869-a344-7e376d45a549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:27.834890 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b392ea3-6410-4869-a344-7e376d45a549 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:27.835177 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b392ea3-6410-4869-a344-7e376d45a549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:27.835457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b392ea3-6410-4869-a344-7e376d45a549 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:27.836173 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b392ea3-6410-4869-a344-7e376d45a549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:27.838175 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b392ea3-6410-4869-a344-7e376d45a549 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:27.862461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1195/2381] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:14:27 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:14:27.867444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a818c-cb68-4eeb-8789-669ad4924629 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:27.879563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a818c-cb68-4eeb-8789-669ad4924629 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:27.884556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcd151-9363-4183-9bed-5c0f31836fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:27.885253 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcd151-9363-4183-9bed-5c0f31836fda admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:27.885540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcd151-9363-4183-9bed-5c0f31836fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:27.885857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcd151-9363-4183-9bed-5c0f31836fda admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:27.886600 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babcd151-9363-4183-9bed-5c0f31836fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:27.888238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babcd151-9363-4183-9bed-5c0f31836fda admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:27.900398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1187/2382] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:14:27.904507 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b392ea3-6410-4869-a344-7e376d45a549 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:27.916232 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b392ea3-6410-4869-a344-7e376d45a549 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:27.921037 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfb196-c0bb-48bf-b816-07329194d4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:27.921986 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfb196-c0bb-48bf-b816-07329194d4e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:27.922276 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfb196-c0bb-48bf-b816-07329194d4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:27.922561 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfb196-c0bb-48bf-b816-07329194d4e5 admin admin] PATH_INFO: `/v3/projects/7f7ce72c3486493aa089c7ee3fd161f4/users/64d6a2a1cdc6494699087fd15ba26ca1/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:27.941957 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfb196-c0bb-48bf-b816-07329194d4e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7ce72c3486493aa089c7ee3fd161f4, user_id=64d6a2a1cdc6494699087fd15ba26ca1, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:27.953904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfb196-c0bb-48bf-b816-07329194d4e5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:27.982816 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1196/2383] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:14:27 2022] PUT /identity/v3/projects/7f7ce72c3486493aa089c7ee3fd161f4/users/64d6a2a1cdc6494699087fd15ba26ca1/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:27.987704 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcd151-9363-4183-9bed-5c0f31836fda admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:27.999421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcd151-9363-4183-9bed-5c0f31836fda admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:28.061067 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:28.084739 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d28c6-e0ef-4c02-850b-1750c20c64a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:28.085596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d28c6-e0ef-4c02-850b-1750c20c64a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:28.085794 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d28c6-e0ef-4c02-850b-1750c20c64a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:28.086095 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d28c6-e0ef-4c02-850b-1750c20c64a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:28.087063 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d28c6-e0ef-4c02-850b-1750c20c64a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:28.088767 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d28c6-e0ef-4c02-850b-1750c20c64a4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:28.102865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1188/2384] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:14:28.106999 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfb196-c0bb-48bf-b816-07329194d4e5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:28.125176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfb196-c0bb-48bf-b816-07329194d4e5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:28.131697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8d2f4-ceb6-4eda-be5c-441296b243a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:28.132612 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8d2f4-ceb6-4eda-be5c-441296b243a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:28.132897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8d2f4-ceb6-4eda-be5c-441296b243a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:28.133178 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8d2f4-ceb6-4eda-be5c-441296b243a3 admin admin] PATH_INFO: `/v3/projects/7f7ce72c3486493aa089c7ee3fd161f4/users/64d6a2a1cdc6494699087fd15ba26ca1/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:28.135439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8d2f4-ceb6-4eda-be5c-441296b243a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7ce72c3486493aa089c7ee3fd161f4, user_id=64d6a2a1cdc6494699087fd15ba26ca1, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:28.138168 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8d2f4-ceb6-4eda-be5c-441296b243a3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:28.152100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1197/2385] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:14:28 2022] PUT /identity/v3/projects/7f7ce72c3486493aa089c7ee3fd161f4/users/64d6a2a1cdc6494699087fd15ba26ca1/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:28.165513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1f725-d3f1-4a7d-864d-91c94d01627a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:28.165513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1f725-d3f1-4a7d-864d-91c94d01627a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:28.165856 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1f725-d3f1-4a7d-864d-91c94d01627a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:28.194695 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-33d1f725-d3f1-4a7d-864d-91c94d01627a None None] MFA Rules not processed for user `64d6a2a1cdc6494699087fd15ba26ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:14:28.195939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-33d1f725-d3f1-4a7d-864d-91c94d01627a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:28.269920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1189/2386] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:14:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:14:28.281640 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8d2f4-ceb6-4eda-be5c-441296b243a3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:28.283448 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0ef8d2f4-ceb6-4eda-be5c-441296b243a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:28.344842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8d2f4-ceb6-4eda-be5c-441296b243a3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:28.349442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7355132-165e-47c2-bb62-ad7863f662c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:28.350234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7355132-165e-47c2-bb62-ad7863f662c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:28.350404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7355132-165e-47c2-bb62-ad7863f662c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:28.350688 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7355132-165e-47c2-bb62-ad7863f662c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:28.411921 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7355132-165e-47c2-bb62-ad7863f662c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:28.413525 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7355132-165e-47c2-bb62-ad7863f662c3 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:28.422880 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1198/2387] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:14:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:14:29.973739 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1f725-d3f1-4a7d-864d-91c94d01627a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:29.975397 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-33d1f725-d3f1-4a7d-864d-91c94d01627a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:29.989499 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1f725-d3f1-4a7d-864d-91c94d01627a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:29.993202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55024e-de65-417d-ad87-d92e1e562987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:29.993926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55024e-de65-417d-ad87-d92e1e562987 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:29.994176 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55024e-de65-417d-ad87-d92e1e562987 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:29.994454 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55024e-de65-417d-ad87-d92e1e562987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:30.078153 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55024e-de65-417d-ad87-d92e1e562987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:30.079615 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55024e-de65-417d-ad87-d92e1e562987 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:30.090210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1190/2388] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:14:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:14:30.768420 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7355132-165e-47c2-bb62-ad7863f662c3 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:30.778138 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7355132-165e-47c2-bb62-ad7863f662c3 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:30.786246 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3468118-9ba6-48f9-80d3-ef6b8e48f3ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:30.786727 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3468118-9ba6-48f9-80d3-ef6b8e48f3ab service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:30.787015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3468118-9ba6-48f9-80d3-ef6b8e48f3ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:30.787294 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3468118-9ba6-48f9-80d3-ef6b8e48f3ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:30.796919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3468118-9ba6-48f9-80d3-ef6b8e48f3ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:30.798387 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3468118-9ba6-48f9-80d3-ef6b8e48f3ab service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:30.808972 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1199/2389] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:14:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:14:33.990654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55024e-de65-417d-ad87-d92e1e562987 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:33.992126 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-dd55024e-de65-417d-ad87-d92e1e562987 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:34.065197 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55024e-de65-417d-ad87-d92e1e562987 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:34.070979 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129117ae-50cf-4f99-ac70-78d2d8e35b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:34.071857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129117ae-50cf-4f99-ac70-78d2d8e35b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:34.072150 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129117ae-50cf-4f99-ac70-78d2d8e35b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:34.072446 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129117ae-50cf-4f99-ac70-78d2d8e35b0c admin admin] PATH_INFO: `/v3/users/edf6a4f02eb34720b0126d17db1c1b86` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:34.073799 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129117ae-50cf-4f99-ac70-78d2d8e35b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf6a4f02eb34720b0126d17db1c1b86)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:34.075735 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129117ae-50cf-4f99-ac70-78d2d8e35b0c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:34.077413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:34.125445 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-129117ae-50cf-4f99-ac70-78d2d8e35b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf6a4f02eb34720b0126d17db1c1b86'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:34.132974 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-129117ae-50cf-4f99-ac70-78d2d8e35b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf6a4f02eb34720b0126d17db1c1b86'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:34.145227 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-129117ae-50cf-4f99-ac70-78d2d8e35b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf6a4f02eb34720b0126d17db1c1b86'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:34.145931 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-129117ae-50cf-4f99-ac70-78d2d8e35b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf6a4f02eb34720b0126d17db1c1b86'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:34.146536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-129117ae-50cf-4f99-ac70-78d2d8e35b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf6a4f02eb34720b0126d17db1c1b86'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:34.159614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1191/2390] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:14:33 2022] DELETE /identity/v3/users/edf6a4f02eb34720b0126d17db1c1b86 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:34.344790 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3468118-9ba6-48f9-80d3-ef6b8e48f3ab service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:34.357931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3468118-9ba6-48f9-80d3-ef6b8e48f3ab service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:34.374381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:34.434716 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd9a9e-4cc6-47dd-93ed-daf702c72b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:34.435581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd9a9e-4cc6-47dd-93ed-daf702c72b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:34.435864 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd9a9e-4cc6-47dd-93ed-daf702c72b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:34.436143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd9a9e-4cc6-47dd-93ed-daf702c72b20 admin admin] PATH_INFO: `/v3/projects/10568aeb4aba423585e0668a4a5e05d9` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:34.437528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd9a9e-4cc6-47dd-93ed-daf702c72b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10568aeb4aba423585e0668a4a5e05d9)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:34.439861 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd9a9e-4cc6-47dd-93ed-daf702c72b20 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:34.490459 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-26bd9a9e-4cc6-47dd-93ed-daf702c72b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10568aeb4aba423585e0668a4a5e05d9', 'request_id': 'req-26bd9a9e-4cc6-47dd-93ed-daf702c72b20'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:34.498289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-26bd9a9e-4cc6-47dd-93ed-daf702c72b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10568aeb4aba423585e0668a4a5e05d9', 'request_id': 'req-26bd9a9e-4cc6-47dd-93ed-daf702c72b20'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:34.506399 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-26bd9a9e-4cc6-47dd-93ed-daf702c72b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10568aeb4aba423585e0668a4a5e05d9', 'request_id': 'req-26bd9a9e-4cc6-47dd-93ed-daf702c72b20'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:34.517052 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-26bd9a9e-4cc6-47dd-93ed-daf702c72b20 admin admin] The token cache is being invalidate because project 10568aeb4aba423585e0668a4a5e05d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:14:34.517342 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-26bd9a9e-4cc6-47dd-93ed-daf702c72b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:34.518085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-26bd9a9e-4cc6-47dd-93ed-daf702c72b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:34.520792 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1200/2391] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:14:34 2022] DELETE /identity/v3/projects/10568aeb4aba423585e0668a4a5e05d9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:34.525138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129117ae-50cf-4f99-ac70-78d2d8e35b0c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:34.526784 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-129117ae-50cf-4f99-ac70-78d2d8e35b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:34.545500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129117ae-50cf-4f99-ac70-78d2d8e35b0c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:34.608102 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba687348-abcd-4ae0-b0a5-0d9e748eb66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:34.609031 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba687348-abcd-4ae0-b0a5-0d9e748eb66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:34.609310 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba687348-abcd-4ae0-b0a5-0d9e748eb66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:34.609582 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba687348-abcd-4ae0-b0a5-0d9e748eb66a admin admin] PATH_INFO: `/v3/users/f1e1d900d4394e80a62feac59bde10c3` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:34.611060 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba687348-abcd-4ae0-b0a5-0d9e748eb66a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e1d900d4394e80a62feac59bde10c3)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:34.613263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba687348-abcd-4ae0-b0a5-0d9e748eb66a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:34.668810 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ba687348-abcd-4ae0-b0a5-0d9e748eb66a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e1d900d4394e80a62feac59bde10c3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:34.676993 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ba687348-abcd-4ae0-b0a5-0d9e748eb66a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e1d900d4394e80a62feac59bde10c3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:34.695015 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ba687348-abcd-4ae0-b0a5-0d9e748eb66a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e1d900d4394e80a62feac59bde10c3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:34.695810 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ba687348-abcd-4ae0-b0a5-0d9e748eb66a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e1d900d4394e80a62feac59bde10c3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:34.698140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-ba687348-abcd-4ae0-b0a5-0d9e748eb66a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e1d900d4394e80a62feac59bde10c3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:34.708240 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:34.718593 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1192/2392] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:14:34 2022] DELETE /identity/v3/users/f1e1d900d4394e80a62feac59bde10c3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:34.907742 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd9a9e-4cc6-47dd-93ed-daf702c72b20 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:34.909412 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-26bd9a9e-4cc6-47dd-93ed-daf702c72b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:34.925287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd9a9e-4cc6-47dd-93ed-daf702c72b20 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:34.994361 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa693aeb-a7de-4588-bf30-63f93a45b144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:34.995317 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa693aeb-a7de-4588-bf30-63f93a45b144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:34.995603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa693aeb-a7de-4588-bf30-63f93a45b144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:34.995884 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa693aeb-a7de-4588-bf30-63f93a45b144 admin admin] PATH_INFO: `/v3/projects/e96a5638e2ff4acabb3b01d1938dd498` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:34.997171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa693aeb-a7de-4588-bf30-63f93a45b144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e96a5638e2ff4acabb3b01d1938dd498)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:34.999411 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa693aeb-a7de-4588-bf30-63f93a45b144 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:35.054465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fa693aeb-a7de-4588-bf30-63f93a45b144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e96a5638e2ff4acabb3b01d1938dd498', 'request_id': 'req-fa693aeb-a7de-4588-bf30-63f93a45b144'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:35.056180 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:35.072038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fa693aeb-a7de-4588-bf30-63f93a45b144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e96a5638e2ff4acabb3b01d1938dd498', 'request_id': 'req-fa693aeb-a7de-4588-bf30-63f93a45b144'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:35.086066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fa693aeb-a7de-4588-bf30-63f93a45b144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e96a5638e2ff4acabb3b01d1938dd498', 'request_id': 'req-fa693aeb-a7de-4588-bf30-63f93a45b144'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:35.100304 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fa693aeb-a7de-4588-bf30-63f93a45b144 admin admin] The token cache is being invalidate because project e96a5638e2ff4acabb3b01d1938dd498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:14:35.100815 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fa693aeb-a7de-4588-bf30-63f93a45b144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:35.101354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fa693aeb-a7de-4588-bf30-63f93a45b144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:35.102923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1201/2393] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:14:34 2022] DELETE /identity/v3/projects/e96a5638e2ff4acabb3b01d1938dd498 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:35.786290 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba687348-abcd-4ae0-b0a5-0d9e748eb66a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:35.787760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ba687348-abcd-4ae0-b0a5-0d9e748eb66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:35.800707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba687348-abcd-4ae0-b0a5-0d9e748eb66a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:35.859124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6266bfa-1c37-49db-8a76-3a49bd0b217e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:35.859996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6266bfa-1c37-49db-8a76-3a49bd0b217e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:35.860279 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6266bfa-1c37-49db-8a76-3a49bd0b217e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:35.860556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6266bfa-1c37-49db-8a76-3a49bd0b217e admin admin] PATH_INFO: `/v3/users/2ceb8702c948458a8773cfc2a23c7aa5` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:35.861778 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6266bfa-1c37-49db-8a76-3a49bd0b217e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ceb8702c948458a8773cfc2a23c7aa5)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:35.864041 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6266bfa-1c37-49db-8a76-3a49bd0b217e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:35.910998 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d6266bfa-1c37-49db-8a76-3a49bd0b217e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ceb8702c948458a8773cfc2a23c7aa5'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:35.918005 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d6266bfa-1c37-49db-8a76-3a49bd0b217e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ceb8702c948458a8773cfc2a23c7aa5'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:35.930241 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d6266bfa-1c37-49db-8a76-3a49bd0b217e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ceb8702c948458a8773cfc2a23c7aa5'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:35.930939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d6266bfa-1c37-49db-8a76-3a49bd0b217e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ceb8702c948458a8773cfc2a23c7aa5'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:35.931570 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d6266bfa-1c37-49db-8a76-3a49bd0b217e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ceb8702c948458a8773cfc2a23c7aa5'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:35.945622 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1193/2394] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:14:35 2022] DELETE /identity/v3/users/2ceb8702c948458a8773cfc2a23c7aa5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:35.950246 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413c40b-b63a-4983-8f69-ee622e38027b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:35.950731 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413c40b-b63a-4983-8f69-ee622e38027b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:35.950829 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413c40b-b63a-4983-8f69-ee622e38027b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:35.970235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9413c40b-b63a-4983-8f69-ee622e38027b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:14:35.971385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9413c40b-b63a-4983-8f69-ee622e38027b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:36.037122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1202/2395] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:14:36.046831 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6266bfa-1c37-49db-8a76-3a49bd0b217e admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:36.048249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d6266bfa-1c37-49db-8a76-3a49bd0b217e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:36.108094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6266bfa-1c37-49db-8a76-3a49bd0b217e admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:36.111883 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1df1e6-183a-4eb8-87f9-a8d3b7269e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:36.112538 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1df1e6-183a-4eb8-87f9-a8d3b7269e5c service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:36.112817 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1df1e6-183a-4eb8-87f9-a8d3b7269e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:36.113088 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1df1e6-183a-4eb8-87f9-a8d3b7269e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:36.122503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1df1e6-183a-4eb8-87f9-a8d3b7269e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:36.123956 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1df1e6-183a-4eb8-87f9-a8d3b7269e5c service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:36.134318 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1194/2396] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:14:36.409872 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413c40b-b63a-4983-8f69-ee622e38027b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:36.411413 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9413c40b-b63a-4983-8f69-ee622e38027b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:36.423830 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413c40b-b63a-4983-8f69-ee622e38027b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:36.429099 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb564c-71c4-48d2-8307-030dd96fce37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:36.429967 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb564c-71c4-48d2-8307-030dd96fce37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:36.430259 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb564c-71c4-48d2-8307-030dd96fce37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:36.430568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb564c-71c4-48d2-8307-030dd96fce37 admin admin] PATH_INFO: `/v3/projects/dcec7f6c8e5747269c7b2dc74162bc9e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:36.432772 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb564c-71c4-48d2-8307-030dd96fce37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcec7f6c8e5747269c7b2dc74162bc9e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:36.437085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb564c-71c4-48d2-8307-030dd96fce37 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:36.495560 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3ffb564c-71c4-48d2-8307-030dd96fce37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcec7f6c8e5747269c7b2dc74162bc9e', 'request_id': 'req-3ffb564c-71c4-48d2-8307-030dd96fce37'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:36.506289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3ffb564c-71c4-48d2-8307-030dd96fce37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcec7f6c8e5747269c7b2dc74162bc9e', 'request_id': 'req-3ffb564c-71c4-48d2-8307-030dd96fce37'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:36.512967 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3ffb564c-71c4-48d2-8307-030dd96fce37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcec7f6c8e5747269c7b2dc74162bc9e', 'request_id': 'req-3ffb564c-71c4-48d2-8307-030dd96fce37'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:36.523463 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3ffb564c-71c4-48d2-8307-030dd96fce37 admin admin] The token cache is being invalidate because project dcec7f6c8e5747269c7b2dc74162bc9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:14:36.523744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3ffb564c-71c4-48d2-8307-030dd96fce37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:36.524385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3ffb564c-71c4-48d2-8307-030dd96fce37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:36.525976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1203/2397] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:14:36 2022] DELETE /identity/v3/projects/dcec7f6c8e5747269c7b2dc74162bc9e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:36.530075 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1df1e6-183a-4eb8-87f9-a8d3b7269e5c service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:36.540507 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1df1e6-183a-4eb8-87f9-a8d3b7269e5c service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:36.557439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:36.599807 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfcfdf-ffba-4572-9272-d526f8ac940c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:36.600680 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfcfdf-ffba-4572-9272-d526f8ac940c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:36.600982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfcfdf-ffba-4572-9272-d526f8ac940c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:36.601243 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfcfdf-ffba-4572-9272-d526f8ac940c admin admin] PATH_INFO: `/v3/users/73eb34b127694bc99e31564ccc62261a` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:36.602473 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfcfdf-ffba-4572-9272-d526f8ac940c admin admin] RBAC: Authorizing `identity:delete_user(user_id=73eb34b127694bc99e31564ccc62261a)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:36.604402 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfcfdf-ffba-4572-9272-d526f8ac940c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:36.649369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-34bfcfdf-ffba-4572-9272-d526f8ac940c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73eb34b127694bc99e31564ccc62261a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:36.656634 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-34bfcfdf-ffba-4572-9272-d526f8ac940c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73eb34b127694bc99e31564ccc62261a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:36.669319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-34bfcfdf-ffba-4572-9272-d526f8ac940c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73eb34b127694bc99e31564ccc62261a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:36.670048 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-34bfcfdf-ffba-4572-9272-d526f8ac940c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73eb34b127694bc99e31564ccc62261a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:36.670684 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-34bfcfdf-ffba-4572-9272-d526f8ac940c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73eb34b127694bc99e31564ccc62261a'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:36.684387 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1195/2398] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:14:36 2022] DELETE /identity/v3/users/73eb34b127694bc99e31564ccc62261a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:14:36.965917 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb564c-71c4-48d2-8307-030dd96fce37 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:36.967728 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3ffb564c-71c4-48d2-8307-030dd96fce37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:36.982843 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb564c-71c4-48d2-8307-030dd96fce37 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:37.042285 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3ddcf-50c0-4b47-898f-d914878cd0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:37.043066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3ddcf-50c0-4b47-898f-d914878cd0d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:37.043354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3ddcf-50c0-4b47-898f-d914878cd0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:37.043632 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3ddcf-50c0-4b47-898f-d914878cd0d8 admin admin] PATH_INFO: `/v3/projects/e5f287496ed04505a34344ba2d84c448` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:37.044822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3ddcf-50c0-4b47-898f-d914878cd0d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5f287496ed04505a34344ba2d84c448)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:37.046765 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3ddcf-50c0-4b47-898f-d914878cd0d8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:37.049055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:37.095475 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0ff3ddcf-50c0-4b47-898f-d914878cd0d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5f287496ed04505a34344ba2d84c448', 'request_id': 'req-0ff3ddcf-50c0-4b47-898f-d914878cd0d8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:37.103371 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0ff3ddcf-50c0-4b47-898f-d914878cd0d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5f287496ed04505a34344ba2d84c448', 'request_id': 'req-0ff3ddcf-50c0-4b47-898f-d914878cd0d8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:37.109784 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0ff3ddcf-50c0-4b47-898f-d914878cd0d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5f287496ed04505a34344ba2d84c448', 'request_id': 'req-0ff3ddcf-50c0-4b47-898f-d914878cd0d8'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:37.120829 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0ff3ddcf-50c0-4b47-898f-d914878cd0d8 admin admin] The token cache is being invalidate because project e5f287496ed04505a34344ba2d84c448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:14:37.121117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0ff3ddcf-50c0-4b47-898f-d914878cd0d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:37.121784 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0ff3ddcf-50c0-4b47-898f-d914878cd0d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:37.123326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1204/2399] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:14:36 2022] DELETE /identity/v3/projects/e5f287496ed04505a34344ba2d84c448 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:37.127260 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfcfdf-ffba-4572-9272-d526f8ac940c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:37.129504 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-34bfcfdf-ffba-4572-9272-d526f8ac940c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:37.142392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfcfdf-ffba-4572-9272-d526f8ac940c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:37.208448 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0870d-2638-4391-bf91-2b79fd1d292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:37.209345 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0870d-2638-4391-bf91-2b79fd1d292f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:37.209633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0870d-2638-4391-bf91-2b79fd1d292f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:37.209953 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0870d-2638-4391-bf91-2b79fd1d292f admin admin] PATH_INFO: `/v3/users/64d6a2a1cdc6494699087fd15ba26ca1` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:37.211191 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0870d-2638-4391-bf91-2b79fd1d292f admin admin] RBAC: Authorizing `identity:delete_user(user_id=64d6a2a1cdc6494699087fd15ba26ca1)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:37.213133 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0870d-2638-4391-bf91-2b79fd1d292f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:37.256065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:37.262722 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8ce0870d-2638-4391-bf91-2b79fd1d292f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64d6a2a1cdc6494699087fd15ba26ca1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:37.271902 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8ce0870d-2638-4391-bf91-2b79fd1d292f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64d6a2a1cdc6494699087fd15ba26ca1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:37.283873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8ce0870d-2638-4391-bf91-2b79fd1d292f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64d6a2a1cdc6494699087fd15ba26ca1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:37.284580 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8ce0870d-2638-4391-bf91-2b79fd1d292f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64d6a2a1cdc6494699087fd15ba26ca1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:37.286743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8ce0870d-2638-4391-bf91-2b79fd1d292f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64d6a2a1cdc6494699087fd15ba26ca1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:37.299915 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1196/2400] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:14:37 2022] DELETE /identity/v3/users/64d6a2a1cdc6494699087fd15ba26ca1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:37.588079 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3ddcf-50c0-4b47-898f-d914878cd0d8 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:37.589542 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0ff3ddcf-50c0-4b47-898f-d914878cd0d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:37.602624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3ddcf-50c0-4b47-898f-d914878cd0d8 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:37.662233 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0395f57-3331-4ef7-8ea2-cbe0e313bdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:37.663093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0395f57-3331-4ef7-8ea2-cbe0e313bdaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:37.663375 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0395f57-3331-4ef7-8ea2-cbe0e313bdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:37.663651 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0395f57-3331-4ef7-8ea2-cbe0e313bdaa admin admin] PATH_INFO: `/v3/projects/7f7ce72c3486493aa089c7ee3fd161f4` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:37.664868 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0395f57-3331-4ef7-8ea2-cbe0e313bdaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f7ce72c3486493aa089c7ee3fd161f4)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:37.666820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0395f57-3331-4ef7-8ea2-cbe0e313bdaa admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:37.722213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d0395f57-3331-4ef7-8ea2-cbe0e313bdaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f7ce72c3486493aa089c7ee3fd161f4', 'request_id': 'req-d0395f57-3331-4ef7-8ea2-cbe0e313bdaa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:37.730648 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d0395f57-3331-4ef7-8ea2-cbe0e313bdaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f7ce72c3486493aa089c7ee3fd161f4', 'request_id': 'req-d0395f57-3331-4ef7-8ea2-cbe0e313bdaa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:37.737350 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d0395f57-3331-4ef7-8ea2-cbe0e313bdaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f7ce72c3486493aa089c7ee3fd161f4', 'request_id': 'req-d0395f57-3331-4ef7-8ea2-cbe0e313bdaa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:37.748942 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d0395f57-3331-4ef7-8ea2-cbe0e313bdaa admin admin] The token cache is being invalidate because project 7f7ce72c3486493aa089c7ee3fd161f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:14:37.749234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d0395f57-3331-4ef7-8ea2-cbe0e313bdaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:37.749919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d0395f57-3331-4ef7-8ea2-cbe0e313bdaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:14:37.751471 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1205/2401] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:14:37 2022] DELETE /identity/v3/projects/7f7ce72c3486493aa089c7ee3fd161f4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:37.757629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc28b0-baa8-433a-b3c0-e69121a10a04 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:37.757944 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc28b0-baa8-433a-b3c0-e69121a10a04 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:37.758227 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc28b0-baa8-433a-b3c0-e69121a10a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:37.776695 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-93bc28b0-baa8-433a-b3c0-e69121a10a04 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:14:37.777957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-93bc28b0-baa8-433a-b3c0-e69121a10a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:37.842556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1197/2402] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:14:37.852146 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2267309-d210-42aa-a3a8-ebf49de7e8ca None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:37.852572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2267309-d210-42aa-a3a8-ebf49de7e8ca None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:37.852877 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2267309-d210-42aa-a3a8-ebf49de7e8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:37.873202 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f2267309-d210-42aa-a3a8-ebf49de7e8ca None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:14:37.874450 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f2267309-d210-42aa-a3a8-ebf49de7e8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:37.883049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1206/2403] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:14:37.887742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc28b0-baa8-433a-b3c0-e69121a10a04 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:37.898200 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc28b0-baa8-433a-b3c0-e69121a10a04 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:37.902948 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4975fab-747a-400e-9529-a6a9aeb6d15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:37.903614 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4975fab-747a-400e-9529-a6a9aeb6d15f admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:37.903900 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4975fab-747a-400e-9529-a6a9aeb6d15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:37.904182 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4975fab-747a-400e-9529-a6a9aeb6d15f admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:37.904955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4975fab-747a-400e-9529-a6a9aeb6d15f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:14:37.905265 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4975fab-747a-400e-9529-a6a9aeb6d15f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:37.906928 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4975fab-747a-400e-9529-a6a9aeb6d15f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:37.919248 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1198/2404] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:14:37.923689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2267309-d210-42aa-a3a8-ebf49de7e8ca None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:37.933521 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2267309-d210-42aa-a3a8-ebf49de7e8ca None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:37.938158 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26872b2-901f-4b0d-8b6e-f90f8c55a2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:37.938811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26872b2-901f-4b0d-8b6e-f90f8c55a2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:37.939088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26872b2-901f-4b0d-8b6e-f90f8c55a2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:37.939358 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26872b2-901f-4b0d-8b6e-f90f8c55a2e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:37.940036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26872b2-901f-4b0d-8b6e-f90f8c55a2e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:37.942692 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26872b2-901f-4b0d-8b6e-f90f8c55a2e3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:37.955817 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:37.971312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1207/2405] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:14:37 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:14:37.975683 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4975fab-747a-400e-9529-a6a9aeb6d15f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:37.985779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4975fab-747a-400e-9529-a6a9aeb6d15f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:38.052530 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb5f1f-cbcf-4c27-9ab0-bd6f13c7394e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:38.053225 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb5f1f-cbcf-4c27-9ab0-bd6f13c7394e admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:38.053517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb5f1f-cbcf-4c27-9ab0-bd6f13c7394e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:38.053829 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb5f1f-cbcf-4c27-9ab0-bd6f13c7394e admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:38.054714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb5f1f-cbcf-4c27-9ab0-bd6f13c7394e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:38.056711 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb5f1f-cbcf-4c27-9ab0-bd6f13c7394e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:38.079679 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1199/2406] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:14:37 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:14:38.084037 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26872b2-901f-4b0d-8b6e-f90f8c55a2e3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:38.094797 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26872b2-901f-4b0d-8b6e-f90f8c55a2e3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:38.100071 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39f5ee-ecf4-4ef3-af76-1de00fc15e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:38.100737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39f5ee-ecf4-4ef3-af76-1de00fc15e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:38.101018 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39f5ee-ecf4-4ef3-af76-1de00fc15e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:38.101293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39f5ee-ecf4-4ef3-af76-1de00fc15e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:38.102069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39f5ee-ecf4-4ef3-af76-1de00fc15e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:38.103650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39f5ee-ecf4-4ef3-af76-1de00fc15e90 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:38.116769 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1208/2407] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:14:38.121282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb5f1f-cbcf-4c27-9ab0-bd6f13c7394e admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:38.132201 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb5f1f-cbcf-4c27-9ab0-bd6f13c7394e admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:38.136906 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb1141-51fa-47b2-a0fe-4efd312969ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:38.137566 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb1141-51fa-47b2-a0fe-4efd312969ff admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:38.137883 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb1141-51fa-47b2-a0fe-4efd312969ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:38.138160 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb1141-51fa-47b2-a0fe-4efd312969ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:38.138880 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb1141-51fa-47b2-a0fe-4efd312969ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:38.140494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb1141-51fa-47b2-a0fe-4efd312969ff admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:38.153291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1200/2408] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:14:38.157580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39f5ee-ecf4-4ef3-af76-1de00fc15e90 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:38.169157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39f5ee-ecf4-4ef3-af76-1de00fc15e90 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:38.174143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a5d87-718b-41fb-8feb-92354926510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:38.175062 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a5d87-718b-41fb-8feb-92354926510b admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:38.175974 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a5d87-718b-41fb-8feb-92354926510b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:38.176259 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a5d87-718b-41fb-8feb-92354926510b admin admin] PATH_INFO: `/v3/projects/7ebe073ea3874cf7bcee095cfb76edc8/users/3b62389a9ea247b4a19a8edaefeca9a3/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:38.191510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a5d87-718b-41fb-8feb-92354926510b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebe073ea3874cf7bcee095cfb76edc8, user_id=3b62389a9ea247b4a19a8edaefeca9a3, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:38.194217 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a5d87-718b-41fb-8feb-92354926510b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:38.206922 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1209/2409] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:14:38 2022] PUT /identity/v3/projects/7ebe073ea3874cf7bcee095cfb76edc8/users/3b62389a9ea247b4a19a8edaefeca9a3/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:14:38.218506 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326f4e1-7071-4881-93fb-f871afa2b117 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:38.218800 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326f4e1-7071-4881-93fb-f871afa2b117 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:38.219081 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326f4e1-7071-4881-93fb-f871afa2b117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:38.248719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-2326f4e1-7071-4881-93fb-f871afa2b117 None None] MFA Rules not processed for user `3b62389a9ea247b4a19a8edaefeca9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:14:38.249991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2326f4e1-7071-4881-93fb-f871afa2b117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:38.262309 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:38.323550 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1201/2410] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:14:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:14:38.336138 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a5d87-718b-41fb-8feb-92354926510b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:14:38.337904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7a5a5d87-718b-41fb-8feb-92354926510b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:14:38.397029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a5d87-718b-41fb-8feb-92354926510b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:14:38.400601 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058043f-2ad0-4e57-ab75-30a5f427aea4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d69d99d980744fba12a6b38586e7bf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:14:38.401242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058043f-2ad0-4e57-ab75-30a5f427aea4 service glance] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:14:38.401523 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058043f-2ad0-4e57-ab75-30a5f427aea4 service glance] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:14:38.401837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058043f-2ad0-4e57-ab75-30a5f427aea4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:14:38.410837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058043f-2ad0-4e57-ab75-30a5f427aea4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:14:38.412274 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058043f-2ad0-4e57-ab75-30a5f427aea4 service glance] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:14:38.421123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1210/2411] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:14:38 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:14:48.326665 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=21 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:48.417056 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:00.148087 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326f4e1-7071-4881-93fb-f871afa2b117 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:00.149508 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2326f4e1-7071-4881-93fb-f871afa2b117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:00.218668 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326f4e1-7071-4881-93fb-f871afa2b117 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:00.224309 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bdc47-ee35-4980-a1a7-5ffbf9f1b22b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bebc8414d01a40c8ab34afa9b1312a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:00.224962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bdc47-ee35-4980-a1a7-5ffbf9f1b22b service placement] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:00.225244 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bdc47-ee35-4980-a1a7-5ffbf9f1b22b service placement] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:00.225516 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bdc47-ee35-4980-a1a7-5ffbf9f1b22b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:00.227339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c97bdc47-ee35-4980-a1a7-5ffbf9f1b22b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:00.239950 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bdc47-ee35-4980-a1a7-5ffbf9f1b22b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:00.241535 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bdc47-ee35-4980-a1a7-5ffbf9f1b22b service placement] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:00.251735 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1202/2412] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:15:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:15:05.277936 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3fbf8-5142-4cb2-b7f6-e2935ed5e4bf None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:05.278674 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3fbf8-5142-4cb2-b7f6-e2935ed5e4bf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:05.278674 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3fbf8-5142-4cb2-b7f6-e2935ed5e4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:05.298629 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-3ff3fbf8-5142-4cb2-b7f6-e2935ed5e4bf None None] MFA Rules not processed for user `01881ccdf756480b8fcc1ac599fdf905`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:15:05.300780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3ff3fbf8-5142-4cb2-b7f6-e2935ed5e4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:05.373026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1211/2413] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:15:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:15:10.247379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=32 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:15.365497 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=25 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:29.802630 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bdc47-ee35-4980-a1a7-5ffbf9f1b22b service placement] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:29.898773 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bdc47-ee35-4980-a1a7-5ffbf9f1b22b service placement] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:29.903821 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322172b3-4fe3-4a6c-9c04-0d8aa9f35326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:29.904735 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322172b3-4fe3-4a6c-9c04-0d8aa9f35326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:29.905016 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322172b3-4fe3-4a6c-9c04-0d8aa9f35326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:29.905295 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322172b3-4fe3-4a6c-9c04-0d8aa9f35326 admin admin] PATH_INFO: `/v3/users/3b62389a9ea247b4a19a8edaefeca9a3` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:29.906606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322172b3-4fe3-4a6c-9c04-0d8aa9f35326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b62389a9ea247b4a19a8edaefeca9a3)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:29.909409 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322172b3-4fe3-4a6c-9c04-0d8aa9f35326 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:29.965600 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-322172b3-4fe3-4a6c-9c04-0d8aa9f35326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b62389a9ea247b4a19a8edaefeca9a3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:15:29.975391 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-322172b3-4fe3-4a6c-9c04-0d8aa9f35326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b62389a9ea247b4a19a8edaefeca9a3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:15:29.989134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-322172b3-4fe3-4a6c-9c04-0d8aa9f35326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b62389a9ea247b4a19a8edaefeca9a3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:15:29.989916 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-322172b3-4fe3-4a6c-9c04-0d8aa9f35326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b62389a9ea247b4a19a8edaefeca9a3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:15:29.990647 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-322172b3-4fe3-4a6c-9c04-0d8aa9f35326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b62389a9ea247b4a19a8edaefeca9a3'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:15:30.007739 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1203/2414] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:15:29 2022] DELETE /identity/v3/users/3b62389a9ea247b4a19a8edaefeca9a3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:15:30.012173 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7f075-a68a-49a0-bd98-05f0215a453a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:30.012695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7f075-a68a-49a0-bd98-05f0215a453a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:30.012813 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7f075-a68a-49a0-bd98-05f0215a453a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:30.032170 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9ea7f075-a68a-49a0-bd98-05f0215a453a None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:15:30.034296 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9ea7f075-a68a-49a0-bd98-05f0215a453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:30.099350 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1212/2415] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:15:30.109747 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322172b3-4fe3-4a6c-9c04-0d8aa9f35326 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:30.111974 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-322172b3-4fe3-4a6c-9c04-0d8aa9f35326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:30.192177 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322172b3-4fe3-4a6c-9c04-0d8aa9f35326 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:30.196176 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f329f-c022-4900-a017-fba31099eee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:30.196841 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f329f-c022-4900-a017-fba31099eee0 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:30.197126 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f329f-c022-4900-a017-fba31099eee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:30.197403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f329f-c022-4900-a017-fba31099eee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:30.207797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f329f-c022-4900-a017-fba31099eee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:30.209249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f329f-c022-4900-a017-fba31099eee0 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:30.221879 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1204/2416] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:15:30.524538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7f075-a68a-49a0-bd98-05f0215a453a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:30.526256 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9ea7f075-a68a-49a0-bd98-05f0215a453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:30.540751 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7f075-a68a-49a0-bd98-05f0215a453a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:30.545997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067463a-e280-405a-bb20-4fe15a7cd51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:30.546987 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067463a-e280-405a-bb20-4fe15a7cd51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:30.547338 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067463a-e280-405a-bb20-4fe15a7cd51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:30.547688 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067463a-e280-405a-bb20-4fe15a7cd51e admin admin] PATH_INFO: `/v3/projects/7ebe073ea3874cf7bcee095cfb76edc8` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:30.549118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067463a-e280-405a-bb20-4fe15a7cd51e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ebe073ea3874cf7bcee095cfb76edc8)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:30.551222 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067463a-e280-405a-bb20-4fe15a7cd51e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:30.604480 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0067463a-e280-405a-bb20-4fe15a7cd51e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ebe073ea3874cf7bcee095cfb76edc8', 'request_id': 'req-0067463a-e280-405a-bb20-4fe15a7cd51e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:15:30.614589 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0067463a-e280-405a-bb20-4fe15a7cd51e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ebe073ea3874cf7bcee095cfb76edc8', 'request_id': 'req-0067463a-e280-405a-bb20-4fe15a7cd51e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:15:30.621309 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0067463a-e280-405a-bb20-4fe15a7cd51e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ebe073ea3874cf7bcee095cfb76edc8', 'request_id': 'req-0067463a-e280-405a-bb20-4fe15a7cd51e'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:15:30.632889 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0067463a-e280-405a-bb20-4fe15a7cd51e admin admin] The token cache is being invalidate because project 7ebe073ea3874cf7bcee095cfb76edc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:15:30.633176 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0067463a-e280-405a-bb20-4fe15a7cd51e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:15:30.633867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-0067463a-e280-405a-bb20-4fe15a7cd51e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:15:30.635685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1213/2417] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:15:30 2022] DELETE /identity/v3/projects/7ebe073ea3874cf7bcee095cfb76edc8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:15:30.640486 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba6e8b-0c5b-4dda-8c07-2eab315d2c5b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:30.640777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba6e8b-0c5b-4dda-8c07-2eab315d2c5b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:30.641055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba6e8b-0c5b-4dda-8c07-2eab315d2c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:30.659152 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-96ba6e8b-0c5b-4dda-8c07-2eab315d2c5b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:15:30.660438 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-96ba6e8b-0c5b-4dda-8c07-2eab315d2c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:30.678281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:30.726274 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1205/2418] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:15:30.734673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b18436-c089-4f51-b620-a1359284a221 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:30.734988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b18436-c089-4f51-b620-a1359284a221 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:30.735290 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b18436-c089-4f51-b620-a1359284a221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:30.755384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d3b18436-c089-4f51-b620-a1359284a221 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:15:30.756576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d3b18436-c089-4f51-b620-a1359284a221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:30.764495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1214/2419] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:15:30.768730 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba6e8b-0c5b-4dda-8c07-2eab315d2c5b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:30.778814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba6e8b-0c5b-4dda-8c07-2eab315d2c5b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:30.784059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f42c5-e13f-4534-815d-aab39e56bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:30.784725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f42c5-e13f-4534-815d-aab39e56bfab admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:30.785014 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f42c5-e13f-4534-815d-aab39e56bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:30.785295 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f42c5-e13f-4534-815d-aab39e56bfab admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:30.786117 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f42c5-e13f-4534-815d-aab39e56bfab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:15:30.786431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f42c5-e13f-4534-815d-aab39e56bfab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:30.788141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f42c5-e13f-4534-815d-aab39e56bfab admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:30.800848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1206/2420] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:15:30.805259 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b18436-c089-4f51-b620-a1359284a221 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:30.815519 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b18436-c089-4f51-b620-a1359284a221 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:30.820707 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512e754-464c-4735-932d-516fffb83ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:30.821391 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512e754-464c-4735-932d-516fffb83ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:30.821697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512e754-464c-4735-932d-516fffb83ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:30.821983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512e754-464c-4735-932d-516fffb83ed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:30.822706 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512e754-464c-4735-932d-516fffb83ed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:30.824609 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512e754-464c-4735-932d-516fffb83ed6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:30.851093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1215/2421] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:15:30 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:15:30.855749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f42c5-e13f-4534-815d-aab39e56bfab admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:30.866560 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f42c5-e13f-4534-815d-aab39e56bfab admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:30.924274 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1178f-15aa-4314-a79d-e264cc7e7370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:30.924978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1178f-15aa-4314-a79d-e264cc7e7370 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:30.925263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1178f-15aa-4314-a79d-e264cc7e7370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:30.925542 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1178f-15aa-4314-a79d-e264cc7e7370 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:30.926264 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1178f-15aa-4314-a79d-e264cc7e7370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:30.928231 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1178f-15aa-4314-a79d-e264cc7e7370 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:30.948674 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1207/2422] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:15:30 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:15:30.952687 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512e754-464c-4735-932d-516fffb83ed6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:30.963748 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512e754-464c-4735-932d-516fffb83ed6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:30.969182 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713f3d7-4876-49b5-b82c-215e427ac780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:30.969900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713f3d7-4876-49b5-b82c-215e427ac780 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:30.970185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713f3d7-4876-49b5-b82c-215e427ac780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:30.970983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713f3d7-4876-49b5-b82c-215e427ac780 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:30.971743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713f3d7-4876-49b5-b82c-215e427ac780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:30.973447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713f3d7-4876-49b5-b82c-215e427ac780 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:30.985508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1216/2423] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:15:30.991183 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1178f-15aa-4314-a79d-e264cc7e7370 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:31.003224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1178f-15aa-4314-a79d-e264cc7e7370 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:31.008364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736628c-a9b7-4e82-807e-0c0ff7885df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:31.009078 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736628c-a9b7-4e82-807e-0c0ff7885df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:31.009362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736628c-a9b7-4e82-807e-0c0ff7885df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:31.009643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736628c-a9b7-4e82-807e-0c0ff7885df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:31.010413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736628c-a9b7-4e82-807e-0c0ff7885df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:31.012074 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736628c-a9b7-4e82-807e-0c0ff7885df1 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:31.024092 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1208/2424] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:15:31.029279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713f3d7-4876-49b5-b82c-215e427ac780 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:31.040934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713f3d7-4876-49b5-b82c-215e427ac780 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:31.046799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef792a7-3ef1-4b9a-b4cd-b75490e37054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:31.047734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef792a7-3ef1-4b9a-b4cd-b75490e37054 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:31.048104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef792a7-3ef1-4b9a-b4cd-b75490e37054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:31.048268 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef792a7-3ef1-4b9a-b4cd-b75490e37054 admin admin] PATH_INFO: `/v3/projects/dd5a225077df40c6b99ae3e05740d44e/users/6b0deb40045e47cba7ed81b1ae6b528d/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:31.068650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef792a7-3ef1-4b9a-b4cd-b75490e37054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5a225077df40c6b99ae3e05740d44e, user_id=6b0deb40045e47cba7ed81b1ae6b528d, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:31.071481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef792a7-3ef1-4b9a-b4cd-b75490e37054 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:31.086887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1217/2425] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:15:31 2022] PUT /identity/v3/projects/dd5a225077df40c6b99ae3e05740d44e/users/6b0deb40045e47cba7ed81b1ae6b528d/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:15:31.092488 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a10418-3013-45bd-8e4e-c8f5dbb3c4f9 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:31.092777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a10418-3013-45bd-8e4e-c8f5dbb3c4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:31.093058 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a10418-3013-45bd-8e4e-c8f5dbb3c4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:31.114103 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e8a10418-3013-45bd-8e4e-c8f5dbb3c4f9 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:15:31.115369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e8a10418-3013-45bd-8e4e-c8f5dbb3c4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:31.178346 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1209/2426] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:15:31.188177 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef792a7-3ef1-4b9a-b4cd-b75490e37054 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:31.190095 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-fef792a7-3ef1-4b9a-b4cd-b75490e37054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:31.212227 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:31.252492 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef792a7-3ef1-4b9a-b4cd-b75490e37054 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:31.256160 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8617ff-7fb5-43f0-a301-d4c9471b3196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:31.256797 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8617ff-7fb5-43f0-a301-d4c9471b3196 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:31.257078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8617ff-7fb5-43f0-a301-d4c9471b3196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:31.257353 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8617ff-7fb5-43f0-a301-d4c9471b3196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:31.266401 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8617ff-7fb5-43f0-a301-d4c9471b3196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:31.267917 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8617ff-7fb5-43f0-a301-d4c9471b3196 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:31.277413 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1218/2427] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:15:35.807238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d6084-50f7-484d-932b-266f70f2a898 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:35.807972 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d6084-50f7-484d-932b-266f70f2a898 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:35.807972 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d6084-50f7-484d-932b-266f70f2a898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:35.839442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-0f5d6084-50f7-484d-932b-266f70f2a898 None None] MFA Rules not processed for user `6b0deb40045e47cba7ed81b1ae6b528d`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:15:35.840696 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-0f5d6084-50f7-484d-932b-266f70f2a898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:35.862941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:35.915736 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1210/2428] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:15:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:15:35.920135 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8617ff-7fb5-43f0-a301-d4c9471b3196 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:35.931593 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8617ff-7fb5-43f0-a301-d4c9471b3196 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:35.936323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9faed-4a5d-4bba-bc0e-7212a6fbc1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:35.937110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9faed-4a5d-4bba-bc0e-7212a6fbc1bd admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:35.937403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9faed-4a5d-4bba-bc0e-7212a6fbc1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:35.937705 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9faed-4a5d-4bba-bc0e-7212a6fbc1bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:35.938420 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9faed-4a5d-4bba-bc0e-7212a6fbc1bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:35.941692 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9faed-4a5d-4bba-bc0e-7212a6fbc1bd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:35.971107 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1219/2429] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:15:35 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:15:35.975278 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d6084-50f7-484d-932b-266f70f2a898 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:35.988322 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d6084-50f7-484d-932b-266f70f2a898 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:36.046278 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccbb16-ad31-41e0-aa6f-c74dc87e3428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:36.046944 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccbb16-ad31-41e0-aa6f-c74dc87e3428 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:36.047228 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccbb16-ad31-41e0-aa6f-c74dc87e3428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:36.047503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccbb16-ad31-41e0-aa6f-c74dc87e3428 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:36.048218 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccbb16-ad31-41e0-aa6f-c74dc87e3428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:36.050749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccbb16-ad31-41e0-aa6f-c74dc87e3428 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:36.077107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1211/2430] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:15:35 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:15:36.081261 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9faed-4a5d-4bba-bc0e-7212a6fbc1bd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:36.092196 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9faed-4a5d-4bba-bc0e-7212a6fbc1bd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:36.097188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944b9a0-d717-4b36-a8bc-5514a61cb6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:36.097885 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944b9a0-d717-4b36-a8bc-5514a61cb6ff admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:36.098168 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944b9a0-d717-4b36-a8bc-5514a61cb6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:36.098442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944b9a0-d717-4b36-a8bc-5514a61cb6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:36.099161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944b9a0-d717-4b36-a8bc-5514a61cb6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:36.100747 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944b9a0-d717-4b36-a8bc-5514a61cb6ff admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:36.111917 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1220/2431] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:15:36.116132 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccbb16-ad31-41e0-aa6f-c74dc87e3428 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:36.126348 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccbb16-ad31-41e0-aa6f-c74dc87e3428 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:36.131859 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1552c-a38f-4454-a3b5-554f0464aeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:36.132741 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1552c-a38f-4454-a3b5-554f0464aeef admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:36.133020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1552c-a38f-4454-a3b5-554f0464aeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:36.133318 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1552c-a38f-4454-a3b5-554f0464aeef admin admin] PATH_INFO: `/v3/projects/0bc033640bb846018ee08c989d4da012/users/a9af65e5c80443cba93526b47d20ba51/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:36.149345 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1552c-a38f-4454-a3b5-554f0464aeef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc033640bb846018ee08c989d4da012, user_id=a9af65e5c80443cba93526b47d20ba51, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:36.152276 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1552c-a38f-4454-a3b5-554f0464aeef admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:36.169733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1212/2432] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:15:36 2022] PUT /identity/v3/projects/0bc033640bb846018ee08c989d4da012/users/a9af65e5c80443cba93526b47d20ba51/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:15:36.171216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944b9a0-d717-4b36-a8bc-5514a61cb6ff admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:36.182529 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944b9a0-d717-4b36-a8bc-5514a61cb6ff admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:36.240597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de59766-4187-4933-84e9-6dd2bd0a2df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:36.241266 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de59766-4187-4933-84e9-6dd2bd0a2df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:36.241548 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de59766-4187-4933-84e9-6dd2bd0a2df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:36.241866 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de59766-4187-4933-84e9-6dd2bd0a2df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:36.242589 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de59766-4187-4933-84e9-6dd2bd0a2df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:36.244202 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de59766-4187-4933-84e9-6dd2bd0a2df6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:36.254288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1221/2433] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:15:36.258557 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1552c-a38f-4454-a3b5-554f0464aeef admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:36.268902 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1552c-a38f-4454-a3b5-554f0464aeef admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:36.273468 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d37d0c-c1aa-4733-84f8-ecfb1eefe005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:36.274379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d37d0c-c1aa-4733-84f8-ecfb1eefe005 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:36.274655 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d37d0c-c1aa-4733-84f8-ecfb1eefe005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:36.274921 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d37d0c-c1aa-4733-84f8-ecfb1eefe005 admin admin] PATH_INFO: `/v3/projects/0bc033640bb846018ee08c989d4da012/users/a9af65e5c80443cba93526b47d20ba51/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:36.276873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d37d0c-c1aa-4733-84f8-ecfb1eefe005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc033640bb846018ee08c989d4da012, user_id=a9af65e5c80443cba93526b47d20ba51, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:36.279549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d37d0c-c1aa-4733-84f8-ecfb1eefe005 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:36.290727 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1213/2434] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:15:36 2022] PUT /identity/v3/projects/0bc033640bb846018ee08c989d4da012/users/a9af65e5c80443cba93526b47d20ba51/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:15:40.883706 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f78d4d-970a-46e3-9974-1dcf1a56f9b8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:40.884276 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f78d4d-970a-46e3-9974-1dcf1a56f9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:40.884767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f78d4d-970a-46e3-9974-1dcf1a56f9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:40.918513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-66f78d4d-970a-46e3-9974-1dcf1a56f9b8 None None] MFA Rules not processed for user `a9af65e5c80443cba93526b47d20ba51`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:15:40.919916 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-66f78d4d-970a-46e3-9974-1dcf1a56f9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:41.011778 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1222/2435] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:15:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:15:41.021436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d37d0c-c1aa-4733-84f8-ecfb1eefe005 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:41.023610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e6d37d0c-c1aa-4733-84f8-ecfb1eefe005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:41.139834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d37d0c-c1aa-4733-84f8-ecfb1eefe005 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:41.148758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152f101-0eb2-40ae-841d-1876e7da5f74 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d69d99d980744fba12a6b38586e7bf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:41.149435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152f101-0eb2-40ae-841d-1876e7da5f74 service glance] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:41.149814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152f101-0eb2-40ae-841d-1876e7da5f74 service glance] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:41.150096 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152f101-0eb2-40ae-841d-1876e7da5f74 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:41.186287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:41.232729 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152f101-0eb2-40ae-841d-1876e7da5f74 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:41.234418 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152f101-0eb2-40ae-841d-1876e7da5f74 service glance] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:41.254096 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1214/2436] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:15:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:15:41.363588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abb8cb-71eb-4cc9-b145-1dd940274d91 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:41.363882 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abb8cb-71eb-4cc9-b145-1dd940274d91 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:41.364164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abb8cb-71eb-4cc9-b145-1dd940274d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:41.387945 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-22abb8cb-71eb-4cc9-b145-1dd940274d91 None None] MFA Rules not processed for user `9692d55c8c924544a1bff62054731ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:15:41.389218 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-22abb8cb-71eb-4cc9-b145-1dd940274d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:41.395710 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:41.457791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1223/2437] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 18 17:15:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:15:41.514046 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152f101-0eb2-40ae-841d-1876e7da5f74 service glance] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:41.515670 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7152f101-0eb2-40ae-841d-1876e7da5f74 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:41.614064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152f101-0eb2-40ae-841d-1876e7da5f74 service glance] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:41.619534 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd2ed6-4a7d-41fc-b814-aed2ce5f0d90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b712c7f5fce54fe2a89d63863f3845f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:41.620194 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd2ed6-4a7d-41fc-b814-aed2ce5f0d90 service swift] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:41.620477 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd2ed6-4a7d-41fc-b814-aed2ce5f0d90 service swift] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:41.620787 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd2ed6-4a7d-41fc-b814-aed2ce5f0d90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:41.634164 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd2ed6-4a7d-41fc-b814-aed2ce5f0d90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:41.635798 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd2ed6-4a7d-41fc-b814-aed2ce5f0d90 service swift] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:41.646141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1215/2438] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 18 17:15:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 17:15:50.431457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de559b9-4d89-4926-b302-e777cf13e9a4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:50.432055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de559b9-4d89-4926-b302-e777cf13e9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:50.432055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de559b9-4d89-4926-b302-e777cf13e9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:50.451177 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4de559b9-4d89-4926-b302-e777cf13e9a4 None None] MFA Rules not processed for user `6b0deb40045e47cba7ed81b1ae6b528d`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:15:50.452439 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4de559b9-4d89-4926-b302-e777cf13e9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:50.460929 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1224/2439] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:15:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:15:51.641476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=48 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:52.504279 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f46109-f1ff-4a90-86ee-eac1e6b3cf6e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:52.504654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f46109-f1ff-4a90-86ee-eac1e6b3cf6e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:52.504940 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f46109-f1ff-4a90-86ee-eac1e6b3cf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:52.524936 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e8f46109-f1ff-4a90-86ee-eac1e6b3cf6e None None] MFA Rules not processed for user `9692d55c8c924544a1bff62054731ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:15:52.526327 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e8f46109-f1ff-4a90-86ee-eac1e6b3cf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:52.535002 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1216/2440] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 18 17:15:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:15:52.548814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de559b9-4d89-4926-b302-e777cf13e9a4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:52.561473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de559b9-4d89-4926-b302-e777cf13e9a4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:52.574568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17c48f-8634-47cc-91fa-9ebb74c80e8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b712c7f5fce54fe2a89d63863f3845f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:52.575397 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17c48f-8634-47cc-91fa-9ebb74c80e8d service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:52.575707 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17c48f-8634-47cc-91fa-9ebb74c80e8d service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:52.576016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17c48f-8634-47cc-91fa-9ebb74c80e8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:52.586591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17c48f-8634-47cc-91fa-9ebb74c80e8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:52.588123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17c48f-8634-47cc-91fa-9ebb74c80e8d service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:52.598370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1225/2441] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 18 17:15:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 17:15:53.336491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f46109-f1ff-4a90-86ee-eac1e6b3cf6e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:53.399042 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f46109-f1ff-4a90-86ee-eac1e6b3cf6e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:53.402950 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05482d-b0fb-4219-bc77-26aaaf7bbf72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:53.403623 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05482d-b0fb-4219-bc77-26aaaf7bbf72 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:53.403910 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05482d-b0fb-4219-bc77-26aaaf7bbf72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:53.404186 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05482d-b0fb-4219-bc77-26aaaf7bbf72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:53.406148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bc05482d-b0fb-4219-bc77-26aaaf7bbf72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:53.504718 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05482d-b0fb-4219-bc77-26aaaf7bbf72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:53.506230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05482d-b0fb-4219-bc77-26aaaf7bbf72 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:53.519648 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1217/2442] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:15:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:15:54.714073 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17c48f-8634-47cc-91fa-9ebb74c80e8d service swift] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:15:54.715596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6f17c48f-8634-47cc-91fa-9ebb74c80e8d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:54.729918 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17c48f-8634-47cc-91fa-9ebb74c80e8d service swift] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:15:54.733599 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44414f-6285-45d5-a324-6b4ec3f70e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:15:54.734513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44414f-6285-45d5-a324-6b4ec3f70e0f service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:15:54.734960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44414f-6285-45d5-a324-6b4ec3f70e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:15:54.735444 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44414f-6285-45d5-a324-6b4ec3f70e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:15:54.738417 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0c44414f-6285-45d5-a324-6b4ec3f70e0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:15:54.756009 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44414f-6285-45d5-a324-6b4ec3f70e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:15:54.757823 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44414f-6285-45d5-a324-6b4ec3f70e0f service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:15:54.771870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1226/2443] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:15:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:16:03.513468 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=57 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:16:04.764666 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=35 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:16:32.014333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd203b1-b48f-4598-8768-0e893b69c25b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:16:32.014850 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd203b1-b48f-4598-8768-0e893b69c25b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:16:32.014943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd203b1-b48f-4598-8768-0e893b69c25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:16:32.033533 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9cd203b1-b48f-4598-8768-0e893b69c25b None None] MFA Rules not processed for user `9692d55c8c924544a1bff62054731ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:16:32.035215 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9cd203b1-b48f-4598-8768-0e893b69c25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:16:32.042414 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1218/2444] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 18 17:16:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:16:32.055063 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44414f-6285-45d5-a324-6b4ec3f70e0f service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:16:32.068643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44414f-6285-45d5-a324-6b4ec3f70e0f service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:16:32.074469 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75faf0-3b0c-4f87-b5d0-cf30eca35b73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b712c7f5fce54fe2a89d63863f3845f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:16:32.075203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75faf0-3b0c-4f87-b5d0-cf30eca35b73 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:16:32.075555 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75faf0-3b0c-4f87-b5d0-cf30eca35b73 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:16:32.075872 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75faf0-3b0c-4f87-b5d0-cf30eca35b73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:16:32.085898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75faf0-3b0c-4f87-b5d0-cf30eca35b73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:16:32.087653 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75faf0-3b0c-4f87-b5d0-cf30eca35b73 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:16:32.096970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1227/2445] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 18 17:16:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 17:16:32.879748 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd203b1-b48f-4598-8768-0e893b69c25b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:16:32.892379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd203b1-b48f-4598-8768-0e893b69c25b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:16:32.896837 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7d306-0b7f-4118-aeec-af549ce6806b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:16:32.897612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7d306-0b7f-4118-aeec-af549ce6806b service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:16:32.897933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7d306-0b7f-4118-aeec-af549ce6806b service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:16:32.898217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7d306-0b7f-4118-aeec-af549ce6806b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:16:32.909313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7d306-0b7f-4118-aeec-af549ce6806b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:16:32.910828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7d306-0b7f-4118-aeec-af549ce6806b service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:16:32.925554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1219/2446] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:16:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:16:35.462219 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75faf0-3b0c-4f87-b5d0-cf30eca35b73 service swift] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:16:35.478957 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75faf0-3b0c-4f87-b5d0-cf30eca35b73 service swift] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:16:35.490285 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577dfca-9fd3-4d00-8886-4e40c42483ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:16:35.491055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577dfca-9fd3-4d00-8886-4e40c42483ff service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:16:35.491407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577dfca-9fd3-4d00-8886-4e40c42483ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:16:35.491758 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577dfca-9fd3-4d00-8886-4e40c42483ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:16:35.494869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f577dfca-9fd3-4d00-8886-4e40c42483ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:16:35.520505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577dfca-9fd3-4d00-8886-4e40c42483ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:16:35.525408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577dfca-9fd3-4d00-8886-4e40c42483ff service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:16:35.542192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1228/2447] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:16:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:16:42.916777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=9 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:16:45.536163 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=12 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:16:49.783672 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a895a-403f-45d5-b285-d6feb5794f12 None None] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:16:49.784701 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a895a-403f-45d5-b285-d6feb5794f12 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:16:49.785154 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a895a-403f-45d5-b285-d6feb5794f12 None None] PATH_INFO: `/` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:16:49.787240 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1220/2448] 10.222.0.49 () {54 vars in 921 bytes} [Wed May 18 17:16:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 18 17:16:49.792992 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537fcec-4ca7-485f-a626-f547216b3e08 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:16:49.793871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537fcec-4ca7-485f-a626-f547216b3e08 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:16:49.794321 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537fcec-4ca7-485f-a626-f547216b3e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:16:49.817350 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-1537fcec-4ca7-485f-a626-f547216b3e08 None None] MFA Rules not processed for user `c9e3c0ef5ed943d183b064f383fc01f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:16:49.818627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1537fcec-4ca7-485f-a626-f547216b3e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:16:49.828991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1229/2449] 10.222.0.49 () {58 vars in 1018 bytes} [Wed May 18 17:16:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:16:49.840697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a895a-403f-45d5-b285-d6feb5794f12 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:16:49.852981 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a895a-403f-45d5-b285-d6feb5794f12 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:16:49.856648 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ce6dc-dacb-4a00-82ea-07799285b299 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d69d99d980744fba12a6b38586e7bf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:16:49.857292 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ce6dc-dacb-4a00-82ea-07799285b299 service glance] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:16:49.857623 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ce6dc-dacb-4a00-82ea-07799285b299 service glance] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:16:49.858561 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ce6dc-dacb-4a00-82ea-07799285b299 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:16:49.870993 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ce6dc-dacb-4a00-82ea-07799285b299 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:16:49.872465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ce6dc-dacb-4a00-82ea-07799285b299 service glance] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:16:49.885155 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1221/2450] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:16:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:16:50.310930 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537fcec-4ca7-485f-a626-f547216b3e08 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:16:50.313434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1537fcec-4ca7-485f-a626-f547216b3e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:16:50.418646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537fcec-4ca7-485f-a626-f547216b3e08 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:16:50.424156 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb213c-111a-4187-b67a-90e55860c028 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bebc8414d01a40c8ab34afa9b1312a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:16:50.424868 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb213c-111a-4187-b67a-90e55860c028 service placement] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:16:50.425165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb213c-111a-4187-b67a-90e55860c028 service placement] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:16:50.425473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb213c-111a-4187-b67a-90e55860c028 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:16:50.427509 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-ebdb213c-111a-4187-b67a-90e55860c028 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:16:50.441270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb213c-111a-4187-b67a-90e55860c028 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:16:50.442968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb213c-111a-4187-b67a-90e55860c028 service placement] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:16:50.459754 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1230/2451] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:16:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:16:52.527842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a06ac-80ac-4be3-8d3e-5a2af214cc70 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:16:52.528363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a06ac-80ac-4be3-8d3e-5a2af214cc70 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:16:52.528475 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a06ac-80ac-4be3-8d3e-5a2af214cc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:16:52.550522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c61a06ac-80ac-4be3-8d3e-5a2af214cc70 None None] MFA Rules not processed for user `9692d55c8c924544a1bff62054731ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:16:52.551859 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c61a06ac-80ac-4be3-8d3e-5a2af214cc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:16:52.559974 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1222/2452] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 18 17:16:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:16:52.578117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb213c-111a-4187-b67a-90e55860c028 service placement] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:16:52.593498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb213c-111a-4187-b67a-90e55860c028 service placement] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:16:52.602555 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef5dfb-094e-4201-be8e-b347a4d0bfd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b712c7f5fce54fe2a89d63863f3845f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:16:52.603232 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef5dfb-094e-4201-be8e-b347a4d0bfd0 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:16:52.603534 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef5dfb-094e-4201-be8e-b347a4d0bfd0 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:16:52.603810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef5dfb-094e-4201-be8e-b347a4d0bfd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:16:52.614627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef5dfb-094e-4201-be8e-b347a4d0bfd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:16:52.616410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef5dfb-094e-4201-be8e-b347a4d0bfd0 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:16:52.626369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1231/2453] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 18 17:16:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 17:16:56.367282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a06ac-80ac-4be3-8d3e-5a2af214cc70 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:16:56.368814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c61a06ac-80ac-4be3-8d3e-5a2af214cc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:16:56.496289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a06ac-80ac-4be3-8d3e-5a2af214cc70 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:16:56.500401 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5770c1d-0a89-44d0-873d-75a91948b360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:16:56.501088 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5770c1d-0a89-44d0-873d-75a91948b360 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:16:56.501410 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5770c1d-0a89-44d0-873d-75a91948b360 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:16:56.501728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5770c1d-0a89-44d0-873d-75a91948b360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:16:56.504076 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b5770c1d-0a89-44d0-873d-75a91948b360 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:16:56.650892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5770c1d-0a89-44d0-873d-75a91948b360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:16:56.652277 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5770c1d-0a89-44d0-873d-75a91948b360 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:16:56.677359 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1223/2454] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:16:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:16:56.821709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef5dfb-094e-4201-be8e-b347a4d0bfd0 service swift] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:16:56.852293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef5dfb-094e-4201-be8e-b347a4d0bfd0 service swift] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:16:56.856295 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d79a35-f3f4-4044-ba01-cf634c562d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:16:56.857044 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d79a35-f3f4-4044-ba01-cf634c562d98 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:16:56.857404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d79a35-f3f4-4044-ba01-cf634c562d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:16:56.857813 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d79a35-f3f4-4044-ba01-cf634c562d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:16:56.860151 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-70d79a35-f3f4-4044-ba01-cf634c562d98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:16:57.004743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d79a35-f3f4-4044-ba01-cf634c562d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:16:57.006228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d79a35-f3f4-4044-ba01-cf634c562d98 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:16:57.028237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1232/2455] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:17:01.419019 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5770c1d-0a89-44d0-873d-75a91948b360 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:01.421325 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b5770c1d-0a89-44d0-873d-75a91948b360 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:01.441921 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5770c1d-0a89-44d0-873d-75a91948b360 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:01.447866 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811a0aa-2869-4b0a-a7b7-2537721ee5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:01.449309 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811a0aa-2869-4b0a-a7b7-2537721ee5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:01.449839 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811a0aa-2869-4b0a-a7b7-2537721ee5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:01.450291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811a0aa-2869-4b0a-a7b7-2537721ee5a4 admin admin] PATH_INFO: `/v3/users/9b596d7285294117b826f459a39872c1` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:01.452150 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811a0aa-2869-4b0a-a7b7-2537721ee5a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b596d7285294117b826f459a39872c1)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:01.455229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811a0aa-2869-4b0a-a7b7-2537721ee5a4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:01.487424 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:01.536019 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c811a0aa-2869-4b0a-a7b7-2537721ee5a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b596d7285294117b826f459a39872c1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:01.552473 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c811a0aa-2869-4b0a-a7b7-2537721ee5a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b596d7285294117b826f459a39872c1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:01.577872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c811a0aa-2869-4b0a-a7b7-2537721ee5a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b596d7285294117b826f459a39872c1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:01.578671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c811a0aa-2869-4b0a-a7b7-2537721ee5a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b596d7285294117b826f459a39872c1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:01.579310 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c811a0aa-2869-4b0a-a7b7-2537721ee5a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b596d7285294117b826f459a39872c1'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:01.610247 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1224/2456] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:17:01 2022] DELETE /identity/v3/users/9b596d7285294117b826f459a39872c1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:01.874754 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d79a35-f3f4-4044-ba01-cf634c562d98 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:01.888832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d79a35-f3f4-4044-ba01-cf634c562d98 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:01.916159 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:02.039595 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be5ec7-fc52-4fc1-bb5b-d0e2bb248156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:02.041189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be5ec7-fc52-4fc1-bb5b-d0e2bb248156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:02.041791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be5ec7-fc52-4fc1-bb5b-d0e2bb248156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:02.042151 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be5ec7-fc52-4fc1-bb5b-d0e2bb248156 admin admin] PATH_INFO: `/v3/projects/2ffb442f11714159af838b0176f885ca` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:02.043675 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be5ec7-fc52-4fc1-bb5b-d0e2bb248156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ffb442f11714159af838b0176f885ca)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:02.046612 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be5ec7-fc52-4fc1-bb5b-d0e2bb248156 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:02.144308 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f6be5ec7-fc52-4fc1-bb5b-d0e2bb248156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ffb442f11714159af838b0176f885ca', 'request_id': 'req-f6be5ec7-fc52-4fc1-bb5b-d0e2bb248156'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:02.154202 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f6be5ec7-fc52-4fc1-bb5b-d0e2bb248156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ffb442f11714159af838b0176f885ca', 'request_id': 'req-f6be5ec7-fc52-4fc1-bb5b-d0e2bb248156'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:02.165449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f6be5ec7-fc52-4fc1-bb5b-d0e2bb248156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ffb442f11714159af838b0176f885ca', 'request_id': 'req-f6be5ec7-fc52-4fc1-bb5b-d0e2bb248156'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:02.180656 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f6be5ec7-fc52-4fc1-bb5b-d0e2bb248156 admin admin] The token cache is being invalidate because project 2ffb442f11714159af838b0176f885ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:17:02.181043 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f6be5ec7-fc52-4fc1-bb5b-d0e2bb248156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:02.181859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f6be5ec7-fc52-4fc1-bb5b-d0e2bb248156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:02.184106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1233/2457] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:17:01 2022] DELETE /identity/v3/projects/2ffb442f11714159af838b0176f885ca => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:02.190430 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bab73-2437-4102-8058-3997fe850d4d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:02.190819 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bab73-2437-4102-8058-3997fe850d4d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:02.191606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bab73-2437-4102-8058-3997fe850d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:02.250148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-133bab73-2437-4102-8058-3997fe850d4d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:02.251487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-133bab73-2437-4102-8058-3997fe850d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:02.323638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1225/2458] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:02.332192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8c5b7-5a5b-4790-802a-ee3e7d39f7ec None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:02.332478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8c5b7-5a5b-4790-802a-ee3e7d39f7ec None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:02.332755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8c5b7-5a5b-4790-802a-ee3e7d39f7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:02.364081 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-39c8c5b7-5a5b-4790-802a-ee3e7d39f7ec None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:02.365407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-39c8c5b7-5a5b-4790-802a-ee3e7d39f7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:02.375118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1234/2459] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:02.380679 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bab73-2437-4102-8058-3997fe850d4d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:02.392669 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bab73-2437-4102-8058-3997fe850d4d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:02.397876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b25a72-7dcf-4b63-8cf2-cb71565549e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:02.398557 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b25a72-7dcf-4b63-8cf2-cb71565549e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:02.398850 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b25a72-7dcf-4b63-8cf2-cb71565549e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:02.399127 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b25a72-7dcf-4b63-8cf2-cb71565549e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:02.399871 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b25a72-7dcf-4b63-8cf2-cb71565549e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:17:02.400181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b25a72-7dcf-4b63-8cf2-cb71565549e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:02.402024 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b25a72-7dcf-4b63-8cf2-cb71565549e6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:02.417710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1226/2460] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 17:17:02.422159 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8c5b7-5a5b-4790-802a-ee3e7d39f7ec None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:02.434002 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8c5b7-5a5b-4790-802a-ee3e7d39f7ec None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:02.439677 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be15bf-9ff1-4393-a00b-20f09ecfa081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:02.440324 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be15bf-9ff1-4393-a00b-20f09ecfa081 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:02.440608 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be15bf-9ff1-4393-a00b-20f09ecfa081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:02.440886 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be15bf-9ff1-4393-a00b-20f09ecfa081 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:02.441603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be15bf-9ff1-4393-a00b-20f09ecfa081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:02.443626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be15bf-9ff1-4393-a00b-20f09ecfa081 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:02.476421 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1235/2461] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:17:02 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:17:02.480716 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b25a72-7dcf-4b63-8cf2-cb71565549e6 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:02.492605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b25a72-7dcf-4b63-8cf2-cb71565549e6 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:02.574536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1197787-be75-4e3d-871e-e3b3e012ed70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:02.575097 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1197787-be75-4e3d-871e-e3b3e012ed70 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:02.575367 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1197787-be75-4e3d-871e-e3b3e012ed70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:02.575653 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1197787-be75-4e3d-871e-e3b3e012ed70 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:02.576383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1197787-be75-4e3d-871e-e3b3e012ed70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:02.578812 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1197787-be75-4e3d-871e-e3b3e012ed70 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:02.587494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:02.607550 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1227/2462] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:17:02 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:17:02.608863 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be15bf-9ff1-4393-a00b-20f09ecfa081 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:02.621165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be15bf-9ff1-4393-a00b-20f09ecfa081 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:02.626870 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102cd3e-e76b-4c9d-bd6a-b9f888094940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:02.627821 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102cd3e-e76b-4c9d-bd6a-b9f888094940 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:02.628259 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102cd3e-e76b-4c9d-bd6a-b9f888094940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:02.628616 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102cd3e-e76b-4c9d-bd6a-b9f888094940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:02.629372 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102cd3e-e76b-4c9d-bd6a-b9f888094940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:02.631037 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102cd3e-e76b-4c9d-bd6a-b9f888094940 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:02.644688 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1236/2463] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:17:02.649708 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1197787-be75-4e3d-871e-e3b3e012ed70 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:02.662774 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1197787-be75-4e3d-871e-e3b3e012ed70 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:02.667975 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a4db6-f37e-4d72-a48f-211f927aba8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:02.668910 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a4db6-f37e-4d72-a48f-211f927aba8a admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:02.669569 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a4db6-f37e-4d72-a48f-211f927aba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:02.670045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a4db6-f37e-4d72-a48f-211f927aba8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:02.671239 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a4db6-f37e-4d72-a48f-211f927aba8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:02.673001 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a4db6-f37e-4d72-a48f-211f927aba8a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:02.685047 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1228/2464] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:17:02.691157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102cd3e-e76b-4c9d-bd6a-b9f888094940 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:02.703478 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102cd3e-e76b-4c9d-bd6a-b9f888094940 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:02.713712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5485dac-628b-4712-ad5d-a213a0bea7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:02.714792 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5485dac-628b-4712-ad5d-a213a0bea7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:02.715076 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5485dac-628b-4712-ad5d-a213a0bea7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:02.715445 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5485dac-628b-4712-ad5d-a213a0bea7cc admin admin] PATH_INFO: `/v3/projects/ccc3e8453956417bb207ecdc8c0b59c4/users/5d0b378265254af490c0c22654fdf582/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:02.743528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5485dac-628b-4712-ad5d-a213a0bea7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc3e8453956417bb207ecdc8c0b59c4, user_id=5d0b378265254af490c0c22654fdf582, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:02.746649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5485dac-628b-4712-ad5d-a213a0bea7cc admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:02.763495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1237/2465] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:17:02 2022] PUT /identity/v3/projects/ccc3e8453956417bb207ecdc8c0b59c4/users/5d0b378265254af490c0c22654fdf582/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:02.775538 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6973a0-cf92-465c-aecd-8d8179fa8df2 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:02.775920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6973a0-cf92-465c-aecd-8d8179fa8df2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:02.776327 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6973a0-cf92-465c-aecd-8d8179fa8df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:02.807828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5c6973a0-cf92-465c-aecd-8d8179fa8df2 None None] MFA Rules not processed for user `5d0b378265254af490c0c22654fdf582`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:02.809084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5c6973a0-cf92-465c-aecd-8d8179fa8df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:02.882466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1229/2466] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:02.886833 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5485dac-628b-4712-ad5d-a213a0bea7cc admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:02.936444 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:02.957570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5485dac-628b-4712-ad5d-a213a0bea7cc admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:02.962504 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d665203-8f06-4af4-9a8f-5697fa0b636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:02.963229 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d665203-8f06-4af4-9a8f-5697fa0b636c admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:02.963515 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d665203-8f06-4af4-9a8f-5697fa0b636c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:02.963794 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d665203-8f06-4af4-9a8f-5697fa0b636c admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:02.964523 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d665203-8f06-4af4-9a8f-5697fa0b636c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:02.966700 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d665203-8f06-4af4-9a8f-5697fa0b636c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:02.997298 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1238/2467] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:17:02 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:17:02.999545 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6973a0-cf92-465c-aecd-8d8179fa8df2 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:03.011671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6973a0-cf92-465c-aecd-8d8179fa8df2 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:03.070479 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819f19a-5a37-40a6-b1e0-283d2619ced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:03.071170 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819f19a-5a37-40a6-b1e0-283d2619ced6 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:03.071453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819f19a-5a37-40a6-b1e0-283d2619ced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:03.072014 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819f19a-5a37-40a6-b1e0-283d2619ced6 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:03.072860 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819f19a-5a37-40a6-b1e0-283d2619ced6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:03.074890 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819f19a-5a37-40a6-b1e0-283d2619ced6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:03.098833 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1230/2468] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:17:02 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:17:03.103347 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d665203-8f06-4af4-9a8f-5697fa0b636c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:03.113589 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d665203-8f06-4af4-9a8f-5697fa0b636c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:03.118361 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5234c1-f9e3-43df-a796-b672bf94c1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:03.119024 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5234c1-f9e3-43df-a796-b672bf94c1cc admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:03.119325 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5234c1-f9e3-43df-a796-b672bf94c1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:03.119603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5234c1-f9e3-43df-a796-b672bf94c1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:03.120328 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5234c1-f9e3-43df-a796-b672bf94c1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:03.121970 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5234c1-f9e3-43df-a796-b672bf94c1cc admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:03.134740 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1239/2469] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:17:03.138862 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819f19a-5a37-40a6-b1e0-283d2619ced6 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:03.149900 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819f19a-5a37-40a6-b1e0-283d2619ced6 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:03.154615 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d7f42-9eee-4375-81e7-6c7baa3ebe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:03.155508 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d7f42-9eee-4375-81e7-6c7baa3ebe22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:03.155788 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d7f42-9eee-4375-81e7-6c7baa3ebe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:03.156065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d7f42-9eee-4375-81e7-6c7baa3ebe22 admin admin] PATH_INFO: `/v3/projects/22d9a09d101b495ca5c18fb19c8b1873/users/3f6d257f4daa4cb39d74fa4b7ed845bb/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:03.173855 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d7f42-9eee-4375-81e7-6c7baa3ebe22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d9a09d101b495ca5c18fb19c8b1873, user_id=3f6d257f4daa4cb39d74fa4b7ed845bb, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:03.176675 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499d7f42-9eee-4375-81e7-6c7baa3ebe22 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:03.191255 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1231/2470] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:17:03 2022] PUT /identity/v3/projects/22d9a09d101b495ca5c18fb19c8b1873/users/3f6d257f4daa4cb39d74fa4b7ed845bb/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:03.195417 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5234c1-f9e3-43df-a796-b672bf94c1cc admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:03.207301 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5234c1-f9e3-43df-a796-b672bf94c1cc admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:03.268132 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7903a-7dd9-4577-95b6-bec5071b73ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:03.268793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7903a-7dd9-4577-95b6-bec5071b73ca admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:03.269074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7903a-7dd9-4577-95b6-bec5071b73ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:03.269349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7903a-7dd9-4577-95b6-bec5071b73ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:03.270093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7903a-7dd9-4577-95b6-bec5071b73ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:03.271681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7903a-7dd9-4577-95b6-bec5071b73ca admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:03.281451 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1240/2471] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:17:03.285854 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d7f42-9eee-4375-81e7-6c7baa3ebe22 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:03.296392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d7f42-9eee-4375-81e7-6c7baa3ebe22 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:03.301604 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ab384-eb5c-4559-b45e-ffda536b7e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:03.302511 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ab384-eb5c-4559-b45e-ffda536b7e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:03.302820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ab384-eb5c-4559-b45e-ffda536b7e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:03.303141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ab384-eb5c-4559-b45e-ffda536b7e48 admin admin] PATH_INFO: `/v3/projects/22d9a09d101b495ca5c18fb19c8b1873/users/3f6d257f4daa4cb39d74fa4b7ed845bb/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:03.305061 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ab384-eb5c-4559-b45e-ffda536b7e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d9a09d101b495ca5c18fb19c8b1873, user_id=3f6d257f4daa4cb39d74fa4b7ed845bb, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:03.307743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ab384-eb5c-4559-b45e-ffda536b7e48 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:03.319068 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1232/2472] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:17:03 2022] PUT /identity/v3/projects/22d9a09d101b495ca5c18fb19c8b1873/users/3f6d257f4daa4cb39d74fa4b7ed845bb/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:03.329491 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa0ee5-6a7d-4310-9d2c-5239db38fd19 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:03.329812 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa0ee5-6a7d-4310-9d2c-5239db38fd19 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:03.330218 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa0ee5-6a7d-4310-9d2c-5239db38fd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:03.356273 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-dcfa0ee5-6a7d-4310-9d2c-5239db38fd19 None None] MFA Rules not processed for user `3f6d257f4daa4cb39d74fa4b7ed845bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:03.357477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-dcfa0ee5-6a7d-4310-9d2c-5239db38fd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:03.427561 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1241/2473] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:03.440062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ab384-eb5c-4559-b45e-ffda536b7e48 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:03.441833 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3b4ab384-eb5c-4559-b45e-ffda536b7e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:03.468702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:03.501026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ab384-eb5c-4559-b45e-ffda536b7e48 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:03.505619 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3aa501-2762-4ab4-8359-e3ea52f68119 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:03.506293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aa501-2762-4ab4-8359-e3ea52f68119 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:03.506577 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aa501-2762-4ab4-8359-e3ea52f68119 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:03.506857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aa501-2762-4ab4-8359-e3ea52f68119 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:03.516055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3aa501-2762-4ab4-8359-e3ea52f68119 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:03.517708 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3aa501-2762-4ab4-8359-e3ea52f68119 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:03.527184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1233/2474] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:17:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:17:03.601915 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa0ee5-6a7d-4310-9d2c-5239db38fd19 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:03.612449 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa0ee5-6a7d-4310-9d2c-5239db38fd19 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:03.616075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33bbb6-6d00-4c1b-af85-f2beccfdcf6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:03.616709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33bbb6-6d00-4c1b-af85-f2beccfdcf6c service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:03.616990 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33bbb6-6d00-4c1b-af85-f2beccfdcf6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:03.617264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33bbb6-6d00-4c1b-af85-f2beccfdcf6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:03.655737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:03.677165 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33bbb6-6d00-4c1b-af85-f2beccfdcf6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:03.678720 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33bbb6-6d00-4c1b-af85-f2beccfdcf6c service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:03.687718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1242/2475] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:17:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:17:13.522957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=16 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:13.683520 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=10 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:15.666466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3aa501-2762-4ab4-8359-e3ea52f68119 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:15.731713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3aa501-2762-4ab4-8359-e3ea52f68119 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:15.737300 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b077d-47a0-4a1b-867d-9c84c18e6db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:15.738200 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b077d-47a0-4a1b-867d-9c84c18e6db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:15.738483 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b077d-47a0-4a1b-867d-9c84c18e6db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:15.738763 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b077d-47a0-4a1b-867d-9c84c18e6db0 admin admin] PATH_INFO: `/v3/users/5d0b378265254af490c0c22654fdf582` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:15.739973 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b077d-47a0-4a1b-867d-9c84c18e6db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0b378265254af490c0c22654fdf582)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:15.741937 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b077d-47a0-4a1b-867d-9c84c18e6db0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:15.794389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c66b077d-47a0-4a1b-867d-9c84c18e6db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0b378265254af490c0c22654fdf582'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:15.802012 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c66b077d-47a0-4a1b-867d-9c84c18e6db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0b378265254af490c0c22654fdf582'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:15.814305 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c66b077d-47a0-4a1b-867d-9c84c18e6db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0b378265254af490c0c22654fdf582'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:15.815210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c66b077d-47a0-4a1b-867d-9c84c18e6db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0b378265254af490c0c22654fdf582'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:15.815838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c66b077d-47a0-4a1b-867d-9c84c18e6db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0b378265254af490c0c22654fdf582'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:15.831610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1234/2476] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:17:15 2022] DELETE /identity/v3/users/5d0b378265254af490c0c22654fdf582 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:15.836428 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544b983-d2a7-4f34-8748-a35e5521a403 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:15.836938 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544b983-d2a7-4f34-8748-a35e5521a403 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:15.837039 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544b983-d2a7-4f34-8748-a35e5521a403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:15.859735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9544b983-d2a7-4f34-8748-a35e5521a403 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:15.861623 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9544b983-d2a7-4f34-8748-a35e5521a403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:15.928305 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1243/2477] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:15.938464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b077d-47a0-4a1b-867d-9c84c18e6db0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:15.939956 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c66b077d-47a0-4a1b-867d-9c84c18e6db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:16.025608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b077d-47a0-4a1b-867d-9c84c18e6db0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:16.029350 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe6591-a959-4376-a599-20aa37fcebf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:16.030038 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe6591-a959-4376-a599-20aa37fcebf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:16.030326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe6591-a959-4376-a599-20aa37fcebf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:16.030607 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe6591-a959-4376-a599-20aa37fcebf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:16.041269 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe6591-a959-4376-a599-20aa37fcebf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:16.042760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe6591-a959-4376-a599-20aa37fcebf6 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:16.054313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1235/2478] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:17:16.363781 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544b983-d2a7-4f34-8748-a35e5521a403 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:16.368249 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9544b983-d2a7-4f34-8748-a35e5521a403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:16.400315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe6591-a959-4376-a599-20aa37fcebf6 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:16.401883 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-51fe6591-a959-4376-a599-20aa37fcebf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:16.422439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:16.431429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe6591-a959-4376-a599-20aa37fcebf6 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:16.443561 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94725f95-a630-417a-8f26-cb3c593722a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:16.444372 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94725f95-a630-417a-8f26-cb3c593722a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:16.444703 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94725f95-a630-417a-8f26-cb3c593722a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:16.444915 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94725f95-a630-417a-8f26-cb3c593722a2 admin admin] PATH_INFO: `/v3/projects/ccc3e8453956417bb207ecdc8c0b59c4` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:16.447285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94725f95-a630-417a-8f26-cb3c593722a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc3e8453956417bb207ecdc8c0b59c4)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:16.449205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94725f95-a630-417a-8f26-cb3c593722a2 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:16.475896 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544b983-d2a7-4f34-8748-a35e5521a403 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:16.481704 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecf06f-c85b-408f-9245-8088c5780956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:16.482452 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecf06f-c85b-408f-9245-8088c5780956 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:16.482671 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecf06f-c85b-408f-9245-8088c5780956 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:16.483044 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecf06f-c85b-408f-9245-8088c5780956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:16.484986 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0fecf06f-c85b-408f-9245-8088c5780956 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:16.497976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecf06f-c85b-408f-9245-8088c5780956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:16.499637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecf06f-c85b-408f-9245-8088c5780956 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:16.503594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-94725f95-a630-417a-8f26-cb3c593722a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc3e8453956417bb207ecdc8c0b59c4', 'request_id': 'req-94725f95-a630-417a-8f26-cb3c593722a2'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:16.510110 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-94725f95-a630-417a-8f26-cb3c593722a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc3e8453956417bb207ecdc8c0b59c4', 'request_id': 'req-94725f95-a630-417a-8f26-cb3c593722a2'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:16.512592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1244/2479] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:17:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:17:16.517644 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-94725f95-a630-417a-8f26-cb3c593722a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc3e8453956417bb207ecdc8c0b59c4', 'request_id': 'req-94725f95-a630-417a-8f26-cb3c593722a2'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:16.532632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-94725f95-a630-417a-8f26-cb3c593722a2 admin admin] The token cache is being invalidate because project ccc3e8453956417bb207ecdc8c0b59c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:17:16.532924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-94725f95-a630-417a-8f26-cb3c593722a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:16.533527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-94725f95-a630-417a-8f26-cb3c593722a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:16.535112 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1236/2480] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:17:16 2022] DELETE /identity/v3/projects/ccc3e8453956417bb207ecdc8c0b59c4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:17:16.539305 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecf06f-c85b-408f-9245-8088c5780956 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:16.552100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecf06f-c85b-408f-9245-8088c5780956 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:16.620732 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec60d1-ec4e-4d34-9b1a-9af73d18f6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:16.621616 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec60d1-ec4e-4d34-9b1a-9af73d18f6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:16.621938 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec60d1-ec4e-4d34-9b1a-9af73d18f6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:16.622206 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec60d1-ec4e-4d34-9b1a-9af73d18f6be admin admin] PATH_INFO: `/v3/users/3f6d257f4daa4cb39d74fa4b7ed845bb` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:16.623409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec60d1-ec4e-4d34-9b1a-9af73d18f6be admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f6d257f4daa4cb39d74fa4b7ed845bb)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:16.626938 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec60d1-ec4e-4d34-9b1a-9af73d18f6be admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:16.660295 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:16.679867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c5ec60d1-ec4e-4d34-9b1a-9af73d18f6be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f6d257f4daa4cb39d74fa4b7ed845bb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:16.680546 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c5ec60d1-ec4e-4d34-9b1a-9af73d18f6be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f6d257f4daa4cb39d74fa4b7ed845bb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:16.687701 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c5ec60d1-ec4e-4d34-9b1a-9af73d18f6be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f6d257f4daa4cb39d74fa4b7ed845bb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:16.696091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c5ec60d1-ec4e-4d34-9b1a-9af73d18f6be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f6d257f4daa4cb39d74fa4b7ed845bb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:16.711373 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c5ec60d1-ec4e-4d34-9b1a-9af73d18f6be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f6d257f4daa4cb39d74fa4b7ed845bb'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:16.718147 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1245/2481] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:17:16 2022] DELETE /identity/v3/users/3f6d257f4daa4cb39d74fa4b7ed845bb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:17.059451 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94725f95-a630-417a-8f26-cb3c593722a2 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:17.060980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-94725f95-a630-417a-8f26-cb3c593722a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:17.075133 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94725f95-a630-417a-8f26-cb3c593722a2 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:17.137458 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd04dd0-3420-46c9-abd6-a7d7f0eabee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:17.138263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd04dd0-3420-46c9-abd6-a7d7f0eabee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:17.138549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd04dd0-3420-46c9-abd6-a7d7f0eabee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:17.138825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd04dd0-3420-46c9-abd6-a7d7f0eabee4 admin admin] PATH_INFO: `/v3/projects/22d9a09d101b495ca5c18fb19c8b1873` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:17.140055 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd04dd0-3420-46c9-abd6-a7d7f0eabee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22d9a09d101b495ca5c18fb19c8b1873)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:17.142174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd04dd0-3420-46c9-abd6-a7d7f0eabee4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:17.191036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9cd04dd0-3420-46c9-abd6-a7d7f0eabee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22d9a09d101b495ca5c18fb19c8b1873', 'request_id': 'req-9cd04dd0-3420-46c9-abd6-a7d7f0eabee4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:17.196793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9cd04dd0-3420-46c9-abd6-a7d7f0eabee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22d9a09d101b495ca5c18fb19c8b1873', 'request_id': 'req-9cd04dd0-3420-46c9-abd6-a7d7f0eabee4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:17.203157 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9cd04dd0-3420-46c9-abd6-a7d7f0eabee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22d9a09d101b495ca5c18fb19c8b1873', 'request_id': 'req-9cd04dd0-3420-46c9-abd6-a7d7f0eabee4'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:17.216091 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9cd04dd0-3420-46c9-abd6-a7d7f0eabee4 admin admin] The token cache is being invalidate because project 22d9a09d101b495ca5c18fb19c8b1873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:17:17.216380 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9cd04dd0-3420-46c9-abd6-a7d7f0eabee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:17.217011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9cd04dd0-3420-46c9-abd6-a7d7f0eabee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:17.218846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1237/2482] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:17:17 2022] DELETE /identity/v3/projects/22d9a09d101b495ca5c18fb19c8b1873 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:17.224420 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0d371-b491-4f74-ab38-64e1c00a031f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:17.224912 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0d371-b491-4f74-ab38-64e1c00a031f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:17.225012 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0d371-b491-4f74-ab38-64e1c00a031f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:17.244158 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-91b0d371-b491-4f74-ab38-64e1c00a031f None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:17.245360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-91b0d371-b491-4f74-ab38-64e1c00a031f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:17.306076 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1246/2483] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:17:17.314010 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a0577-c842-47e1-90df-f66a68e5439b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:17.314323 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a0577-c842-47e1-90df-f66a68e5439b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:17.314603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a0577-c842-47e1-90df-f66a68e5439b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:17.333413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9b6a0577-c842-47e1-90df-f66a68e5439b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:17.334651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9b6a0577-c842-47e1-90df-f66a68e5439b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:17.342888 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1238/2484] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:17.348001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0d371-b491-4f74-ab38-64e1c00a031f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:17.357977 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0d371-b491-4f74-ab38-64e1c00a031f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:17.363681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e437d-3c80-416d-b76d-2b1e748b732b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:17.364324 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e437d-3c80-416d-b76d-2b1e748b732b admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:17.365232 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e437d-3c80-416d-b76d-2b1e748b732b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:17.365232 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e437d-3c80-416d-b76d-2b1e748b732b admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:17.365681 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e437d-3c80-416d-b76d-2b1e748b732b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:17:17.365995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e437d-3c80-416d-b76d-2b1e748b732b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:17.367609 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e437d-3c80-416d-b76d-2b1e748b732b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:17.380436 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1247/2485] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:17:17.385983 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a0577-c842-47e1-90df-f66a68e5439b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:17.396479 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a0577-c842-47e1-90df-f66a68e5439b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:17.401367 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0c872-6ddb-4534-a48e-a0c2795ae727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:17.402070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0c872-6ddb-4534-a48e-a0c2795ae727 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:17.402355 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0c872-6ddb-4534-a48e-a0c2795ae727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:17.402631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0c872-6ddb-4534-a48e-a0c2795ae727 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:17.403327 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0c872-6ddb-4534-a48e-a0c2795ae727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:17.405290 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0c872-6ddb-4534-a48e-a0c2795ae727 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:17.410989 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:17.437701 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1239/2486] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:17:17 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:17:17.442473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e437d-3c80-416d-b76d-2b1e748b732b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:17.452767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e437d-3c80-416d-b76d-2b1e748b732b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:17.518822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a98ddb-78f6-4ef5-bb70-839aa3158a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:17.519500 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a98ddb-78f6-4ef5-bb70-839aa3158a37 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:17.519790 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a98ddb-78f6-4ef5-bb70-839aa3158a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:17.520073 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a98ddb-78f6-4ef5-bb70-839aa3158a37 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:17.521121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a98ddb-78f6-4ef5-bb70-839aa3158a37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:17.522756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a98ddb-78f6-4ef5-bb70-839aa3158a37 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:17.544022 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1248/2487] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:17:17 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:17:17.549013 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0c872-6ddb-4534-a48e-a0c2795ae727 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:17.559401 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0c872-6ddb-4534-a48e-a0c2795ae727 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:17.564840 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12d0b3-7983-444f-82e4-75b4b0042e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:17.565586 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12d0b3-7983-444f-82e4-75b4b0042e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:17.565913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12d0b3-7983-444f-82e4-75b4b0042e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:17.566190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12d0b3-7983-444f-82e4-75b4b0042e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:17.566951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12d0b3-7983-444f-82e4-75b4b0042e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:17.568594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12d0b3-7983-444f-82e4-75b4b0042e50 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:17.579593 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1240/2488] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:17:17.584172 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a98ddb-78f6-4ef5-bb70-839aa3158a37 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:17.594472 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a98ddb-78f6-4ef5-bb70-839aa3158a37 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:17.600016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd216d-26b3-4b5e-b272-26338cfa02e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:17.600669 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd216d-26b3-4b5e-b272-26338cfa02e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:17.600951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd216d-26b3-4b5e-b272-26338cfa02e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:17.601226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd216d-26b3-4b5e-b272-26338cfa02e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:17.601981 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd216d-26b3-4b5e-b272-26338cfa02e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:17.603570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd216d-26b3-4b5e-b272-26338cfa02e3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:17.613857 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1249/2489] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:17:17.618123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12d0b3-7983-444f-82e4-75b4b0042e50 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:17.628328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12d0b3-7983-444f-82e4-75b4b0042e50 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:17.632938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11822d5-e98d-4c6d-a4bb-0c80f8a9fcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:17.633856 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11822d5-e98d-4c6d-a4bb-0c80f8a9fcea admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:17.634138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11822d5-e98d-4c6d-a4bb-0c80f8a9fcea admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:17.634409 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11822d5-e98d-4c6d-a4bb-0c80f8a9fcea admin admin] PATH_INFO: `/v3/projects/e9560502b4854267b2d2b6050548e853/users/ecd9433455924c73aa9657d4ce415f1f/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:17.649527 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11822d5-e98d-4c6d-a4bb-0c80f8a9fcea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9560502b4854267b2d2b6050548e853, user_id=ecd9433455924c73aa9657d4ce415f1f, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:17.652180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11822d5-e98d-4c6d-a4bb-0c80f8a9fcea admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:17.666933 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1241/2490] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:17:17 2022] PUT /identity/v3/projects/e9560502b4854267b2d2b6050548e853/users/ecd9433455924c73aa9657d4ce415f1f/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:17.678493 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ec95a-559c-47c9-aa35-2515b7ccbf1a None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:17.678797 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ec95a-559c-47c9-aa35-2515b7ccbf1a None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:17.679086 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ec95a-559c-47c9-aa35-2515b7ccbf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:17.698289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:17.707424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d17ec95a-559c-47c9-aa35-2515b7ccbf1a None None] MFA Rules not processed for user `ecd9433455924c73aa9657d4ce415f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:17.709504 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d17ec95a-559c-47c9-aa35-2515b7ccbf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:17.774522 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1250/2491] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:17.786641 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11822d5-e98d-4c6d-a4bb-0c80f8a9fcea admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:17.788356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c11822d5-e98d-4c6d-a4bb-0c80f8a9fcea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:17.846766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11822d5-e98d-4c6d-a4bb-0c80f8a9fcea admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:17.850582 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008752a-03a5-4a1e-861d-3a5ac7fbe23e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:17.851233 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008752a-03a5-4a1e-861d-3a5ac7fbe23e service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:17.851521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008752a-03a5-4a1e-861d-3a5ac7fbe23e service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:17.851801 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008752a-03a5-4a1e-861d-3a5ac7fbe23e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:17.861837 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008752a-03a5-4a1e-861d-3a5ac7fbe23e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:17.863501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008752a-03a5-4a1e-861d-3a5ac7fbe23e service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:17.873232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1242/2492] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:17:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:17:17.894409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ec95a-559c-47c9-aa35-2515b7ccbf1a None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:17.961373 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ec95a-559c-47c9-aa35-2515b7ccbf1a None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:17.966124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059ee2f-15e9-47f7-a7a7-1b7f897b2ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:17.967003 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059ee2f-15e9-47f7-a7a7-1b7f897b2ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:17.967287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059ee2f-15e9-47f7-a7a7-1b7f897b2ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:17.967816 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059ee2f-15e9-47f7-a7a7-1b7f897b2ca6 admin admin] PATH_INFO: `/v3/users/ecd9433455924c73aa9657d4ce415f1f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:17.969029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059ee2f-15e9-47f7-a7a7-1b7f897b2ca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecd9433455924c73aa9657d4ce415f1f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:17.971913 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059ee2f-15e9-47f7-a7a7-1b7f897b2ca6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:18.017728 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f059ee2f-15e9-47f7-a7a7-1b7f897b2ca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecd9433455924c73aa9657d4ce415f1f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:18.018394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f059ee2f-15e9-47f7-a7a7-1b7f897b2ca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecd9433455924c73aa9657d4ce415f1f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:18.026238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f059ee2f-15e9-47f7-a7a7-1b7f897b2ca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecd9433455924c73aa9657d4ce415f1f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:18.034284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f059ee2f-15e9-47f7-a7a7-1b7f897b2ca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecd9433455924c73aa9657d4ce415f1f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:18.045863 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f059ee2f-15e9-47f7-a7a7-1b7f897b2ca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecd9433455924c73aa9657d4ce415f1f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:18.053974 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1251/2493] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:17:17 2022] DELETE /identity/v3/users/ecd9433455924c73aa9657d4ce415f1f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:18.058630 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a0398-cba5-4018-860f-61f4d0581d0d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:18.058932 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a0398-cba5-4018-860f-61f4d0581d0d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:18.059218 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a0398-cba5-4018-860f-61f4d0581d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:18.085687 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-788a0398-cba5-4018-860f-61f4d0581d0d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:18.086980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-788a0398-cba5-4018-860f-61f4d0581d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:18.149425 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1243/2494] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:18.164391 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059ee2f-15e9-47f7-a7a7-1b7f897b2ca6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:18.165910 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f059ee2f-15e9-47f7-a7a7-1b7f897b2ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:18.189162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:18.229697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059ee2f-15e9-47f7-a7a7-1b7f897b2ca6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:18.233303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac0772-4574-43c4-8fe6-da47796cf7a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:18.233983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac0772-4574-43c4-8fe6-da47796cf7a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:18.234267 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac0772-4574-43c4-8fe6-da47796cf7a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:18.234543 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac0772-4574-43c4-8fe6-da47796cf7a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:18.244640 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac0772-4574-43c4-8fe6-da47796cf7a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:18.246109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac0772-4574-43c4-8fe6-da47796cf7a1 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:18.256044 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1252/2495] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:17:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:17:18.527829 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a0398-cba5-4018-860f-61f4d0581d0d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:18.529533 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-788a0398-cba5-4018-860f-61f4d0581d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:18.545284 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a0398-cba5-4018-860f-61f4d0581d0d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:18.550744 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3808605-1451-4f5e-8fce-547ba123d449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:18.551626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3808605-1451-4f5e-8fce-547ba123d449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:18.552461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3808605-1451-4f5e-8fce-547ba123d449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:18.552921 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3808605-1451-4f5e-8fce-547ba123d449 admin admin] PATH_INFO: `/v3/projects/e9560502b4854267b2d2b6050548e853` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:18.554199 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3808605-1451-4f5e-8fce-547ba123d449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9560502b4854267b2d2b6050548e853)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:18.556121 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3808605-1451-4f5e-8fce-547ba123d449 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:18.619263 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccde96-0e24-4353-a868-bca39d1dcee8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:18.619749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccde96-0e24-4353-a868-bca39d1dcee8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:18.620205 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccde96-0e24-4353-a868-bca39d1dcee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:18.626418 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e3808605-1451-4f5e-8fce-547ba123d449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9560502b4854267b2d2b6050548e853', 'request_id': 'req-e3808605-1451-4f5e-8fce-547ba123d449'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:18.627708 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:18.635379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e3808605-1451-4f5e-8fce-547ba123d449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9560502b4854267b2d2b6050548e853', 'request_id': 'req-e3808605-1451-4f5e-8fce-547ba123d449'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:18.640574 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-68ccde96-0e24-4353-a868-bca39d1dcee8 None None] MFA Rules not processed for user `9692d55c8c924544a1bff62054731ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:18.642517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-68ccde96-0e24-4353-a868-bca39d1dcee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:18.644500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e3808605-1451-4f5e-8fce-547ba123d449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9560502b4854267b2d2b6050548e853', 'request_id': 'req-e3808605-1451-4f5e-8fce-547ba123d449'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:18.664248 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e3808605-1451-4f5e-8fce-547ba123d449 admin admin] The token cache is being invalidate because project e9560502b4854267b2d2b6050548e853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:17:18.664248 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e3808605-1451-4f5e-8fce-547ba123d449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:18.665032 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e3808605-1451-4f5e-8fce-547ba123d449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:18.667160 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1244/2496] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:17:18 2022] DELETE /identity/v3/projects/e9560502b4854267b2d2b6050548e853 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:18.671511 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0d428-de10-43df-93e7-55d0c0993c4c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:18.671878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0d428-de10-43df-93e7-55d0c0993c4c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:18.672229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0d428-de10-43df-93e7-55d0c0993c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:18.693404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b6c0d428-de10-43df-93e7-55d0c0993c4c None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:18.694783 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b6c0d428-de10-43df-93e7-55d0c0993c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:18.708697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1253/2497] 10.222.0.49 () {58 vars in 967 bytes} [Wed May 18 17:17:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:17:18.723531 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccde96-0e24-4353-a868-bca39d1dcee8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:18.725088 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-68ccde96-0e24-4353-a868-bca39d1dcee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:18.760824 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1245/2498] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:18.769563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865e2cc-4820-406b-a6b2-885476f59e52 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:18.769813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865e2cc-4820-406b-a6b2-885476f59e52 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:18.770101 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865e2cc-4820-406b-a6b2-885476f59e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:18.790935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d865e2cc-4820-406b-a6b2-885476f59e52 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:18.792306 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d865e2cc-4820-406b-a6b2-885476f59e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:18.801407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccde96-0e24-4353-a868-bca39d1dcee8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:18.801589 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1246/2499] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:18.805964 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865e2cc-4820-406b-a6b2-885476f59e52 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:18.806553 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2309e-fa27-4b57-b903-77ef828d0cd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b712c7f5fce54fe2a89d63863f3845f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:18.807255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2309e-fa27-4b57-b903-77ef828d0cd3 service swift] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:18.807592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2309e-fa27-4b57-b903-77ef828d0cd3 service swift] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:18.807877 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2309e-fa27-4b57-b903-77ef828d0cd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:18.815982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865e2cc-4820-406b-a6b2-885476f59e52 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:18.817246 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2309e-fa27-4b57-b903-77ef828d0cd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:18.818948 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2309e-fa27-4b57-b903-77ef828d0cd3 service swift] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:18.821289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14774f3-e5b4-4f5e-89cc-525343c4ba89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:18.821980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14774f3-e5b4-4f5e-89cc-525343c4ba89 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:18.822266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14774f3-e5b4-4f5e-89cc-525343c4ba89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:18.822719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14774f3-e5b4-4f5e-89cc-525343c4ba89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:18.824017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14774f3-e5b4-4f5e-89cc-525343c4ba89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:17:18.824338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14774f3-e5b4-4f5e-89cc-525343c4ba89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:18.825962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14774f3-e5b4-4f5e-89cc-525343c4ba89 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:18.827598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1254/2500] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 18 17:17:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 18 17:17:18.838453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1247/2501] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 17:17:18.842980 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2309e-fa27-4b57-b903-77ef828d0cd3 service swift] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:18.855684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2309e-fa27-4b57-b903-77ef828d0cd3 service swift] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:18.861004 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1c329-31d9-437c-9047-8207f1ab59f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:18.861908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1c329-31d9-437c-9047-8207f1ab59f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:18.862192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1c329-31d9-437c-9047-8207f1ab59f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:18.862385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1c329-31d9-437c-9047-8207f1ab59f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:18.863148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1c329-31d9-437c-9047-8207f1ab59f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:18.865600 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1c329-31d9-437c-9047-8207f1ab59f5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:18.893621 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1255/2502] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:17:18 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:17:18.898168 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14774f3-e5b4-4f5e-89cc-525343c4ba89 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:18.909839 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14774f3-e5b4-4f5e-89cc-525343c4ba89 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:18.971426 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f8462-d2b2-4d6a-85cd-051155497b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:18.972107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f8462-d2b2-4d6a-85cd-051155497b5e admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:18.972464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f8462-d2b2-4d6a-85cd-051155497b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:18.972689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f8462-d2b2-4d6a-85cd-051155497b5e admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:18.973363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f8462-d2b2-4d6a-85cd-051155497b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:18.975430 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f8462-d2b2-4d6a-85cd-051155497b5e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:18.997807 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1248/2503] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:17:18 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:17:19.002127 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1c329-31d9-437c-9047-8207f1ab59f5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:19.013020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1c329-31d9-437c-9047-8207f1ab59f5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:19.018782 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9241d6-d8d9-4689-b681-74927203c51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:19.019662 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9241d6-d8d9-4689-b681-74927203c51c admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:19.019910 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9241d6-d8d9-4689-b681-74927203c51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:19.020214 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9241d6-d8d9-4689-b681-74927203c51c admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:19.020994 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9241d6-d8d9-4689-b681-74927203c51c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:19.022863 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9241d6-d8d9-4689-b681-74927203c51c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:19.034486 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1256/2504] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:17:19.038760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f8462-d2b2-4d6a-85cd-051155497b5e admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:19.051700 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f8462-d2b2-4d6a-85cd-051155497b5e admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:19.058632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fbec3-c0fb-46f2-8bcd-5e97948e03e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:19.059392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fbec3-c0fb-46f2-8bcd-5e97948e03e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:19.059685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fbec3-c0fb-46f2-8bcd-5e97948e03e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:19.059972 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fbec3-c0fb-46f2-8bcd-5e97948e03e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:19.060770 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fbec3-c0fb-46f2-8bcd-5e97948e03e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:19.062679 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fbec3-c0fb-46f2-8bcd-5e97948e03e5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:19.076771 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1249/2505] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:17:19.081374 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9241d6-d8d9-4689-b681-74927203c51c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:19.092735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9241d6-d8d9-4689-b681-74927203c51c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:19.099435 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efebb28-3aa7-4e09-99a3-ce9baa4c9f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:19.100705 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efebb28-3aa7-4e09-99a3-ce9baa4c9f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:19.100995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efebb28-3aa7-4e09-99a3-ce9baa4c9f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:19.101280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efebb28-3aa7-4e09-99a3-ce9baa4c9f00 admin admin] PATH_INFO: `/v3/projects/879f4959cb7b40e2a764a9cc21ffa754/users/9ed8f691e9394be28c41a975a6b731ac/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:19.119655 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efebb28-3aa7-4e09-99a3-ce9baa4c9f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879f4959cb7b40e2a764a9cc21ffa754, user_id=9ed8f691e9394be28c41a975a6b731ac, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:19.122425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efebb28-3aa7-4e09-99a3-ce9baa4c9f00 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:19.133447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:19.139575 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1257/2506] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:17:19 2022] PUT /identity/v3/projects/879f4959cb7b40e2a764a9cc21ffa754/users/9ed8f691e9394be28c41a975a6b731ac/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:19.150089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f466204-faf7-4c1b-93f5-8de1b3ddb75e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:19.150575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f466204-faf7-4c1b-93f5-8de1b3ddb75e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:19.150830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f466204-faf7-4c1b-93f5-8de1b3ddb75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:19.181426 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-7f466204-faf7-4c1b-93f5-8de1b3ddb75e None None] MFA Rules not processed for user `9ed8f691e9394be28c41a975a6b731ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:19.182706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7f466204-faf7-4c1b-93f5-8de1b3ddb75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:19.211978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:19.257244 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1250/2507] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:19.268467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efebb28-3aa7-4e09-99a3-ce9baa4c9f00 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:19.270507 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2efebb28-3aa7-4e09-99a3-ce9baa4c9f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:19.329694 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efebb28-3aa7-4e09-99a3-ce9baa4c9f00 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:19.333393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529fbaa-337d-4f17-b829-25a27b7110ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:19.334071 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529fbaa-337d-4f17-b829-25a27b7110ce service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:19.334358 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529fbaa-337d-4f17-b829-25a27b7110ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:19.334637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529fbaa-337d-4f17-b829-25a27b7110ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:19.343271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529fbaa-337d-4f17-b829-25a27b7110ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:19.344723 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529fbaa-337d-4f17-b829-25a27b7110ce service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:19.353686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1258/2508] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:17:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:17:29.253872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=15 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:29.349732 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=26 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:34.916695 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f466204-faf7-4c1b-93f5-8de1b3ddb75e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:34.928014 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f466204-faf7-4c1b-93f5-8de1b3ddb75e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:34.931962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97b257-5cd7-4f81-b162-3eab7fb5a941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:34.932615 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97b257-5cd7-4f81-b162-3eab7fb5a941 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:34.932908 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97b257-5cd7-4f81-b162-3eab7fb5a941 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:34.933189 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97b257-5cd7-4f81-b162-3eab7fb5a941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:34.935033 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1c97b257-5cd7-4f81-b162-3eab7fb5a941 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:35.032082 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97b257-5cd7-4f81-b162-3eab7fb5a941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:35.034619 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97b257-5cd7-4f81-b162-3eab7fb5a941 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:35.060017 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1251/2509] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:17:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:17:44.113829 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529fbaa-337d-4f17-b829-25a27b7110ce service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:44.187058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529fbaa-337d-4f17-b829-25a27b7110ce service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:44.192225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb6105-69e4-4617-bb12-20848caf2f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:44.193112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb6105-69e4-4617-bb12-20848caf2f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:44.193394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb6105-69e4-4617-bb12-20848caf2f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:44.193680 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb6105-69e4-4617-bb12-20848caf2f86 admin admin] PATH_INFO: `/v3/users/9ed8f691e9394be28c41a975a6b731ac` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:44.194929 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb6105-69e4-4617-bb12-20848caf2f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ed8f691e9394be28c41a975a6b731ac)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:44.196894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb6105-69e4-4617-bb12-20848caf2f86 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:44.249498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9bcb6105-69e4-4617-bb12-20848caf2f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ed8f691e9394be28c41a975a6b731ac'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:44.251629 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9bcb6105-69e4-4617-bb12-20848caf2f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ed8f691e9394be28c41a975a6b731ac'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:44.260979 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9bcb6105-69e4-4617-bb12-20848caf2f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ed8f691e9394be28c41a975a6b731ac'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:44.270059 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9bcb6105-69e4-4617-bb12-20848caf2f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ed8f691e9394be28c41a975a6b731ac'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:44.283029 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-9bcb6105-69e4-4617-bb12-20848caf2f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ed8f691e9394be28c41a975a6b731ac'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:44.291060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1259/2510] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:17:44 2022] DELETE /identity/v3/users/9ed8f691e9394be28c41a975a6b731ac => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:17:44.295832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d008286-39c9-4014-9a11-f02242cb11a8 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:44.296375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d008286-39c9-4014-9a11-f02242cb11a8 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:44.296490 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d008286-39c9-4014-9a11-f02242cb11a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:44.317060 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6d008286-39c9-4014-9a11-f02242cb11a8 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:44.318411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6d008286-39c9-4014-9a11-f02242cb11a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:44.389295 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1252/2511] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:44.404841 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb6105-69e4-4617-bb12-20848caf2f86 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:44.407809 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9bcb6105-69e4-4617-bb12-20848caf2f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:44.480663 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb6105-69e4-4617-bb12-20848caf2f86 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:44.484417 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbdf7c-ff76-49cf-b84c-25e48e70095c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:44.485061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbdf7c-ff76-49cf-b84c-25e48e70095c service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:44.485342 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbdf7c-ff76-49cf-b84c-25e48e70095c service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:44.485618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbdf7c-ff76-49cf-b84c-25e48e70095c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:44.496422 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbdf7c-ff76-49cf-b84c-25e48e70095c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:44.497907 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbdf7c-ff76-49cf-b84c-25e48e70095c service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:44.508484 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1260/2512] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:17:44.794701 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d008286-39c9-4014-9a11-f02242cb11a8 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:44.796404 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6d008286-39c9-4014-9a11-f02242cb11a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:44.812363 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d008286-39c9-4014-9a11-f02242cb11a8 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:44.818152 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b3c34-5e2c-4a9c-8e2b-187c28897f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:44.819121 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b3c34-5e2c-4a9c-8e2b-187c28897f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:44.819329 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b3c34-5e2c-4a9c-8e2b-187c28897f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:44.820497 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b3c34-5e2c-4a9c-8e2b-187c28897f4f admin admin] PATH_INFO: `/v3/projects/879f4959cb7b40e2a764a9cc21ffa754` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:44.822297 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b3c34-5e2c-4a9c-8e2b-187c28897f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=879f4959cb7b40e2a764a9cc21ffa754)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:44.824238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b3c34-5e2c-4a9c-8e2b-187c28897f4f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:44.881273 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9e3b3c34-5e2c-4a9c-8e2b-187c28897f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879f4959cb7b40e2a764a9cc21ffa754', 'request_id': 'req-9e3b3c34-5e2c-4a9c-8e2b-187c28897f4f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:44.887227 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9e3b3c34-5e2c-4a9c-8e2b-187c28897f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879f4959cb7b40e2a764a9cc21ffa754', 'request_id': 'req-9e3b3c34-5e2c-4a9c-8e2b-187c28897f4f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:44.894488 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9e3b3c34-5e2c-4a9c-8e2b-187c28897f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879f4959cb7b40e2a764a9cc21ffa754', 'request_id': 'req-9e3b3c34-5e2c-4a9c-8e2b-187c28897f4f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:44.897029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:44.910998 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9e3b3c34-5e2c-4a9c-8e2b-187c28897f4f admin admin] The token cache is being invalidate because project 879f4959cb7b40e2a764a9cc21ffa754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:17:44.911379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9e3b3c34-5e2c-4a9c-8e2b-187c28897f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:44.911955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9e3b3c34-5e2c-4a9c-8e2b-187c28897f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:44.913545 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1253/2513] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:17:44 2022] DELETE /identity/v3/projects/879f4959cb7b40e2a764a9cc21ffa754 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:44.919337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863c7dd-eae1-426e-8b40-460ac168786f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:44.919650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863c7dd-eae1-426e-8b40-460ac168786f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:44.919927 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863c7dd-eae1-426e-8b40-460ac168786f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:44.952890 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d863c7dd-eae1-426e-8b40-460ac168786f None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:44.954158 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d863c7dd-eae1-426e-8b40-460ac168786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:44.963465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:45.016230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1261/2514] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:45.024909 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cac27-28af-48c8-bcd9-7faecda8b381 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:45.025202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cac27-28af-48c8-bcd9-7faecda8b381 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:45.025484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cac27-28af-48c8-bcd9-7faecda8b381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:45.044084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-754cac27-28af-48c8-bcd9-7faecda8b381 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:45.045217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-754cac27-28af-48c8-bcd9-7faecda8b381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:45.053702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1254/2515] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:45.058281 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863c7dd-eae1-426e-8b40-460ac168786f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:45.069991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863c7dd-eae1-426e-8b40-460ac168786f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:45.075026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607755da-dc2c-49bc-b4ce-cc8b61ab5512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:45.075705 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607755da-dc2c-49bc-b4ce-cc8b61ab5512 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:45.075988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607755da-dc2c-49bc-b4ce-cc8b61ab5512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:45.076262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607755da-dc2c-49bc-b4ce-cc8b61ab5512 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:45.076997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607755da-dc2c-49bc-b4ce-cc8b61ab5512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:17:45.077304 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607755da-dc2c-49bc-b4ce-cc8b61ab5512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:45.078950 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607755da-dc2c-49bc-b4ce-cc8b61ab5512 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:45.093227 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1262/2516] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:17:45.097997 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cac27-28af-48c8-bcd9-7faecda8b381 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:45.107330 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cac27-28af-48c8-bcd9-7faecda8b381 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:45.112272 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f3ebd-9f55-46f5-940c-84de9069bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:45.112922 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f3ebd-9f55-46f5-940c-84de9069bc89 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:45.113207 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f3ebd-9f55-46f5-940c-84de9069bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:45.113484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f3ebd-9f55-46f5-940c-84de9069bc89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:45.114238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f3ebd-9f55-46f5-940c-84de9069bc89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:45.116156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f3ebd-9f55-46f5-940c-84de9069bc89 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:45.143620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1255/2517] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:17:45 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:17:45.148188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607755da-dc2c-49bc-b4ce-cc8b61ab5512 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:45.158411 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607755da-dc2c-49bc-b4ce-cc8b61ab5512 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:45.225644 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9544e8-7aaf-47c5-b823-d5a3543d83f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:45.226510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9544e8-7aaf-47c5-b823-d5a3543d83f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:45.226800 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9544e8-7aaf-47c5-b823-d5a3543d83f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:45.227084 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9544e8-7aaf-47c5-b823-d5a3543d83f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:45.227811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9544e8-7aaf-47c5-b823-d5a3543d83f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:45.229887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9544e8-7aaf-47c5-b823-d5a3543d83f6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:45.262741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1263/2518] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:17:45 2022] POST /identity/v3/users => generated 282 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:17:45.263952 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f3ebd-9f55-46f5-940c-84de9069bc89 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:45.274851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f3ebd-9f55-46f5-940c-84de9069bc89 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:45.279835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375e6e8-deca-47a9-bcf7-2027118695ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:45.280606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375e6e8-deca-47a9-bcf7-2027118695ae admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:45.280960 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375e6e8-deca-47a9-bcf7-2027118695ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:45.281395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375e6e8-deca-47a9-bcf7-2027118695ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:45.282247 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375e6e8-deca-47a9-bcf7-2027118695ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:45.284455 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375e6e8-deca-47a9-bcf7-2027118695ae admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:45.296478 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1256/2519] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:17:45.300818 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9544e8-7aaf-47c5-b823-d5a3543d83f6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:45.312862 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9544e8-7aaf-47c5-b823-d5a3543d83f6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:45.318652 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ed865-0555-4fa3-bd08-cc4c80c8de2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:45.319340 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ed865-0555-4fa3-bd08-cc4c80c8de2b admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:45.319626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ed865-0555-4fa3-bd08-cc4c80c8de2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:45.319935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ed865-0555-4fa3-bd08-cc4c80c8de2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:45.320685 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ed865-0555-4fa3-bd08-cc4c80c8de2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:45.322432 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ed865-0555-4fa3-bd08-cc4c80c8de2b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:45.333773 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1264/2520] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:17:45.338844 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375e6e8-deca-47a9-bcf7-2027118695ae admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:45.350476 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375e6e8-deca-47a9-bcf7-2027118695ae admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:45.355520 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4a9cb-aed4-4a2c-8781-3be3b8a92630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:45.356418 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4a9cb-aed4-4a2c-8781-3be3b8a92630 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:45.356693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4a9cb-aed4-4a2c-8781-3be3b8a92630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:45.356989 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4a9cb-aed4-4a2c-8781-3be3b8a92630 admin admin] PATH_INFO: `/v3/projects/918e18a0bf9344429a2f5e58ac9934fc/users/4badd64f91da443fb11226e70aa8480d/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:45.375550 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4a9cb-aed4-4a2c-8781-3be3b8a92630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=918e18a0bf9344429a2f5e58ac9934fc, user_id=4badd64f91da443fb11226e70aa8480d, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:45.379150 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4a9cb-aed4-4a2c-8781-3be3b8a92630 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:45.396983 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1257/2521] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:17:45 2022] PUT /identity/v3/projects/918e18a0bf9344429a2f5e58ac9934fc/users/4badd64f91da443fb11226e70aa8480d/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:45.415505 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097ea46-7735-4a2b-9873-09cacad9915c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:45.415797 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097ea46-7735-4a2b-9873-09cacad9915c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:45.416103 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097ea46-7735-4a2b-9873-09cacad9915c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:45.447690 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d097ea46-7735-4a2b-9873-09cacad9915c None None] MFA Rules not processed for user `4badd64f91da443fb11226e70aa8480d`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:45.448949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d097ea46-7735-4a2b-9873-09cacad9915c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:45.535750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1265/2522] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:45 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:45.547368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4a9cb-aed4-4a2c-8781-3be3b8a92630 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:45.549316 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-59d4a9cb-aed4-4a2c-8781-3be3b8a92630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:45.611830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4a9cb-aed4-4a2c-8781-3be3b8a92630 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:45.615641 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2310a-ce21-466c-b509-fe90d85077a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:45.616301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2310a-ce21-466c-b509-fe90d85077a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:45.616582 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2310a-ce21-466c-b509-fe90d85077a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:45.616851 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2310a-ce21-466c-b509-fe90d85077a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:45.625942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2310a-ce21-466c-b509-fe90d85077a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:45.627927 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2310a-ce21-466c-b509-fe90d85077a1 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:45.637785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1258/2523] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:17:45 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:17:46.241848 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097ea46-7735-4a2b-9873-09cacad9915c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:46.243873 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d097ea46-7735-4a2b-9873-09cacad9915c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:46.257885 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:46.368516 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097ea46-7735-4a2b-9873-09cacad9915c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:46.380120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f7c73-8b04-4000-8ec2-96f515189609 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:46.380890 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f7c73-8b04-4000-8ec2-96f515189609 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:46.381232 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f7c73-8b04-4000-8ec2-96f515189609 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:46.381516 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f7c73-8b04-4000-8ec2-96f515189609 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:46.383559 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a57f7c73-8b04-4000-8ec2-96f515189609 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:46.397698 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f7c73-8b04-4000-8ec2-96f515189609 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:46.399431 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f7c73-8b04-4000-8ec2-96f515189609 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:46.413572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1266/2524] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:17:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:17:52.316013 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2310a-ce21-466c-b509-fe90d85077a1 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:52.317710 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-dbd2310a-ce21-466c-b509-fe90d85077a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:52.389293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2310a-ce21-466c-b509-fe90d85077a1 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:52.393022 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142ac7c-c7eb-43c0-b35b-9cd085f4389f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:52.393704 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142ac7c-c7eb-43c0-b35b-9cd085f4389f service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:52.393991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142ac7c-c7eb-43c0-b35b-9cd085f4389f service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:52.394293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142ac7c-c7eb-43c0-b35b-9cd085f4389f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:52.396101 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7142ac7c-c7eb-43c0-b35b-9cd085f4389f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:52.444010 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:52.464072 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142ac7c-c7eb-43c0-b35b-9cd085f4389f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:52.465516 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142ac7c-c7eb-43c0-b35b-9cd085f4389f service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:52.476422 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1259/2525] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:17:56.210693 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f7c73-8b04-4000-8ec2-96f515189609 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:56.212227 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a57f7c73-8b04-4000-8ec2-96f515189609 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:56.227337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f7c73-8b04-4000-8ec2-96f515189609 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:56.232050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b687c-b2ec-4764-a132-9a30e3d72b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:56.232948 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b687c-b2ec-4764-a132-9a30e3d72b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:56.233227 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b687c-b2ec-4764-a132-9a30e3d72b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:56.233501 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b687c-b2ec-4764-a132-9a30e3d72b67 admin admin] PATH_INFO: `/v3/users/01881ccdf756480b8fcc1ac599fdf905` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:56.234711 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b687c-b2ec-4764-a132-9a30e3d72b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01881ccdf756480b8fcc1ac599fdf905)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:56.236620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b687c-b2ec-4764-a132-9a30e3d72b67 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:56.284782 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fa3b687c-b2ec-4764-a132-9a30e3d72b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01881ccdf756480b8fcc1ac599fdf905'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:56.285441 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fa3b687c-b2ec-4764-a132-9a30e3d72b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01881ccdf756480b8fcc1ac599fdf905'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:56.292931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fa3b687c-b2ec-4764-a132-9a30e3d72b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01881ccdf756480b8fcc1ac599fdf905'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:56.300643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fa3b687c-b2ec-4764-a132-9a30e3d72b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01881ccdf756480b8fcc1ac599fdf905'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:56.312629 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-fa3b687c-b2ec-4764-a132-9a30e3d72b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01881ccdf756480b8fcc1ac599fdf905'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:56.320731 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1267/2526] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:17:56 2022] DELETE /identity/v3/users/01881ccdf756480b8fcc1ac599fdf905 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:56.495442 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142ac7c-c7eb-43c0-b35b-9cd085f4389f service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:56.506308 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142ac7c-c7eb-43c0-b35b-9cd085f4389f service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:56.567224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4babc-47a5-443f-b02c-dd080f9209b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:56.568099 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4babc-47a5-443f-b02c-dd080f9209b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:56.568407 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4babc-47a5-443f-b02c-dd080f9209b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:56.568678 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4babc-47a5-443f-b02c-dd080f9209b2 admin admin] PATH_INFO: `/v3/projects/b0f5daaa505d4985a76f95f1cf7b2da6` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:56.569954 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4babc-47a5-443f-b02c-dd080f9209b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0f5daaa505d4985a76f95f1cf7b2da6)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:56.571887 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4babc-47a5-443f-b02c-dd080f9209b2 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:56.619822 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e3a4babc-47a5-443f-b02c-dd080f9209b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'request_id': 'req-e3a4babc-47a5-443f-b02c-dd080f9209b2'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:56.625097 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e3a4babc-47a5-443f-b02c-dd080f9209b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'request_id': 'req-e3a4babc-47a5-443f-b02c-dd080f9209b2'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:56.632203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e3a4babc-47a5-443f-b02c-dd080f9209b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'request_id': 'req-e3a4babc-47a5-443f-b02c-dd080f9209b2'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:56.646266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e3a4babc-47a5-443f-b02c-dd080f9209b2 admin admin] The token cache is being invalidate because project b0f5daaa505d4985a76f95f1cf7b2da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:17:56.646555 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e3a4babc-47a5-443f-b02c-dd080f9209b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:56.647189 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e3a4babc-47a5-443f-b02c-dd080f9209b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:56.648801 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1260/2527] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:17:56 2022] DELETE /identity/v3/projects/b0f5daaa505d4985a76f95f1cf7b2da6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:56.653997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ac1d3-a1df-469e-b46a-c396fe25473b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:56.654292 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ac1d3-a1df-469e-b46a-c396fe25473b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:56.654574 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ac1d3-a1df-469e-b46a-c396fe25473b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:56.673314 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-bc7ac1d3-a1df-469e-b46a-c396fe25473b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:56.674567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bc7ac1d3-a1df-469e-b46a-c396fe25473b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:56.709001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:56.737968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1268/2528] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:56.746560 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d149b-7741-42e3-8035-729f5281511d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:56.746826 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d149b-7741-42e3-8035-729f5281511d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:56.747123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d149b-7741-42e3-8035-729f5281511d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:56.765335 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-107d149b-7741-42e3-8035-729f5281511d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:56.766573 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-107d149b-7741-42e3-8035-729f5281511d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:56.776763 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1261/2529] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:56.781175 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ac1d3-a1df-469e-b46a-c396fe25473b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:56.791874 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ac1d3-a1df-469e-b46a-c396fe25473b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:56.796567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b43c5b-dd42-4b24-a169-2e1645ce6075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:56.797227 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b43c5b-dd42-4b24-a169-2e1645ce6075 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:56.797512 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b43c5b-dd42-4b24-a169-2e1645ce6075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:56.797889 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b43c5b-dd42-4b24-a169-2e1645ce6075 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:56.798627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b43c5b-dd42-4b24-a169-2e1645ce6075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:17:56.798934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b43c5b-dd42-4b24-a169-2e1645ce6075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:56.800927 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b43c5b-dd42-4b24-a169-2e1645ce6075 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:56.813885 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1269/2530] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:17:56.818784 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d149b-7741-42e3-8035-729f5281511d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:56.828631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d149b-7741-42e3-8035-729f5281511d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:56.834115 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea50da-de0a-49de-8c04-2423864f5da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:56.834784 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea50da-de0a-49de-8c04-2423864f5da2 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:56.835073 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea50da-de0a-49de-8c04-2423864f5da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:56.835353 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea50da-de0a-49de-8c04-2423864f5da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:56.836050 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea50da-de0a-49de-8c04-2423864f5da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:56.838029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea50da-de0a-49de-8c04-2423864f5da2 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:56.863681 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1262/2531] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:17:56 2022] POST /identity/v3/projects => generated 405 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:17:56.868271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b43c5b-dd42-4b24-a169-2e1645ce6075 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:56.879076 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b43c5b-dd42-4b24-a169-2e1645ce6075 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:56.937120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aff5a7-7fd0-49e6-a491-6e539960752a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:56.937824 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aff5a7-7fd0-49e6-a491-6e539960752a admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:56.938117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aff5a7-7fd0-49e6-a491-6e539960752a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:56.938393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aff5a7-7fd0-49e6-a491-6e539960752a admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:56.939085 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aff5a7-7fd0-49e6-a491-6e539960752a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:56.941742 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aff5a7-7fd0-49e6-a491-6e539960752a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:56.966442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1270/2532] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:17:56 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:17:56.967528 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea50da-de0a-49de-8c04-2423864f5da2 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:56.979610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea50da-de0a-49de-8c04-2423864f5da2 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:56.984603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df48bcb-a621-420a-8eda-b770049adfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:56.985298 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df48bcb-a621-420a-8eda-b770049adfbe admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:56.985587 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df48bcb-a621-420a-8eda-b770049adfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:56.985901 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df48bcb-a621-420a-8eda-b770049adfbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:56.986645 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df48bcb-a621-420a-8eda-b770049adfbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:56.989709 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df48bcb-a621-420a-8eda-b770049adfbe admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:57.000591 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1263/2533] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:17:57.005513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aff5a7-7fd0-49e6-a491-6e539960752a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:57.015739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aff5a7-7fd0-49e6-a491-6e539960752a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:57.021393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7c4f6-c394-4d9f-8b81-bc9cf40d4be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:57.022202 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7c4f6-c394-4d9f-8b81-bc9cf40d4be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:57.022485 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7c4f6-c394-4d9f-8b81-bc9cf40d4be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:57.022756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7c4f6-c394-4d9f-8b81-bc9cf40d4be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:57.023481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7c4f6-c394-4d9f-8b81-bc9cf40d4be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:57.025081 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7c4f6-c394-4d9f-8b81-bc9cf40d4be4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:57.036146 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1271/2534] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:17:57.040378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df48bcb-a621-420a-8eda-b770049adfbe admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:57.051232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df48bcb-a621-420a-8eda-b770049adfbe admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:57.055915 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cacb3c-6a9a-4437-aedb-24f6e9139281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:57.056806 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cacb3c-6a9a-4437-aedb-24f6e9139281 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:57.057088 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cacb3c-6a9a-4437-aedb-24f6e9139281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:57.057366 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cacb3c-6a9a-4437-aedb-24f6e9139281 admin admin] PATH_INFO: `/v3/projects/b4f499b0d83c46c2a66929dd01c2c6fa/users/24349f389303494595ccf12c69c6a3e6/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:57.074103 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cacb3c-6a9a-4437-aedb-24f6e9139281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f499b0d83c46c2a66929dd01c2c6fa, user_id=24349f389303494595ccf12c69c6a3e6, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:57.076776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cacb3c-6a9a-4437-aedb-24f6e9139281 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:57.090960 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1264/2535] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:17:57 2022] PUT /identity/v3/projects/b4f499b0d83c46c2a66929dd01c2c6fa/users/24349f389303494595ccf12c69c6a3e6/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:57.102241 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e980a4-cc63-4920-bc6d-b191daa26651 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:57.102532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e980a4-cc63-4920-bc6d-b191daa26651 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:57.103568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e980a4-cc63-4920-bc6d-b191daa26651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:57.131195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-06e980a4-cc63-4920-bc6d-b191daa26651 None None] MFA Rules not processed for user `24349f389303494595ccf12c69c6a3e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:57.132319 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-06e980a4-cc63-4920-bc6d-b191daa26651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:57.205758 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1272/2536] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:57.211478 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cacb3c-6a9a-4437-aedb-24f6e9139281 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:57.223014 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:57.283040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cacb3c-6a9a-4437-aedb-24f6e9139281 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:57.288717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c8b61-0246-4b5e-91fa-256e1ef4dde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:57.289390 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c8b61-0246-4b5e-91fa-256e1ef4dde7 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:57.289700 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c8b61-0246-4b5e-91fa-256e1ef4dde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:57.289988 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c8b61-0246-4b5e-91fa-256e1ef4dde7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:57.290697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c8b61-0246-4b5e-91fa-256e1ef4dde7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:57.292658 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c8b61-0246-4b5e-91fa-256e1ef4dde7 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:57.326653 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1265/2537] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:17:57 2022] POST /identity/v3/projects => generated 405 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:17:57.330748 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e980a4-cc63-4920-bc6d-b191daa26651 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:57.342115 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e980a4-cc63-4920-bc6d-b191daa26651 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:57.375841 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:57.403128 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8494f-ff39-464b-8423-2fcd38ed3962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:57.403720 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8494f-ff39-464b-8423-2fcd38ed3962 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:57.404004 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8494f-ff39-464b-8423-2fcd38ed3962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:57.404282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8494f-ff39-464b-8423-2fcd38ed3962 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:57.405011 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8494f-ff39-464b-8423-2fcd38ed3962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:57.406967 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8494f-ff39-464b-8423-2fcd38ed3962 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:57.431705 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1273/2538] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:17:57 2022] POST /identity/v3/users => generated 309 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:17:57.432891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c8b61-0246-4b5e-91fa-256e1ef4dde7 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:57.443882 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c8b61-0246-4b5e-91fa-256e1ef4dde7 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:57.448597 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029a0b2-3d40-4072-84b0-0b89940707f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:57.449259 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029a0b2-3d40-4072-84b0-0b89940707f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:57.449545 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029a0b2-3d40-4072-84b0-0b89940707f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:57.449857 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029a0b2-3d40-4072-84b0-0b89940707f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:57.450592 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029a0b2-3d40-4072-84b0-0b89940707f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:57.452240 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029a0b2-3d40-4072-84b0-0b89940707f6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:57.464283 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1266/2539] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:17:57.469282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8494f-ff39-464b-8423-2fcd38ed3962 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:57.480297 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8494f-ff39-464b-8423-2fcd38ed3962 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:57.484940 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843d52d-8c1f-447e-b91a-8ca24036bb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:57.485856 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843d52d-8c1f-447e-b91a-8ca24036bb04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:57.486143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843d52d-8c1f-447e-b91a-8ca24036bb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:57.486419 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843d52d-8c1f-447e-b91a-8ca24036bb04 admin admin] PATH_INFO: `/v3/projects/749f6eec1dd14d69b2363ba354f4fd27/users/a161de7427884bd78acf3f2a56f53a24/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:57.501169 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843d52d-8c1f-447e-b91a-8ca24036bb04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=749f6eec1dd14d69b2363ba354f4fd27, user_id=a161de7427884bd78acf3f2a56f53a24, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:57.504484 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843d52d-8c1f-447e-b91a-8ca24036bb04 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:57.519673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1274/2540] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:17:57 2022] PUT /identity/v3/projects/749f6eec1dd14d69b2363ba354f4fd27/users/a161de7427884bd78acf3f2a56f53a24/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:57.523848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029a0b2-3d40-4072-84b0-0b89940707f6 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:57.537727 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029a0b2-3d40-4072-84b0-0b89940707f6 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:57.600951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafa94b-eff6-49a9-81dc-f91645286103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:57.601628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafa94b-eff6-49a9-81dc-f91645286103 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:57.601950 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafa94b-eff6-49a9-81dc-f91645286103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:57.602232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafa94b-eff6-49a9-81dc-f91645286103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:57.602967 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafa94b-eff6-49a9-81dc-f91645286103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:57.604583 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfafa94b-eff6-49a9-81dc-f91645286103 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:57.614984 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1267/2541] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:17:57.619159 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843d52d-8c1f-447e-b91a-8ca24036bb04 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:57.630121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843d52d-8c1f-447e-b91a-8ca24036bb04 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:57.634857 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b21ca-dd47-450f-89cf-69e2c148f78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:57.635730 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b21ca-dd47-450f-89cf-69e2c148f78f admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:57.636015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b21ca-dd47-450f-89cf-69e2c148f78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:57.636291 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b21ca-dd47-450f-89cf-69e2c148f78f admin admin] PATH_INFO: `/v3/projects/749f6eec1dd14d69b2363ba354f4fd27/users/a161de7427884bd78acf3f2a56f53a24/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:57.638305 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b21ca-dd47-450f-89cf-69e2c148f78f admin admin] RBAC: Authorizing `identity:create_grant(project_id=749f6eec1dd14d69b2363ba354f4fd27, user_id=a161de7427884bd78acf3f2a56f53a24, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:57.640973 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b21ca-dd47-450f-89cf-69e2c148f78f admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:57.652672 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1275/2542] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:17:57 2022] PUT /identity/v3/projects/749f6eec1dd14d69b2363ba354f4fd27/users/a161de7427884bd78acf3f2a56f53a24/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:57.664430 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b284982-9af5-4c4f-ab69-737f7d924e4e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:57.664653 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b284982-9af5-4c4f-ab69-737f7d924e4e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:57.664935 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b284982-9af5-4c4f-ab69-737f7d924e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:57.692517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-7b284982-9af5-4c4f-ab69-737f7d924e4e None None] MFA Rules not processed for user `a161de7427884bd78acf3f2a56f53a24`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:57.693754 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7b284982-9af5-4c4f-ab69-737f7d924e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:57.762780 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1268/2543] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:57 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:57.774554 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b21ca-dd47-450f-89cf-69e2c148f78f admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:57.775967 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-199b21ca-dd47-450f-89cf-69e2c148f78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:57.834728 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b21ca-dd47-450f-89cf-69e2c148f78f admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:57.839119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b83906-b9ce-4d37-b1bf-1eeffe0b5337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:57.839344 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b83906-b9ce-4d37-b1bf-1eeffe0b5337 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:57.839633 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b83906-b9ce-4d37-b1bf-1eeffe0b5337 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:57.839913 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b83906-b9ce-4d37-b1bf-1eeffe0b5337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:57.851303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b83906-b9ce-4d37-b1bf-1eeffe0b5337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:57.852761 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b83906-b9ce-4d37-b1bf-1eeffe0b5337 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:57.863955 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1276/2544] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:17:57 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:17:58.013797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b284982-9af5-4c4f-ab69-737f7d924e4e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:58.020278 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:58.080770 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b284982-9af5-4c4f-ab69-737f7d924e4e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:58.086543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce7926-ea2d-4960-aa5f-09f8cbdbb284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:58.087407 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce7926-ea2d-4960-aa5f-09f8cbdbb284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:58.087692 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce7926-ea2d-4960-aa5f-09f8cbdbb284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:58.087966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce7926-ea2d-4960-aa5f-09f8cbdbb284 admin admin] PATH_INFO: `/v3/users/24349f389303494595ccf12c69c6a3e6` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:58.089188 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce7926-ea2d-4960-aa5f-09f8cbdbb284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24349f389303494595ccf12c69c6a3e6)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:58.091152 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce7926-ea2d-4960-aa5f-09f8cbdbb284 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:58.140664 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-97ce7926-ea2d-4960-aa5f-09f8cbdbb284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24349f389303494595ccf12c69c6a3e6'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:58.148319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-97ce7926-ea2d-4960-aa5f-09f8cbdbb284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24349f389303494595ccf12c69c6a3e6'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:58.161913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-97ce7926-ea2d-4960-aa5f-09f8cbdbb284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24349f389303494595ccf12c69c6a3e6'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:58.162657 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-97ce7926-ea2d-4960-aa5f-09f8cbdbb284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24349f389303494595ccf12c69c6a3e6'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:58.163273 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-97ce7926-ea2d-4960-aa5f-09f8cbdbb284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24349f389303494595ccf12c69c6a3e6'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:58.176825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1269/2545] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:17:58 2022] DELETE /identity/v3/users/24349f389303494595ccf12c69c6a3e6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:58.181604 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3d54d-9ece-451a-8def-1f0b0f3052b9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:58.181933 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3d54d-9ece-451a-8def-1f0b0f3052b9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:58.182219 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3d54d-9ece-451a-8def-1f0b0f3052b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:58.200341 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a9e3d54d-9ece-451a-8def-1f0b0f3052b9 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:58.201572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a9e3d54d-9ece-451a-8def-1f0b0f3052b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:58.266890 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1277/2546] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:17:58.277385 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce7926-ea2d-4960-aa5f-09f8cbdbb284 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:58.278876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-97ce7926-ea2d-4960-aa5f-09f8cbdbb284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:58.338364 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce7926-ea2d-4960-aa5f-09f8cbdbb284 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:58.342077 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e7635-f740-4426-b2d2-ce8e9f9d22c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:58.343014 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e7635-f740-4426-b2d2-ce8e9f9d22c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:58.343301 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e7635-f740-4426-b2d2-ce8e9f9d22c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:58.343582 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1e7635-f740-4426-b2d2-ce8e9f9d22c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:58.353390 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e7635-f740-4426-b2d2-ce8e9f9d22c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:58.354876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1e7635-f740-4426-b2d2-ce8e9f9d22c3 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:58.364964 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1270/2547] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:17:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:17:58.645933 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3d54d-9ece-451a-8def-1f0b0f3052b9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:58.647481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a9e3d54d-9ece-451a-8def-1f0b0f3052b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:58.660193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3d54d-9ece-451a-8def-1f0b0f3052b9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:58.664832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536fbdb-e90f-436a-93e6-8eff71bcf7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:58.665801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536fbdb-e90f-436a-93e6-8eff71bcf7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:58.666090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536fbdb-e90f-436a-93e6-8eff71bcf7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:58.666527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536fbdb-e90f-436a-93e6-8eff71bcf7a7 admin admin] PATH_INFO: `/v3/projects/b4f499b0d83c46c2a66929dd01c2c6fa` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:58.667764 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536fbdb-e90f-436a-93e6-8eff71bcf7a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f499b0d83c46c2a66929dd01c2c6fa)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:58.669678 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536fbdb-e90f-436a-93e6-8eff71bcf7a7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:58.702216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:58.720933 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a536fbdb-e90f-436a-93e6-8eff71bcf7a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f499b0d83c46c2a66929dd01c2c6fa', 'request_id': 'req-a536fbdb-e90f-436a-93e6-8eff71bcf7a7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:58.728626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a536fbdb-e90f-436a-93e6-8eff71bcf7a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f499b0d83c46c2a66929dd01c2c6fa', 'request_id': 'req-a536fbdb-e90f-436a-93e6-8eff71bcf7a7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:58.735341 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a536fbdb-e90f-436a-93e6-8eff71bcf7a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f499b0d83c46c2a66929dd01c2c6fa', 'request_id': 'req-a536fbdb-e90f-436a-93e6-8eff71bcf7a7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:58.746447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a536fbdb-e90f-436a-93e6-8eff71bcf7a7 admin admin] The token cache is being invalidate because project b4f499b0d83c46c2a66929dd01c2c6fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:17:58.746738 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a536fbdb-e90f-436a-93e6-8eff71bcf7a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:58.747386 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a536fbdb-e90f-436a-93e6-8eff71bcf7a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:58.748930 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1278/2548] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:17:58 2022] DELETE /identity/v3/projects/b4f499b0d83c46c2a66929dd01c2c6fa => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:58.754172 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e7635-f740-4426-b2d2-ce8e9f9d22c3 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:58.763986 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1e7635-f740-4426-b2d2-ce8e9f9d22c3 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:58.788275 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:58.827949 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a090b-8e0b-4bef-b9ef-394805056c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:58.828820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a090b-8e0b-4bef-b9ef-394805056c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:58.829107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a090b-8e0b-4bef-b9ef-394805056c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:58.829389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a090b-8e0b-4bef-b9ef-394805056c6d admin admin] PATH_INFO: `/v3/users/a161de7427884bd78acf3f2a56f53a24` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:58.830627 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a090b-8e0b-4bef-b9ef-394805056c6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a161de7427884bd78acf3f2a56f53a24)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:58.833099 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a090b-8e0b-4bef-b9ef-394805056c6d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:58.879835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c29a090b-8e0b-4bef-b9ef-394805056c6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a161de7427884bd78acf3f2a56f53a24'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:58.886833 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c29a090b-8e0b-4bef-b9ef-394805056c6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a161de7427884bd78acf3f2a56f53a24'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:58.899173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c29a090b-8e0b-4bef-b9ef-394805056c6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a161de7427884bd78acf3f2a56f53a24'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:58.899850 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c29a090b-8e0b-4bef-b9ef-394805056c6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a161de7427884bd78acf3f2a56f53a24'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:58.900469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c29a090b-8e0b-4bef-b9ef-394805056c6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a161de7427884bd78acf3f2a56f53a24'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:58.915118 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1271/2549] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:17:58 2022] DELETE /identity/v3/users/a161de7427884bd78acf3f2a56f53a24 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:59.199144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536fbdb-e90f-436a-93e6-8eff71bcf7a7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:59.200728 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a536fbdb-e90f-436a-93e6-8eff71bcf7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:59.214555 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536fbdb-e90f-436a-93e6-8eff71bcf7a7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:59.288380 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb5572-a063-4286-84e5-a2ee710ac682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:59.290436 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb5572-a063-4286-84e5-a2ee710ac682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:59.290756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb5572-a063-4286-84e5-a2ee710ac682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:59.291028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb5572-a063-4286-84e5-a2ee710ac682 admin admin] PATH_INFO: `/v3/projects/749f6eec1dd14d69b2363ba354f4fd27` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:59.292662 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb5572-a063-4286-84e5-a2ee710ac682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=749f6eec1dd14d69b2363ba354f4fd27)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:59.294923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb5572-a063-4286-84e5-a2ee710ac682 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:59.354348 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a0eb5572-a063-4286-84e5-a2ee710ac682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '749f6eec1dd14d69b2363ba354f4fd27', 'request_id': 'req-a0eb5572-a063-4286-84e5-a2ee710ac682'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:59.366602 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a0eb5572-a063-4286-84e5-a2ee710ac682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '749f6eec1dd14d69b2363ba354f4fd27', 'request_id': 'req-a0eb5572-a063-4286-84e5-a2ee710ac682'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:59.375567 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a0eb5572-a063-4286-84e5-a2ee710ac682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '749f6eec1dd14d69b2363ba354f4fd27', 'request_id': 'req-a0eb5572-a063-4286-84e5-a2ee710ac682'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:59.389446 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a0eb5572-a063-4286-84e5-a2ee710ac682 admin admin] The token cache is being invalidate because project 749f6eec1dd14d69b2363ba354f4fd27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:17:59.389858 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a0eb5572-a063-4286-84e5-a2ee710ac682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:59.390537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a0eb5572-a063-4286-84e5-a2ee710ac682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:17:59.392230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1279/2550] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:17:59 2022] DELETE /identity/v3/projects/749f6eec1dd14d69b2363ba354f4fd27 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:59.397529 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec800e-6b7f-4465-ad8a-2f04facfe9bc None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:59.397864 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec800e-6b7f-4465-ad8a-2f04facfe9bc None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:59.398162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec800e-6b7f-4465-ad8a-2f04facfe9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:59.419107 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-7fec800e-6b7f-4465-ad8a-2f04facfe9bc None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:59.429381 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7fec800e-6b7f-4465-ad8a-2f04facfe9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:59.504518 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1272/2551] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:59.505753 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d463bc7-362b-48bf-aa69-4b23dc136058 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:59.506046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d463bc7-362b-48bf-aa69-4b23dc136058 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:59.506323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d463bc7-362b-48bf-aa69-4b23dc136058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:59.525672 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6d463bc7-362b-48bf-aa69-4b23dc136058 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:59.527046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6d463bc7-362b-48bf-aa69-4b23dc136058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:59.537806 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1280/2552] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:17:59.542005 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec800e-6b7f-4465-ad8a-2f04facfe9bc None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:59.552154 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec800e-6b7f-4465-ad8a-2f04facfe9bc None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:59.558427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137ab4d-0e9d-42c0-9169-1d83c5625a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:59.559141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137ab4d-0e9d-42c0-9169-1d83c5625a26 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:59.559418 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137ab4d-0e9d-42c0-9169-1d83c5625a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:59.559692 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137ab4d-0e9d-42c0-9169-1d83c5625a26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:59.560420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137ab4d-0e9d-42c0-9169-1d83c5625a26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:17:59.560727 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137ab4d-0e9d-42c0-9169-1d83c5625a26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:59.562366 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137ab4d-0e9d-42c0-9169-1d83c5625a26 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:59.574399 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1273/2553] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:17:59.578962 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d463bc7-362b-48bf-aa69-4b23dc136058 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:59.589992 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d463bc7-362b-48bf-aa69-4b23dc136058 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:59.595292 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5202d-78cc-4bb4-aa68-e04e0d2698a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:59.595995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5202d-78cc-4bb4-aa68-e04e0d2698a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:59.596272 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5202d-78cc-4bb4-aa68-e04e0d2698a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:59.597214 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5202d-78cc-4bb4-aa68-e04e0d2698a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:59.597954 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5202d-78cc-4bb4-aa68-e04e0d2698a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:59.599860 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5202d-78cc-4bb4-aa68-e04e0d2698a3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:59.626871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1281/2554] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:17:59 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:17:59.631818 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137ab4d-0e9d-42c0-9169-1d83c5625a26 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:59.642146 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137ab4d-0e9d-42c0-9169-1d83c5625a26 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:59.681535 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:59.710967 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf12a7-1353-4818-bf9e-dd7bfd1fce15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:59.712588 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf12a7-1353-4818-bf9e-dd7bfd1fce15 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:59.712894 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf12a7-1353-4818-bf9e-dd7bfd1fce15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:59.713297 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf12a7-1353-4818-bf9e-dd7bfd1fce15 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:59.714130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf12a7-1353-4818-bf9e-dd7bfd1fce15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:59.716293 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf12a7-1353-4818-bf9e-dd7bfd1fce15 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:59.741846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1274/2555] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:17:59 2022] POST /identity/v3/users => generated 303 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:17:59.744971 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5202d-78cc-4bb4-aa68-e04e0d2698a3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:59.756561 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5202d-78cc-4bb4-aa68-e04e0d2698a3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:59.761331 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05585916-3053-46cd-be40-fdda2a6e7930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:59.762026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05585916-3053-46cd-be40-fdda2a6e7930 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:59.762337 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05585916-3053-46cd-be40-fdda2a6e7930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:59.762598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05585916-3053-46cd-be40-fdda2a6e7930 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:59.763330 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05585916-3053-46cd-be40-fdda2a6e7930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:59.764932 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05585916-3053-46cd-be40-fdda2a6e7930 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:59.777530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1282/2556] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:17:59.781561 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf12a7-1353-4818-bf9e-dd7bfd1fce15 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:59.792814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf12a7-1353-4818-bf9e-dd7bfd1fce15 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:59.797395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274cdef-78f1-4eb0-b8a0-5119c37cced1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:59.798090 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274cdef-78f1-4eb0-b8a0-5119c37cced1 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:59.798375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274cdef-78f1-4eb0-b8a0-5119c37cced1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:59.798651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274cdef-78f1-4eb0-b8a0-5119c37cced1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:59.799371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274cdef-78f1-4eb0-b8a0-5119c37cced1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:59.801131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274cdef-78f1-4eb0-b8a0-5119c37cced1 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:59.811462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1275/2557] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:17:59.816586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05585916-3053-46cd-be40-fdda2a6e7930 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:59.823086 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:59.827107 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05585916-3053-46cd-be40-fdda2a6e7930 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:17:59.834203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c666a-77f3-41ec-94a9-37342775d4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:17:59.835283 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c666a-77f3-41ec-94a9-37342775d4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:59.835735 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c666a-77f3-41ec-94a9-37342775d4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:59.836016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c666a-77f3-41ec-94a9-37342775d4eb admin admin] PATH_INFO: `/v3/projects/e1a65b7f3c2f4a00a9445eb4bbb01afd/users/be12f02aa9e64a80bff1efe09660db8b/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:59.851493 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c666a-77f3-41ec-94a9-37342775d4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a65b7f3c2f4a00a9445eb4bbb01afd, user_id=be12f02aa9e64a80bff1efe09660db8b, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:17:59.854187 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c666a-77f3-41ec-94a9-37342775d4eb admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:17:59.868734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1283/2558] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:17:59 2022] PUT /identity/v3/projects/e1a65b7f3c2f4a00a9445eb4bbb01afd/users/be12f02aa9e64a80bff1efe09660db8b/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:17:59.874494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a84bf1-cca4-425c-9496-f8ba77942df4 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:17:59.874817 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a84bf1-cca4-425c-9496-f8ba77942df4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:17:59.875104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a84bf1-cca4-425c-9496-f8ba77942df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:17:59.895321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-b8a84bf1-cca4-425c-9496-f8ba77942df4 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:17:59.896540 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b8a84bf1-cca4-425c-9496-f8ba77942df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:17:59.957098 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1276/2559] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:17:59.966534 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c666a-77f3-41ec-94a9-37342775d4eb admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:17:59.968535 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e72c666a-77f3-41ec-94a9-37342775d4eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:00.026895 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c666a-77f3-41ec-94a9-37342775d4eb admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:00.030606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5666c28-a61a-4591-baf0-dbf6eec9b5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:00.031333 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5666c28-a61a-4591-baf0-dbf6eec9b5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:00.031532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5666c28-a61a-4591-baf0-dbf6eec9b5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:00.031812 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5666c28-a61a-4591-baf0-dbf6eec9b5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:00.041080 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5666c28-a61a-4591-baf0-dbf6eec9b5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:00.042542 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5666c28-a61a-4591-baf0-dbf6eec9b5f9 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:00.052199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1284/2560] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:18:00.976134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9578de-db61-4644-a745-9e848c420cb6 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:00.976567 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9578de-db61-4644-a745-9e848c420cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:00.976825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9578de-db61-4644-a745-9e848c420cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:01.006268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6b9578de-db61-4644-a745-9e848c420cb6 None None] MFA Rules not processed for user `be12f02aa9e64a80bff1efe09660db8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:01.007500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6b9578de-db61-4644-a745-9e848c420cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:01.087934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1277/2561] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:01.092361 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5666c28-a61a-4591-baf0-dbf6eec9b5f9 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:01.107110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5666c28-a61a-4591-baf0-dbf6eec9b5f9 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:01.114418 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8589867-dbec-4085-9a62-230b8efc7db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:01.115725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8589867-dbec-4085-9a62-230b8efc7db9 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:01.116044 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8589867-dbec-4085-9a62-230b8efc7db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:01.116349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8589867-dbec-4085-9a62-230b8efc7db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:01.117050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8589867-dbec-4085-9a62-230b8efc7db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:01.119093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8589867-dbec-4085-9a62-230b8efc7db9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:01.152898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1285/2562] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:18:01 2022] POST /identity/v3/projects => generated 403 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:18:01.157040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9578de-db61-4644-a745-9e848c420cb6 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:01.170555 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9578de-db61-4644-a745-9e848c420cb6 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:01.212722 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:01.232797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab2f78-266d-4ad1-8325-26967b79b1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:01.233452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab2f78-266d-4ad1-8325-26967b79b1cb admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:01.233764 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab2f78-266d-4ad1-8325-26967b79b1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:01.234044 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab2f78-266d-4ad1-8325-26967b79b1cb admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:01.234745 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab2f78-266d-4ad1-8325-26967b79b1cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:01.236673 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab2f78-266d-4ad1-8325-26967b79b1cb admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:01.256884 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1278/2563] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:18:01 2022] POST /identity/v3/users => generated 308 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:18:01.261100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8589867-dbec-4085-9a62-230b8efc7db9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:01.271966 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8589867-dbec-4085-9a62-230b8efc7db9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:01.276659 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6ee52-bab5-42b2-a20c-97066982e56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:01.277241 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6ee52-bab5-42b2-a20c-97066982e56a admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:01.277524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6ee52-bab5-42b2-a20c-97066982e56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:01.277842 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6ee52-bab5-42b2-a20c-97066982e56a admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:01.278578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6ee52-bab5-42b2-a20c-97066982e56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:01.280162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6ee52-bab5-42b2-a20c-97066982e56a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:01.291382 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1286/2564] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:18:01.295631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab2f78-266d-4ad1-8325-26967b79b1cb admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:01.306431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab2f78-266d-4ad1-8325-26967b79b1cb admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:01.311224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a937e24-e1f5-46ea-aa7b-b5be43783a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:01.312100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a937e24-e1f5-46ea-aa7b-b5be43783a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:01.312381 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a937e24-e1f5-46ea-aa7b-b5be43783a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:01.312654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a937e24-e1f5-46ea-aa7b-b5be43783a1a admin admin] PATH_INFO: `/v3/projects/19da88f6cc9e432088d19cc42c7baa5d/users/175d6793281749359ef257b743ac1426/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:01.334608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a937e24-e1f5-46ea-aa7b-b5be43783a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19da88f6cc9e432088d19cc42c7baa5d, user_id=175d6793281749359ef257b743ac1426, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:01.337333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a937e24-e1f5-46ea-aa7b-b5be43783a1a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:01.352594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1279/2565] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:18:01 2022] PUT /identity/v3/projects/19da88f6cc9e432088d19cc42c7baa5d/users/175d6793281749359ef257b743ac1426/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:18:01.356684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6ee52-bab5-42b2-a20c-97066982e56a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:01.367789 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6ee52-bab5-42b2-a20c-97066982e56a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:01.432953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b143b-eea3-4d39-8612-a2bf64f5c6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:01.433833 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b143b-eea3-4d39-8612-a2bf64f5c6ee admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:01.434124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b143b-eea3-4d39-8612-a2bf64f5c6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:01.434403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b143b-eea3-4d39-8612-a2bf64f5c6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:01.435137 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b143b-eea3-4d39-8612-a2bf64f5c6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:01.436812 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b143b-eea3-4d39-8612-a2bf64f5c6ee admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:01.447788 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1287/2566] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:18:01.451965 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a937e24-e1f5-46ea-aa7b-b5be43783a1a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:01.463144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a937e24-e1f5-46ea-aa7b-b5be43783a1a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:01.468033 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d62ab0-d2d4-49b0-9b48-c75cc1d1f308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:01.468904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d62ab0-d2d4-49b0-9b48-c75cc1d1f308 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:01.469180 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d62ab0-d2d4-49b0-9b48-c75cc1d1f308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:01.469450 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d62ab0-d2d4-49b0-9b48-c75cc1d1f308 admin admin] PATH_INFO: `/v3/projects/19da88f6cc9e432088d19cc42c7baa5d/users/175d6793281749359ef257b743ac1426/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:01.471463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d62ab0-d2d4-49b0-9b48-c75cc1d1f308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19da88f6cc9e432088d19cc42c7baa5d, user_id=175d6793281749359ef257b743ac1426, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:01.474117 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d62ab0-d2d4-49b0-9b48-c75cc1d1f308 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:01.484437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1280/2567] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:18:01 2022] PUT /identity/v3/projects/19da88f6cc9e432088d19cc42c7baa5d/users/175d6793281749359ef257b743ac1426/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:18:02.163894 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471e349-e2e2-4ace-975b-405aabf55caf None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:02.164509 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471e349-e2e2-4ace-975b-405aabf55caf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:02.164509 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471e349-e2e2-4ace-975b-405aabf55caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:02.193615 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0471e349-e2e2-4ace-975b-405aabf55caf None None] MFA Rules not processed for user `175d6793281749359ef257b743ac1426`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:02.194921 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0471e349-e2e2-4ace-975b-405aabf55caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:02.230923 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:02.269706 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1288/2568] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:02 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:03.430974 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d62ab0-d2d4-49b0-9b48-c75cc1d1f308 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:03.498217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d62ab0-d2d4-49b0-9b48-c75cc1d1f308 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:03.503000 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8958e91-eb25-427a-9df7-38841585ad0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:03.503884 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8958e91-eb25-427a-9df7-38841585ad0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:03.504163 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8958e91-eb25-427a-9df7-38841585ad0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:03.504441 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8958e91-eb25-427a-9df7-38841585ad0a admin admin] PATH_INFO: `/v3/users/be12f02aa9e64a80bff1efe09660db8b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:03.505676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8958e91-eb25-427a-9df7-38841585ad0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=be12f02aa9e64a80bff1efe09660db8b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:03.507666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8958e91-eb25-427a-9df7-38841585ad0a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:03.567970 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d8958e91-eb25-427a-9df7-38841585ad0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be12f02aa9e64a80bff1efe09660db8b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:03.576438 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d8958e91-eb25-427a-9df7-38841585ad0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be12f02aa9e64a80bff1efe09660db8b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:03.592570 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d8958e91-eb25-427a-9df7-38841585ad0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be12f02aa9e64a80bff1efe09660db8b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:03.593598 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d8958e91-eb25-427a-9df7-38841585ad0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be12f02aa9e64a80bff1efe09660db8b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:03.594238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-d8958e91-eb25-427a-9df7-38841585ad0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be12f02aa9e64a80bff1efe09660db8b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:03.609464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1281/2569] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:18:03 2022] DELETE /identity/v3/users/be12f02aa9e64a80bff1efe09660db8b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:03.805497 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471e349-e2e2-4ace-975b-405aabf55caf None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:03.819148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471e349-e2e2-4ace-975b-405aabf55caf None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:03.885152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbb82e-26b6-49db-948f-bc937a621add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:03.886046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbb82e-26b6-49db-948f-bc937a621add admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:03.886330 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbb82e-26b6-49db-948f-bc937a621add admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:03.886606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbb82e-26b6-49db-948f-bc937a621add admin admin] PATH_INFO: `/v3/projects/e1a65b7f3c2f4a00a9445eb4bbb01afd` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:03.887811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbb82e-26b6-49db-948f-bc937a621add admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a65b7f3c2f4a00a9445eb4bbb01afd)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:03.889740 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbb82e-26b6-49db-948f-bc937a621add admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:03.937749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-efdbb82e-26b6-49db-948f-bc937a621add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a65b7f3c2f4a00a9445eb4bbb01afd', 'request_id': 'req-efdbb82e-26b6-49db-948f-bc937a621add'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:03.945925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-efdbb82e-26b6-49db-948f-bc937a621add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a65b7f3c2f4a00a9445eb4bbb01afd', 'request_id': 'req-efdbb82e-26b6-49db-948f-bc937a621add'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:03.952780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-efdbb82e-26b6-49db-948f-bc937a621add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a65b7f3c2f4a00a9445eb4bbb01afd', 'request_id': 'req-efdbb82e-26b6-49db-948f-bc937a621add'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:03.964850 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-efdbb82e-26b6-49db-948f-bc937a621add admin admin] The token cache is being invalidate because project e1a65b7f3c2f4a00a9445eb4bbb01afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:18:03.965238 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-efdbb82e-26b6-49db-948f-bc937a621add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:03.966233 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-efdbb82e-26b6-49db-948f-bc937a621add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:03.968094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1289/2570] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:18:03 2022] DELETE /identity/v3/projects/e1a65b7f3c2f4a00a9445eb4bbb01afd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:03.973407 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8958e91-eb25-427a-9df7-38841585ad0a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:03.974947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d8958e91-eb25-427a-9df7-38841585ad0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:03.988912 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8958e91-eb25-427a-9df7-38841585ad0a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:03.998326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:04.068244 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644de28-cc0d-46ae-96bb-dd1a65fbe03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:04.069624 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644de28-cc0d-46ae-96bb-dd1a65fbe03e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:04.070197 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644de28-cc0d-46ae-96bb-dd1a65fbe03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:04.070705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644de28-cc0d-46ae-96bb-dd1a65fbe03e admin admin] PATH_INFO: `/v3/users/175d6793281749359ef257b743ac1426` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:04.072126 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644de28-cc0d-46ae-96bb-dd1a65fbe03e admin admin] RBAC: Authorizing `identity:delete_user(user_id=175d6793281749359ef257b743ac1426)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:04.074134 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644de28-cc0d-46ae-96bb-dd1a65fbe03e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:04.125518 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4644de28-cc0d-46ae-96bb-dd1a65fbe03e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '175d6793281749359ef257b743ac1426'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:04.133555 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4644de28-cc0d-46ae-96bb-dd1a65fbe03e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '175d6793281749359ef257b743ac1426'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:04.146236 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4644de28-cc0d-46ae-96bb-dd1a65fbe03e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '175d6793281749359ef257b743ac1426'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:04.146975 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4644de28-cc0d-46ae-96bb-dd1a65fbe03e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '175d6793281749359ef257b743ac1426'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:04.147575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-4644de28-cc0d-46ae-96bb-dd1a65fbe03e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '175d6793281749359ef257b743ac1426'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:04.163470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1282/2571] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:18:03 2022] DELETE /identity/v3/users/175d6793281749359ef257b743ac1426 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:04.348947 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbb82e-26b6-49db-948f-bc937a621add admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:04.350498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-efdbb82e-26b6-49db-948f-bc937a621add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:04.374509 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbb82e-26b6-49db-948f-bc937a621add admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:04.442721 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2cd1e-d9a1-4c2e-b364-cce93a4f3bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:04.443603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2cd1e-d9a1-4c2e-b364-cce93a4f3bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:04.443889 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2cd1e-d9a1-4c2e-b364-cce93a4f3bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:04.444166 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2cd1e-d9a1-4c2e-b364-cce93a4f3bc4 admin admin] PATH_INFO: `/v3/projects/19da88f6cc9e432088d19cc42c7baa5d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:04.445401 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2cd1e-d9a1-4c2e-b364-cce93a4f3bc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19da88f6cc9e432088d19cc42c7baa5d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:04.447375 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2cd1e-d9a1-4c2e-b364-cce93a4f3bc4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:04.449849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:04.501220 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-83c2cd1e-d9a1-4c2e-b364-cce93a4f3bc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19da88f6cc9e432088d19cc42c7baa5d', 'request_id': 'req-83c2cd1e-d9a1-4c2e-b364-cce93a4f3bc4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:04.509924 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-83c2cd1e-d9a1-4c2e-b364-cce93a4f3bc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19da88f6cc9e432088d19cc42c7baa5d', 'request_id': 'req-83c2cd1e-d9a1-4c2e-b364-cce93a4f3bc4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:04.516335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-83c2cd1e-d9a1-4c2e-b364-cce93a4f3bc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19da88f6cc9e432088d19cc42c7baa5d', 'request_id': 'req-83c2cd1e-d9a1-4c2e-b364-cce93a4f3bc4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:04.527984 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-83c2cd1e-d9a1-4c2e-b364-cce93a4f3bc4 admin admin] The token cache is being invalidate because project 19da88f6cc9e432088d19cc42c7baa5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:18:04.528273 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-83c2cd1e-d9a1-4c2e-b364-cce93a4f3bc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:04.528952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-83c2cd1e-d9a1-4c2e-b364-cce93a4f3bc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:04.530908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1290/2572] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:18:04 2022] DELETE /identity/v3/projects/19da88f6cc9e432088d19cc42c7baa5d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:04.536806 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdea80-e341-40fd-a93e-bcbfdb7a034f None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:04.537379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdea80-e341-40fd-a93e-bcbfdb7a034f None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:04.537649 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdea80-e341-40fd-a93e-bcbfdb7a034f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:04.560252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-1fcdea80-e341-40fd-a93e-bcbfdb7a034f None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:04.561627 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1fcdea80-e341-40fd-a93e-bcbfdb7a034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:04.633908 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1283/2573] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:04.641457 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73104b-574d-4a80-9634-3015158fa6a0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:04.641781 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73104b-574d-4a80-9634-3015158fa6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:04.642063 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73104b-574d-4a80-9634-3015158fa6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:04.661566 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4c73104b-574d-4a80-9634-3015158fa6a0 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:04.662794 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4c73104b-574d-4a80-9634-3015158fa6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:04.671055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1291/2574] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:04.676449 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdea80-e341-40fd-a93e-bcbfdb7a034f None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:04.686735 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdea80-e341-40fd-a93e-bcbfdb7a034f None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:04.692264 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c3a61-ce6e-4112-be80-9bb525743f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:04.692923 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c3a61-ce6e-4112-be80-9bb525743f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:04.693205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c3a61-ce6e-4112-be80-9bb525743f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:04.693479 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c3a61-ce6e-4112-be80-9bb525743f4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:04.694235 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c3a61-ce6e-4112-be80-9bb525743f4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:18:04.694556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c3a61-ce6e-4112-be80-9bb525743f4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:04.696130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c3a61-ce6e-4112-be80-9bb525743f4e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:04.708158 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1284/2575] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 17:18:04.712537 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73104b-574d-4a80-9634-3015158fa6a0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:04.723589 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73104b-574d-4a80-9634-3015158fa6a0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:04.728378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d84bb1-0091-4925-b067-dbf5fd1a98be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:04.729133 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d84bb1-0091-4925-b067-dbf5fd1a98be admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:04.729420 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d84bb1-0091-4925-b067-dbf5fd1a98be admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:04.729733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d84bb1-0091-4925-b067-dbf5fd1a98be admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:04.730433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d84bb1-0091-4925-b067-dbf5fd1a98be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:04.732344 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d84bb1-0091-4925-b067-dbf5fd1a98be admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:04.759871 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1292/2576] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:18:04 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:18:04.764511 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c3a61-ce6e-4112-be80-9bb525743f4e admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:04.776870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c3a61-ce6e-4112-be80-9bb525743f4e admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:04.795409 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:04.840756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d9213-95a9-413f-9285-43f102132b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:04.841435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d9213-95a9-413f-9285-43f102132b16 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:04.841754 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d9213-95a9-413f-9285-43f102132b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:04.842039 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d9213-95a9-413f-9285-43f102132b16 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:04.843000 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d9213-95a9-413f-9285-43f102132b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:04.844946 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d9213-95a9-413f-9285-43f102132b16 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:04.871227 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1285/2577] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:18:04 2022] POST /identity/v3/users => generated 282 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:18:04.872596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d84bb1-0091-4925-b067-dbf5fd1a98be admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:04.885899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d84bb1-0091-4925-b067-dbf5fd1a98be admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:04.891957 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6ec68-71b1-47eb-a808-7f838de489fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:04.892666 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6ec68-71b1-47eb-a808-7f838de489fd admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:04.892951 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6ec68-71b1-47eb-a808-7f838de489fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:04.893288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6ec68-71b1-47eb-a808-7f838de489fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:04.894134 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6ec68-71b1-47eb-a808-7f838de489fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:04.895653 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6ec68-71b1-47eb-a808-7f838de489fd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:04.907884 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1293/2578] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:18:04.912057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d9213-95a9-413f-9285-43f102132b16 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:04.922329 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d9213-95a9-413f-9285-43f102132b16 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:04.927927 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8349aa-8f0e-4f85-ab88-7daaee6c734f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:04.928666 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8349aa-8f0e-4f85-ab88-7daaee6c734f admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:04.928882 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8349aa-8f0e-4f85-ab88-7daaee6c734f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:04.929192 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8349aa-8f0e-4f85-ab88-7daaee6c734f admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:04.929987 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8349aa-8f0e-4f85-ab88-7daaee6c734f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:04.931600 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8349aa-8f0e-4f85-ab88-7daaee6c734f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:04.944043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1286/2579] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:18:04.948267 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6ec68-71b1-47eb-a808-7f838de489fd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:04.958566 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6ec68-71b1-47eb-a808-7f838de489fd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:04.963229 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d049de1-45d6-41f1-93a2-87f8bcc78dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:04.964135 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d049de1-45d6-41f1-93a2-87f8bcc78dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:04.964425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d049de1-45d6-41f1-93a2-87f8bcc78dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:04.964704 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d049de1-45d6-41f1-93a2-87f8bcc78dfd admin admin] PATH_INFO: `/v3/projects/c6f29b38fdc440cd9067eae517ad0b17/users/6927a8031c554582aceedd4062a93bbe/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:04.981931 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d049de1-45d6-41f1-93a2-87f8bcc78dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f29b38fdc440cd9067eae517ad0b17, user_id=6927a8031c554582aceedd4062a93bbe, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:04.984964 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d049de1-45d6-41f1-93a2-87f8bcc78dfd admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:04.999765 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1294/2580] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:18:04 2022] PUT /identity/v3/projects/c6f29b38fdc440cd9067eae517ad0b17/users/6927a8031c554582aceedd4062a93bbe/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:05.011815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48bf63-4616-43bb-a6be-12eb72498f03 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:05.012110 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48bf63-4616-43bb-a6be-12eb72498f03 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:05.012395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48bf63-4616-43bb-a6be-12eb72498f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:05.042560 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ea48bf63-4616-43bb-a6be-12eb72498f03 None None] MFA Rules not processed for user `6927a8031c554582aceedd4062a93bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:05.043788 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ea48bf63-4616-43bb-a6be-12eb72498f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:05.124535 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1287/2581] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:05.129524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d049de1-45d6-41f1-93a2-87f8bcc78dfd admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:05.196414 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d049de1-45d6-41f1-93a2-87f8bcc78dfd admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:05.208771 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad618a2-2f70-4a92-b451-9e8fe1f041ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:05.209493 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad618a2-2f70-4a92-b451-9e8fe1f041ad admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:05.209874 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad618a2-2f70-4a92-b451-9e8fe1f041ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:05.210384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad618a2-2f70-4a92-b451-9e8fe1f041ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:05.211776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad618a2-2f70-4a92-b451-9e8fe1f041ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:05.216220 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad618a2-2f70-4a92-b451-9e8fe1f041ad admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:05.250869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1295/2582] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:18:05 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:18:05.255616 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48bf63-4616-43bb-a6be-12eb72498f03 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:05.271818 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48bf63-4616-43bb-a6be-12eb72498f03 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:05.333536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82458f7c-a53a-4e4b-b581-6ce7f8951937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:05.334249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82458f7c-a53a-4e4b-b581-6ce7f8951937 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:05.334539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82458f7c-a53a-4e4b-b581-6ce7f8951937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:05.334819 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82458f7c-a53a-4e4b-b581-6ce7f8951937 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:05.335533 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82458f7c-a53a-4e4b-b581-6ce7f8951937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:05.337485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82458f7c-a53a-4e4b-b581-6ce7f8951937 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:05.362975 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1288/2583] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:18:05 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:18:05.367331 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad618a2-2f70-4a92-b451-9e8fe1f041ad admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:05.378278 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad618a2-2f70-4a92-b451-9e8fe1f041ad admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:05.383039 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f790ba-d07a-4bba-9d07-834ef7947979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:05.383709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f790ba-d07a-4bba-9d07-834ef7947979 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:05.383990 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f790ba-d07a-4bba-9d07-834ef7947979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:05.384265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f790ba-d07a-4bba-9d07-834ef7947979 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:05.385123 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f790ba-d07a-4bba-9d07-834ef7947979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:05.386768 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f790ba-d07a-4bba-9d07-834ef7947979 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:05.405321 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1296/2584] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:18:05.410273 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82458f7c-a53a-4e4b-b581-6ce7f8951937 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:05.420539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82458f7c-a53a-4e4b-b581-6ce7f8951937 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:05.426105 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe815ee-64ef-4b96-8c82-8b6714d52203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:05.426998 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe815ee-64ef-4b96-8c82-8b6714d52203 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:05.427286 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe815ee-64ef-4b96-8c82-8b6714d52203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:05.427563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe815ee-64ef-4b96-8c82-8b6714d52203 admin admin] PATH_INFO: `/v3/projects/c2083ef972a84e0889edcb3692e9e581/users/ea2c4bd9bcad465085e91f9d626e5a53/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:05.445261 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe815ee-64ef-4b96-8c82-8b6714d52203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2083ef972a84e0889edcb3692e9e581, user_id=ea2c4bd9bcad465085e91f9d626e5a53, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:05.448165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe815ee-64ef-4b96-8c82-8b6714d52203 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:05.450568 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:05.466136 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1289/2585] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:18:05 2022] PUT /identity/v3/projects/c2083ef972a84e0889edcb3692e9e581/users/ea2c4bd9bcad465085e91f9d626e5a53/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:05.471033 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f790ba-d07a-4bba-9d07-834ef7947979 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:05.477230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:05.483303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f790ba-d07a-4bba-9d07-834ef7947979 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:05.551468 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fed1f9-03f4-49b4-98c9-c9759b3878f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:05.552144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fed1f9-03f4-49b4-98c9-c9759b3878f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:05.552426 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fed1f9-03f4-49b4-98c9-c9759b3878f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:05.552704 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fed1f9-03f4-49b4-98c9-c9759b3878f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:05.553438 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fed1f9-03f4-49b4-98c9-c9759b3878f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:05.555084 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fed1f9-03f4-49b4-98c9-c9759b3878f6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:05.566682 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1297/2586] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:18:05.571240 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe815ee-64ef-4b96-8c82-8b6714d52203 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:05.585694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe815ee-64ef-4b96-8c82-8b6714d52203 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:05.590752 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f82a0-1002-407f-b984-079dad4a30ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:05.591646 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f82a0-1002-407f-b984-079dad4a30ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:05.591926 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f82a0-1002-407f-b984-079dad4a30ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:05.592198 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f82a0-1002-407f-b984-079dad4a30ff admin admin] PATH_INFO: `/v3/projects/c2083ef972a84e0889edcb3692e9e581/users/ea2c4bd9bcad465085e91f9d626e5a53/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:05.594489 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f82a0-1002-407f-b984-079dad4a30ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2083ef972a84e0889edcb3692e9e581, user_id=ea2c4bd9bcad465085e91f9d626e5a53, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:05.598185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f82a0-1002-407f-b984-079dad4a30ff admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:05.609500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1290/2587] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:18:05 2022] PUT /identity/v3/projects/c2083ef972a84e0889edcb3692e9e581/users/ea2c4bd9bcad465085e91f9d626e5a53/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:05.620235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba821f9-5bfd-4502-a8e3-470642b87ec9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:05.620508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba821f9-5bfd-4502-a8e3-470642b87ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:05.620795 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba821f9-5bfd-4502-a8e3-470642b87ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:05.651260 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9ba821f9-5bfd-4502-a8e3-470642b87ec9 None None] MFA Rules not processed for user `ea2c4bd9bcad465085e91f9d626e5a53`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:05.652490 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9ba821f9-5bfd-4502-a8e3-470642b87ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:05.727961 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1298/2588] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:05.744586 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f82a0-1002-407f-b984-079dad4a30ff admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:05.746440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a34f82a0-1002-407f-b984-079dad4a30ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:05.807581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f82a0-1002-407f-b984-079dad4a30ff admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:05.811388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69913e4-b947-4e9f-9624-8f0f471ceb14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:05.812068 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69913e4-b947-4e9f-9624-8f0f471ceb14 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:05.812331 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69913e4-b947-4e9f-9624-8f0f471ceb14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:05.812608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69913e4-b947-4e9f-9624-8f0f471ceb14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:05.824148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69913e4-b947-4e9f-9624-8f0f471ceb14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:05.825684 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69913e4-b947-4e9f-9624-8f0f471ceb14 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:05.837083 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1291/2589] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:18:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:18:05.924022 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba821f9-5bfd-4502-a8e3-470642b87ec9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:05.934106 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba821f9-5bfd-4502-a8e3-470642b87ec9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:05.939038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40142b15-1b26-4844-a39e-70cf138238aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:05.939698 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40142b15-1b26-4844-a39e-70cf138238aa service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:05.939985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40142b15-1b26-4844-a39e-70cf138238aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:05.940933 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40142b15-1b26-4844-a39e-70cf138238aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:06.008641 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40142b15-1b26-4844-a39e-70cf138238aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:06.010175 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40142b15-1b26-4844-a39e-70cf138238aa service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:06.020953 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1299/2590] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:18:05 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:18:08.770269 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69913e4-b947-4e9f-9624-8f0f471ceb14 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:08.839193 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69913e4-b947-4e9f-9624-8f0f471ceb14 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:08.844115 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed4944-1f31-4408-8190-2fff26fc0c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:08.844984 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed4944-1f31-4408-8190-2fff26fc0c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:08.845271 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed4944-1f31-4408-8190-2fff26fc0c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:08.845549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed4944-1f31-4408-8190-2fff26fc0c0b admin admin] PATH_INFO: `/v3/users/6927a8031c554582aceedd4062a93bbe` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:08.847075 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed4944-1f31-4408-8190-2fff26fc0c0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6927a8031c554582aceedd4062a93bbe)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:08.849049 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed4944-1f31-4408-8190-2fff26fc0c0b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:08.901369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-caed4944-1f31-4408-8190-2fff26fc0c0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6927a8031c554582aceedd4062a93bbe'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:08.909026 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-caed4944-1f31-4408-8190-2fff26fc0c0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6927a8031c554582aceedd4062a93bbe'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:08.921383 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-caed4944-1f31-4408-8190-2fff26fc0c0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6927a8031c554582aceedd4062a93bbe'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:08.922155 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-caed4944-1f31-4408-8190-2fff26fc0c0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6927a8031c554582aceedd4062a93bbe'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:08.922765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-caed4944-1f31-4408-8190-2fff26fc0c0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6927a8031c554582aceedd4062a93bbe'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:08.936413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1292/2591] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:18:08 2022] DELETE /identity/v3/users/6927a8031c554582aceedd4062a93bbe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:08.941874 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b490ce8-57fb-404b-a578-8827d3d4060d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:08.942429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b490ce8-57fb-404b-a578-8827d3d4060d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:08.942429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b490ce8-57fb-404b-a578-8827d3d4060d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:08.961350 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6b490ce8-57fb-404b-a578-8827d3d4060d None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:08.962632 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6b490ce8-57fb-404b-a578-8827d3d4060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:08.981110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:09.027749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1300/2592] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:09.037951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed4944-1f31-4408-8190-2fff26fc0c0b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:09.039554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-caed4944-1f31-4408-8190-2fff26fc0c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:09.045334 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:09.105260 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed4944-1f31-4408-8190-2fff26fc0c0b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:09.109012 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c4a3a-6e19-4ccc-8adf-37ea4dd6e25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:09.109682 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c4a3a-6e19-4ccc-8adf-37ea4dd6e25d service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:09.109981 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c4a3a-6e19-4ccc-8adf-37ea4dd6e25d service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:09.110258 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c4a3a-6e19-4ccc-8adf-37ea4dd6e25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:09.121029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c4a3a-6e19-4ccc-8adf-37ea4dd6e25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:09.122520 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c4a3a-6e19-4ccc-8adf-37ea4dd6e25d service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:09.133066 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1293/2593] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:18:09.438579 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b490ce8-57fb-404b-a578-8827d3d4060d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:09.440606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6b490ce8-57fb-404b-a578-8827d3d4060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:09.452991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b490ce8-57fb-404b-a578-8827d3d4060d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:09.458265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191bf4d-df19-45fa-a1ae-5e7241204036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:09.459700 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191bf4d-df19-45fa-a1ae-5e7241204036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:09.460069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191bf4d-df19-45fa-a1ae-5e7241204036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:09.460347 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191bf4d-df19-45fa-a1ae-5e7241204036 admin admin] PATH_INFO: `/v3/projects/c6f29b38fdc440cd9067eae517ad0b17` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:09.461602 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191bf4d-df19-45fa-a1ae-5e7241204036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6f29b38fdc440cd9067eae517ad0b17)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:09.463571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191bf4d-df19-45fa-a1ae-5e7241204036 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:09.514616 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a191bf4d-df19-45fa-a1ae-5e7241204036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6f29b38fdc440cd9067eae517ad0b17', 'request_id': 'req-a191bf4d-df19-45fa-a1ae-5e7241204036'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:09.524156 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a191bf4d-df19-45fa-a1ae-5e7241204036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6f29b38fdc440cd9067eae517ad0b17', 'request_id': 'req-a191bf4d-df19-45fa-a1ae-5e7241204036'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:09.530933 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a191bf4d-df19-45fa-a1ae-5e7241204036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6f29b38fdc440cd9067eae517ad0b17', 'request_id': 'req-a191bf4d-df19-45fa-a1ae-5e7241204036'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:09.541877 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a191bf4d-df19-45fa-a1ae-5e7241204036 admin admin] The token cache is being invalidate because project c6f29b38fdc440cd9067eae517ad0b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:18:09.542158 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a191bf4d-df19-45fa-a1ae-5e7241204036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:09.542795 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a191bf4d-df19-45fa-a1ae-5e7241204036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:09.544322 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1301/2594] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:18:09 2022] DELETE /identity/v3/projects/c6f29b38fdc440cd9067eae517ad0b17 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:09.548605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c4a3a-6e19-4ccc-8adf-37ea4dd6e25d service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:09.559606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c4a3a-6e19-4ccc-8adf-37ea4dd6e25d service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:09.619462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa59ab-c04b-4ba7-87e2-2a328cdc6a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:09.620351 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa59ab-c04b-4ba7-87e2-2a328cdc6a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:09.620637 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa59ab-c04b-4ba7-87e2-2a328cdc6a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:09.620959 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa59ab-c04b-4ba7-87e2-2a328cdc6a9f admin admin] PATH_INFO: `/v3/users/ea2c4bd9bcad465085e91f9d626e5a53` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:09.622161 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa59ab-c04b-4ba7-87e2-2a328cdc6a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2c4bd9bcad465085e91f9d626e5a53)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:09.624113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa59ab-c04b-4ba7-87e2-2a328cdc6a9f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:09.676916 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-10aa59ab-c04b-4ba7-87e2-2a328cdc6a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2c4bd9bcad465085e91f9d626e5a53'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:09.684943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-10aa59ab-c04b-4ba7-87e2-2a328cdc6a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2c4bd9bcad465085e91f9d626e5a53'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:09.699731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-10aa59ab-c04b-4ba7-87e2-2a328cdc6a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2c4bd9bcad465085e91f9d626e5a53'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:09.700514 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-10aa59ab-c04b-4ba7-87e2-2a328cdc6a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2c4bd9bcad465085e91f9d626e5a53'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:09.701124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-10aa59ab-c04b-4ba7-87e2-2a328cdc6a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2c4bd9bcad465085e91f9d626e5a53'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:09.726020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1294/2595] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:18:09 2022] DELETE /identity/v3/users/ea2c4bd9bcad465085e91f9d626e5a53 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:10.009009 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191bf4d-df19-45fa-a1ae-5e7241204036 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:10.010595 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a191bf4d-df19-45fa-a1ae-5e7241204036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:10.025603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191bf4d-df19-45fa-a1ae-5e7241204036 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:10.086443 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035485d-a266-444d-924a-7a8119b89771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:10.087304 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035485d-a266-444d-924a-7a8119b89771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:10.087580 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035485d-a266-444d-924a-7a8119b89771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:10.087855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035485d-a266-444d-924a-7a8119b89771 admin admin] PATH_INFO: `/v3/projects/c2083ef972a84e0889edcb3692e9e581` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:10.089057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035485d-a266-444d-924a-7a8119b89771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2083ef972a84e0889edcb3692e9e581)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:10.091209 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035485d-a266-444d-924a-7a8119b89771 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:10.138385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:10.139789 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8035485d-a266-444d-924a-7a8119b89771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2083ef972a84e0889edcb3692e9e581', 'request_id': 'req-8035485d-a266-444d-924a-7a8119b89771'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:10.148602 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8035485d-a266-444d-924a-7a8119b89771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2083ef972a84e0889edcb3692e9e581', 'request_id': 'req-8035485d-a266-444d-924a-7a8119b89771'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:10.155524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8035485d-a266-444d-924a-7a8119b89771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2083ef972a84e0889edcb3692e9e581', 'request_id': 'req-8035485d-a266-444d-924a-7a8119b89771'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:10.167306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8035485d-a266-444d-924a-7a8119b89771 admin admin] The token cache is being invalidate because project c2083ef972a84e0889edcb3692e9e581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:18:10.167591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8035485d-a266-444d-924a-7a8119b89771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:10.168303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-8035485d-a266-444d-924a-7a8119b89771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:10.169939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1302/2596] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:18:10 2022] DELETE /identity/v3/projects/c2083ef972a84e0889edcb3692e9e581 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:10.175085 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9a126-502d-4493-b993-fa3ce1976bce None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:10.175605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9a126-502d-4493-b993-fa3ce1976bce None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:10.175786 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9a126-502d-4493-b993-fa3ce1976bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:10.193351 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-8fd9a126-502d-4493-b993-fa3ce1976bce None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:10.194607 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8fd9a126-502d-4493-b993-fa3ce1976bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:10.215812 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:10.259372 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1295/2597] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:10.267703 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fded606-b589-4fe4-8ce9-bdf4912ecf82 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:10.267996 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fded606-b589-4fe4-8ce9-bdf4912ecf82 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:10.268813 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fded606-b589-4fe4-8ce9-bdf4912ecf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:10.290461 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9fded606-b589-4fe4-8ce9-bdf4912ecf82 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:10.291709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9fded606-b589-4fe4-8ce9-bdf4912ecf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:10.300084 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1303/2598] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:18:10.304569 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9a126-502d-4493-b993-fa3ce1976bce None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:10.314541 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9a126-502d-4493-b993-fa3ce1976bce None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:10.320659 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7232da-dbef-499a-af1c-7cbbf4ea9da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:10.321362 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7232da-dbef-499a-af1c-7cbbf4ea9da0 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:10.321646 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7232da-dbef-499a-af1c-7cbbf4ea9da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:10.321955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7232da-dbef-499a-af1c-7cbbf4ea9da0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:10.322724 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7232da-dbef-499a-af1c-7cbbf4ea9da0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:18:10.323034 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7232da-dbef-499a-af1c-7cbbf4ea9da0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:10.324682 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7232da-dbef-499a-af1c-7cbbf4ea9da0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:10.337591 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1296/2599] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:18:10.342190 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fded606-b589-4fe4-8ce9-bdf4912ecf82 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:10.352050 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fded606-b589-4fe4-8ce9-bdf4912ecf82 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:10.357002 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519541aa-6d0e-4bd8-9c4b-a713cbe4eba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:10.357679 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519541aa-6d0e-4bd8-9c4b-a713cbe4eba5 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:10.357965 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519541aa-6d0e-4bd8-9c4b-a713cbe4eba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:10.358242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519541aa-6d0e-4bd8-9c4b-a713cbe4eba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:10.358940 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519541aa-6d0e-4bd8-9c4b-a713cbe4eba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:10.360862 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519541aa-6d0e-4bd8-9c4b-a713cbe4eba5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:10.399268 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1304/2600] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:18:10 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:18:10.403564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7232da-dbef-499a-af1c-7cbbf4ea9da0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:10.416624 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7232da-dbef-499a-af1c-7cbbf4ea9da0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:10.482580 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa831a7f-88da-414f-b2a2-54c63befe467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:10.483040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa831a7f-88da-414f-b2a2-54c63befe467 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:10.483344 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa831a7f-88da-414f-b2a2-54c63befe467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:10.483559 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa831a7f-88da-414f-b2a2-54c63befe467 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:10.484264 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa831a7f-88da-414f-b2a2-54c63befe467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:10.486279 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa831a7f-88da-414f-b2a2-54c63befe467 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:10.513729 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1297/2601] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:18:10 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:18:10.518868 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519541aa-6d0e-4bd8-9c4b-a713cbe4eba5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:10.540306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519541aa-6d0e-4bd8-9c4b-a713cbe4eba5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:10.548397 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a4e55-f7f7-4e84-91bb-afbeb148ccb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:10.549564 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a4e55-f7f7-4e84-91bb-afbeb148ccb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:10.550199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a4e55-f7f7-4e84-91bb-afbeb148ccb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:10.550709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a4e55-f7f7-4e84-91bb-afbeb148ccb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:10.552122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a4e55-f7f7-4e84-91bb-afbeb148ccb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:10.555287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a4e55-f7f7-4e84-91bb-afbeb148ccb5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:10.573590 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1305/2602] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:18:10.580427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa831a7f-88da-414f-b2a2-54c63befe467 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:10.594557 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa831a7f-88da-414f-b2a2-54c63befe467 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:10.600264 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc4007-affd-499e-a1fa-64eea32d5c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:10.600950 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc4007-affd-499e-a1fa-64eea32d5c8b admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:10.601239 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc4007-affd-499e-a1fa-64eea32d5c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:10.601517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc4007-affd-499e-a1fa-64eea32d5c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:10.602305 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc4007-affd-499e-a1fa-64eea32d5c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:10.603945 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc4007-affd-499e-a1fa-64eea32d5c8b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:10.616651 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1298/2603] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:18:10.621536 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a4e55-f7f7-4e84-91bb-afbeb148ccb5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:10.632993 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a4e55-f7f7-4e84-91bb-afbeb148ccb5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:10.637818 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0bcc6-269c-4af3-b8d4-8bd9bf1c70a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:10.638713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0bcc6-269c-4af3-b8d4-8bd9bf1c70a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:10.638993 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0bcc6-269c-4af3-b8d4-8bd9bf1c70a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:10.639294 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0bcc6-269c-4af3-b8d4-8bd9bf1c70a3 admin admin] PATH_INFO: `/v3/projects/9065295decc64496b333a53443c63521/users/d5f49eb20968401081394a0088788d28/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:10.658634 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0bcc6-269c-4af3-b8d4-8bd9bf1c70a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9065295decc64496b333a53443c63521, user_id=d5f49eb20968401081394a0088788d28, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:10.662161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0bcc6-269c-4af3-b8d4-8bd9bf1c70a3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:10.676848 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1306/2604] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:18:10 2022] PUT /identity/v3/projects/9065295decc64496b333a53443c63521/users/d5f49eb20968401081394a0088788d28/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:10.689282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c5ac2-66c3-4f61-b2f5-c35182dac7e9 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:10.689584 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c5ac2-66c3-4f61-b2f5-c35182dac7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:10.689913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c5ac2-66c3-4f61-b2f5-c35182dac7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:10.722610 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-822c5ac2-66c3-4f61-b2f5-c35182dac7e9 None None] MFA Rules not processed for user `d5f49eb20968401081394a0088788d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:10.723624 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-822c5ac2-66c3-4f61-b2f5-c35182dac7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:10.804609 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1299/2605] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:10.809142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0bcc6-269c-4af3-b8d4-8bd9bf1c70a3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:10.876968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0bcc6-269c-4af3-b8d4-8bd9bf1c70a3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:10.882810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7904c60-0f56-4387-ab06-0b944fad5598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:10.883471 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7904c60-0f56-4387-ab06-0b944fad5598 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:10.883815 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7904c60-0f56-4387-ab06-0b944fad5598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:10.884093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7904c60-0f56-4387-ab06-0b944fad5598 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:10.884787 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7904c60-0f56-4387-ab06-0b944fad5598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:10.886738 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7904c60-0f56-4387-ab06-0b944fad5598 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:10.913805 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1307/2606] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:18:10 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:18:10.918164 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c5ac2-66c3-4f61-b2f5-c35182dac7e9 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:10.930647 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c5ac2-66c3-4f61-b2f5-c35182dac7e9 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:10.948732 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:10.992002 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef6195-d1bb-47cd-a9ae-cb279aff725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:10.992693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef6195-d1bb-47cd-a9ae-cb279aff725e admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:10.992991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef6195-d1bb-47cd-a9ae-cb279aff725e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:10.993271 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef6195-d1bb-47cd-a9ae-cb279aff725e admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:10.994078 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef6195-d1bb-47cd-a9ae-cb279aff725e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:10.996040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef6195-d1bb-47cd-a9ae-cb279aff725e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:11.019065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1300/2607] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:18:10 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:18:11.023133 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7904c60-0f56-4387-ab06-0b944fad5598 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:11.034301 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7904c60-0f56-4387-ab06-0b944fad5598 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:11.039385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416316d5-44f4-4e4f-8bf8-d03cbb34d680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:11.040070 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416316d5-44f4-4e4f-8bf8-d03cbb34d680 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:11.040352 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416316d5-44f4-4e4f-8bf8-d03cbb34d680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:11.040628 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416316d5-44f4-4e4f-8bf8-d03cbb34d680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:11.041476 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416316d5-44f4-4e4f-8bf8-d03cbb34d680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:11.043177 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416316d5-44f4-4e4f-8bf8-d03cbb34d680 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:11.056647 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1308/2608] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:18:11.060462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef6195-d1bb-47cd-a9ae-cb279aff725e admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:11.073683 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef6195-d1bb-47cd-a9ae-cb279aff725e admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:11.078928 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11d886-0e50-40bc-8224-954cc96fafe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:11.079826 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11d886-0e50-40bc-8224-954cc96fafe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:11.080108 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11d886-0e50-40bc-8224-954cc96fafe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:11.080385 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11d886-0e50-40bc-8224-954cc96fafe2 admin admin] PATH_INFO: `/v3/projects/fa8709f22a44462fb7c9836568486bfa/users/42eed1b219c64f3aa57cedfaf2ed454d/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:11.098646 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11d886-0e50-40bc-8224-954cc96fafe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8709f22a44462fb7c9836568486bfa, user_id=42eed1b219c64f3aa57cedfaf2ed454d, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:11.101115 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11d886-0e50-40bc-8224-954cc96fafe2 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:11.115633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1301/2609] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:18:11 2022] PUT /identity/v3/projects/fa8709f22a44462fb7c9836568486bfa/users/42eed1b219c64f3aa57cedfaf2ed454d/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:11.119844 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416316d5-44f4-4e4f-8bf8-d03cbb34d680 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:11.130982 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416316d5-44f4-4e4f-8bf8-d03cbb34d680 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:11.177066 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:11.191917 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964cd06-e308-40f5-9fb3-60aba085e03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:11.192603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964cd06-e308-40f5-9fb3-60aba085e03a admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:11.192886 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964cd06-e308-40f5-9fb3-60aba085e03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:11.193195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964cd06-e308-40f5-9fb3-60aba085e03a admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:11.194001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964cd06-e308-40f5-9fb3-60aba085e03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:11.195637 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964cd06-e308-40f5-9fb3-60aba085e03a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:11.206694 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1309/2610] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:18:11.210617 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11d886-0e50-40bc-8224-954cc96fafe2 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:11.222120 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11d886-0e50-40bc-8224-954cc96fafe2 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:11.227047 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835657b8-ad1c-43d3-9ac1-2092edc4f878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:11.227945 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835657b8-ad1c-43d3-9ac1-2092edc4f878 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:11.228229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835657b8-ad1c-43d3-9ac1-2092edc4f878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:11.228507 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835657b8-ad1c-43d3-9ac1-2092edc4f878 admin admin] PATH_INFO: `/v3/projects/fa8709f22a44462fb7c9836568486bfa/users/42eed1b219c64f3aa57cedfaf2ed454d/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:11.230512 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835657b8-ad1c-43d3-9ac1-2092edc4f878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8709f22a44462fb7c9836568486bfa, user_id=42eed1b219c64f3aa57cedfaf2ed454d, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:11.233223 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835657b8-ad1c-43d3-9ac1-2092edc4f878 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:11.244831 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1302/2611] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:18:11 2022] PUT /identity/v3/projects/fa8709f22a44462fb7c9836568486bfa/users/42eed1b219c64f3aa57cedfaf2ed454d/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:11.255533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959e2e8-d9f4-4939-b839-d07abe54b0be None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:11.255882 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959e2e8-d9f4-4939-b839-d07abe54b0be None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:11.256167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959e2e8-d9f4-4939-b839-d07abe54b0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:11.283371 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0959e2e8-d9f4-4939-b839-d07abe54b0be None None] MFA Rules not processed for user `42eed1b219c64f3aa57cedfaf2ed454d`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:11.285578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0959e2e8-d9f4-4939-b839-d07abe54b0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:11.358310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1310/2612] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:11.370498 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835657b8-ad1c-43d3-9ac1-2092edc4f878 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:11.372207 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-835657b8-ad1c-43d3-9ac1-2092edc4f878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:11.431210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835657b8-ad1c-43d3-9ac1-2092edc4f878 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:11.434970 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff6e9d-cd59-44ca-9749-d2e05ec96f63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:11.435623 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff6e9d-cd59-44ca-9749-d2e05ec96f63 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:11.435905 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff6e9d-cd59-44ca-9749-d2e05ec96f63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:11.436183 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff6e9d-cd59-44ca-9749-d2e05ec96f63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:11.496181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff6e9d-cd59-44ca-9749-d2e05ec96f63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:11.497545 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff6e9d-cd59-44ca-9749-d2e05ec96f63 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:11.506775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1303/2613] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:18:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:18:20.271996 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959e2e8-d9f4-4939-b839-d07abe54b0be None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:20.273425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0959e2e8-d9f4-4939-b839-d07abe54b0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:20.306474 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959e2e8-d9f4-4939-b839-d07abe54b0be None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:20.314274 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d172c8d-5310-446d-ac32-d6665b6fabbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:20.315420 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d172c8d-5310-446d-ac32-d6665b6fabbf service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:20.315705 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d172c8d-5310-446d-ac32-d6665b6fabbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:20.315979 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d172c8d-5310-446d-ac32-d6665b6fabbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:20.327017 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d172c8d-5310-446d-ac32-d6665b6fabbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:20.328477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d172c8d-5310-446d-ac32-d6665b6fabbf service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:20.339015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1311/2614] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:18:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:18:21.503252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=83,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:30.334701 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=57 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:54.431603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff6e9d-cd59-44ca-9749-d2e05ec96f63 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:54.493400 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff6e9d-cd59-44ca-9749-d2e05ec96f63 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:54.497957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eeb979-b253-4fd9-9562-4380a06680bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:54.498825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eeb979-b253-4fd9-9562-4380a06680bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:54.499104 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eeb979-b253-4fd9-9562-4380a06680bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:54.499376 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eeb979-b253-4fd9-9562-4380a06680bf admin admin] PATH_INFO: `/v3/users/d5f49eb20968401081394a0088788d28` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:54.500555 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eeb979-b253-4fd9-9562-4380a06680bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5f49eb20968401081394a0088788d28)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:54.503206 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eeb979-b253-4fd9-9562-4380a06680bf admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:54.548130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f6eeb979-b253-4fd9-9562-4380a06680bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5f49eb20968401081394a0088788d28'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:54.555896 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f6eeb979-b253-4fd9-9562-4380a06680bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5f49eb20968401081394a0088788d28'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:54.568197 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f6eeb979-b253-4fd9-9562-4380a06680bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5f49eb20968401081394a0088788d28'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:54.568884 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f6eeb979-b253-4fd9-9562-4380a06680bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5f49eb20968401081394a0088788d28'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:54.569522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f6eeb979-b253-4fd9-9562-4380a06680bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5f49eb20968401081394a0088788d28'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:54.583123 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1304/2615] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:18:54 2022] DELETE /identity/v3/users/d5f49eb20968401081394a0088788d28 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:54.587779 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efcb26-e900-4881-8efe-d84745a8ba01 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:54.588280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efcb26-e900-4881-8efe-d84745a8ba01 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:54.588378 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efcb26-e900-4881-8efe-d84745a8ba01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:54.606654 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-26efcb26-e900-4881-8efe-d84745a8ba01 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:54.607874 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-26efcb26-e900-4881-8efe-d84745a8ba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:54.649423 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eeb979-b253-4fd9-9562-4380a06680bf admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:54.650904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f6eeb979-b253-4fd9-9562-4380a06680bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:54.668802 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1312/2616] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:54.681229 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efcb26-e900-4881-8efe-d84745a8ba01 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:54.682663 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-26efcb26-e900-4881-8efe-d84745a8ba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:54.722925 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eeb979-b253-4fd9-9562-4380a06680bf admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:54.729983 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfea95d-c2f3-4a4c-923b-11d650c536a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:54.730855 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfea95d-c2f3-4a4c-923b-11d650c536a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:54.731138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfea95d-c2f3-4a4c-923b-11d650c536a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:54.731423 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfea95d-c2f3-4a4c-923b-11d650c536a2 admin admin] PATH_INFO: `/v3/users/4badd64f91da443fb11226e70aa8480d` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:54.732690 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfea95d-c2f3-4a4c-923b-11d650c536a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4badd64f91da443fb11226e70aa8480d)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:54.734648 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfea95d-c2f3-4a4c-923b-11d650c536a2 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:54.745982 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efcb26-e900-4881-8efe-d84745a8ba01 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:54.749642 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbecb15-af23-458e-97d6-4d4c68233cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:54.750318 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbecb15-af23-458e-97d6-4d4c68233cbf service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:54.750598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbecb15-af23-458e-97d6-4d4c68233cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:54.750876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbecb15-af23-458e-97d6-4d4c68233cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:54.757588 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:54.762163 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbecb15-af23-458e-97d6-4d4c68233cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:54.763814 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbecb15-af23-458e-97d6-4d4c68233cbf service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:54.775370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1313/2617] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:18:54.787105 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1bfea95d-c2f3-4a4c-923b-11d650c536a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4badd64f91da443fb11226e70aa8480d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:54.794100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1bfea95d-c2f3-4a4c-923b-11d650c536a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4badd64f91da443fb11226e70aa8480d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:54.806601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1bfea95d-c2f3-4a4c-923b-11d650c536a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4badd64f91da443fb11226e70aa8480d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:54.807328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1bfea95d-c2f3-4a4c-923b-11d650c536a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4badd64f91da443fb11226e70aa8480d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:54.807941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1bfea95d-c2f3-4a4c-923b-11d650c536a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4badd64f91da443fb11226e70aa8480d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:54.823411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1305/2618] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:18:54 2022] DELETE /identity/v3/users/4badd64f91da443fb11226e70aa8480d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:18:54.828254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b5958-96bc-499a-a840-e28ce84449ba None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:54.828570 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b5958-96bc-499a-a840-e28ce84449ba None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:54.828878 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b5958-96bc-499a-a840-e28ce84449ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:54.848381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-841b5958-96bc-499a-a840-e28ce84449ba None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:54.849606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-841b5958-96bc-499a-a840-e28ce84449ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:54.920819 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1314/2619] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:54.931597 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfea95d-c2f3-4a4c-923b-11d650c536a2 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:54.933141 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1bfea95d-c2f3-4a4c-923b-11d650c536a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:54.999307 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfea95d-c2f3-4a4c-923b-11d650c536a2 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:55.003828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaeb49-333d-461c-a4c4-d5a4bfb2181b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:55.004493 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaeb49-333d-461c-a4c4-d5a4bfb2181b service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:55.004782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaeb49-333d-461c-a4c4-d5a4bfb2181b service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:55.005061 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaeb49-333d-461c-a4c4-d5a4bfb2181b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:55.014858 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdaeb49-333d-461c-a4c4-d5a4bfb2181b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:55.016343 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdaeb49-333d-461c-a4c4-d5a4bfb2181b service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:55.027892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1306/2620] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:18:55.076465 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b5958-96bc-499a-a840-e28ce84449ba None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:55.078237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-841b5958-96bc-499a-a840-e28ce84449ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:55.106035 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b5958-96bc-499a-a840-e28ce84449ba None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:55.112098 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bbd1c-933e-4e9c-aaf1-6b5dfd72ba71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:55.113279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bbd1c-933e-4e9c-aaf1-6b5dfd72ba71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:55.113571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bbd1c-933e-4e9c-aaf1-6b5dfd72ba71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:55.113952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bbd1c-933e-4e9c-aaf1-6b5dfd72ba71 admin admin] PATH_INFO: `/v3/projects/9065295decc64496b333a53443c63521` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:55.115199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2bbd1c-933e-4e9c-aaf1-6b5dfd72ba71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9065295decc64496b333a53443c63521)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:55.117157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2bbd1c-933e-4e9c-aaf1-6b5dfd72ba71 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:55.163419 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:55.174604 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3b2bbd1c-933e-4e9c-aaf1-6b5dfd72ba71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9065295decc64496b333a53443c63521', 'request_id': 'req-3b2bbd1c-933e-4e9c-aaf1-6b5dfd72ba71'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.183597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3b2bbd1c-933e-4e9c-aaf1-6b5dfd72ba71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9065295decc64496b333a53443c63521', 'request_id': 'req-3b2bbd1c-933e-4e9c-aaf1-6b5dfd72ba71'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.191510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3b2bbd1c-933e-4e9c-aaf1-6b5dfd72ba71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9065295decc64496b333a53443c63521', 'request_id': 'req-3b2bbd1c-933e-4e9c-aaf1-6b5dfd72ba71'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.203860 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3b2bbd1c-933e-4e9c-aaf1-6b5dfd72ba71 admin admin] The token cache is being invalidate because project 9065295decc64496b333a53443c63521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:18:55.204207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3b2bbd1c-933e-4e9c-aaf1-6b5dfd72ba71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.204985 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-3b2bbd1c-933e-4e9c-aaf1-6b5dfd72ba71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.207867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1315/2621] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:18:55 2022] DELETE /identity/v3/projects/9065295decc64496b333a53443c63521 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:55.211965 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaeb49-333d-461c-a4c4-d5a4bfb2181b service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:55.223311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaeb49-333d-461c-a4c4-d5a4bfb2181b service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:55.283155 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a67c1-0312-47d0-af86-dd7eddc5e0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:55.284571 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a67c1-0312-47d0-af86-dd7eddc5e0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:55.284948 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a67c1-0312-47d0-af86-dd7eddc5e0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:55.285226 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a67c1-0312-47d0-af86-dd7eddc5e0cd admin admin] PATH_INFO: `/v3/users/42eed1b219c64f3aa57cedfaf2ed454d` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:55.286502 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a67c1-0312-47d0-af86-dd7eddc5e0cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=42eed1b219c64f3aa57cedfaf2ed454d)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:55.288475 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a67c1-0312-47d0-af86-dd7eddc5e0cd admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:55.327071 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bbd1c-933e-4e9c-aaf1-6b5dfd72ba71 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:55.328841 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3b2bbd1c-933e-4e9c-aaf1-6b5dfd72ba71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:55.345472 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bbd1c-933e-4e9c-aaf1-6b5dfd72ba71 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:55.348860 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:55.351365 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37acfa-9fe0-4575-949c-9965a5286f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:55.351516 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5c9a67c1-0312-47d0-af86-dd7eddc5e0cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42eed1b219c64f3aa57cedfaf2ed454d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.353196 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37acfa-9fe0-4575-949c-9965a5286f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:55.353486 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37acfa-9fe0-4575-949c-9965a5286f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:55.353916 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37acfa-9fe0-4575-949c-9965a5286f5a admin admin] PATH_INFO: `/v3/projects/918e18a0bf9344429a2f5e58ac9934fc` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:55.355022 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37acfa-9fe0-4575-949c-9965a5286f5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=918e18a0bf9344429a2f5e58ac9934fc)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:55.357293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37acfa-9fe0-4575-949c-9965a5286f5a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:55.361470 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5c9a67c1-0312-47d0-af86-dd7eddc5e0cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42eed1b219c64f3aa57cedfaf2ed454d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.374029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5c9a67c1-0312-47d0-af86-dd7eddc5e0cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42eed1b219c64f3aa57cedfaf2ed454d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.374770 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5c9a67c1-0312-47d0-af86-dd7eddc5e0cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42eed1b219c64f3aa57cedfaf2ed454d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.375378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-5c9a67c1-0312-47d0-af86-dd7eddc5e0cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42eed1b219c64f3aa57cedfaf2ed454d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.390790 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1307/2622] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:18:55 2022] DELETE /identity/v3/users/42eed1b219c64f3aa57cedfaf2ed454d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:55.410806 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-dc37acfa-9fe0-4575-949c-9965a5286f5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918e18a0bf9344429a2f5e58ac9934fc', 'request_id': 'req-dc37acfa-9fe0-4575-949c-9965a5286f5a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.421588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-dc37acfa-9fe0-4575-949c-9965a5286f5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918e18a0bf9344429a2f5e58ac9934fc', 'request_id': 'req-dc37acfa-9fe0-4575-949c-9965a5286f5a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.430308 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-dc37acfa-9fe0-4575-949c-9965a5286f5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918e18a0bf9344429a2f5e58ac9934fc', 'request_id': 'req-dc37acfa-9fe0-4575-949c-9965a5286f5a'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.443799 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-dc37acfa-9fe0-4575-949c-9965a5286f5a admin admin] The token cache is being invalidate because project 918e18a0bf9344429a2f5e58ac9934fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:18:55.444062 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-dc37acfa-9fe0-4575-949c-9965a5286f5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.444830 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-dc37acfa-9fe0-4575-949c-9965a5286f5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.446488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1316/2623] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:18:55 2022] DELETE /identity/v3/projects/918e18a0bf9344429a2f5e58ac9934fc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:18:55.451693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bebfb-4bd4-4442-8c01-2ac6a328c89b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:55.452160 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bebfb-4bd4-4442-8c01-2ac6a328c89b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:55.452643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bebfb-4bd4-4442-8c01-2ac6a328c89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:55.475654 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-320bebfb-4bd4-4442-8c01-2ac6a328c89b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:55.477045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-320bebfb-4bd4-4442-8c01-2ac6a328c89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:55.545304 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1308/2624] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:55.553403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf90c2-4adf-4525-a812-b66252b4a565 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:55.553726 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf90c2-4adf-4525-a812-b66252b4a565 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:55.554013 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf90c2-4adf-4525-a812-b66252b4a565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:55.574404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7bbf90c2-4adf-4525-a812-b66252b4a565 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:55.575762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7bbf90c2-4adf-4525-a812-b66252b4a565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:55.585038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1317/2625] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:55.589386 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bebfb-4bd4-4442-8c01-2ac6a328c89b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:55.600145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bebfb-4bd4-4442-8c01-2ac6a328c89b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:55.604855 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1a94d-4df9-42fa-b449-a55fdead399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:55.605523 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1a94d-4df9-42fa-b449-a55fdead399c admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:55.605846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1a94d-4df9-42fa-b449-a55fdead399c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:55.606125 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1a94d-4df9-42fa-b449-a55fdead399c admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:55.606859 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1a94d-4df9-42fa-b449-a55fdead399c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:18:55.607166 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1a94d-4df9-42fa-b449-a55fdead399c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:55.608814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1a94d-4df9-42fa-b449-a55fdead399c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:55.621994 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1309/2626] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:18:55.626244 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf90c2-4adf-4525-a812-b66252b4a565 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:55.636125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf90c2-4adf-4525-a812-b66252b4a565 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:55.640892 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84529dbf-8024-426b-b3ed-834eb9a3faf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:55.641561 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84529dbf-8024-426b-b3ed-834eb9a3faf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:55.641858 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84529dbf-8024-426b-b3ed-834eb9a3faf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:55.642138 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84529dbf-8024-426b-b3ed-834eb9a3faf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:55.643392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84529dbf-8024-426b-b3ed-834eb9a3faf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:55.645394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84529dbf-8024-426b-b3ed-834eb9a3faf4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:55.675391 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1318/2627] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:18:55 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:18:55.676121 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1a94d-4df9-42fa-b449-a55fdead399c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:55.676431 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84529dbf-8024-426b-b3ed-834eb9a3faf4 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:55.677968 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bce1a94d-4df9-42fa-b449-a55fdead399c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:55.692758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1a94d-4df9-42fa-b449-a55fdead399c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:55.751776 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84529dbf-8024-426b-b3ed-834eb9a3faf4 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:55.754237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1342ea1-23e6-4f40-a3a1-76cfc4bafe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:55.755248 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1342ea1-23e6-4f40-a3a1-76cfc4bafe77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:55.755606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1342ea1-23e6-4f40-a3a1-76cfc4bafe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:55.755883 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1342ea1-23e6-4f40-a3a1-76cfc4bafe77 admin admin] PATH_INFO: `/v3/projects/fa8709f22a44462fb7c9836568486bfa` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:55.757045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1342ea1-23e6-4f40-a3a1-76cfc4bafe77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa8709f22a44462fb7c9836568486bfa)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:55.757528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666f9d3-9a14-42e2-9296-5e9e3d04130e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:55.758252 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666f9d3-9a14-42e2-9296-5e9e3d04130e admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:55.758559 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666f9d3-9a14-42e2-9296-5e9e3d04130e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:55.758819 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666f9d3-9a14-42e2-9296-5e9e3d04130e admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:55.758967 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1342ea1-23e6-4f40-a3a1-76cfc4bafe77 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:55.759512 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666f9d3-9a14-42e2-9296-5e9e3d04130e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:55.761424 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666f9d3-9a14-42e2-9296-5e9e3d04130e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:55.783538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1319/2628] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:18:55 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:18:55.787903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666f9d3-9a14-42e2-9296-5e9e3d04130e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:55.798456 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666f9d3-9a14-42e2-9296-5e9e3d04130e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:55.807770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=83,keystone:DELETE=11,keystone:INSERT=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:55.812447 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e1342ea1-23e6-4f40-a3a1-76cfc4bafe77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa8709f22a44462fb7c9836568486bfa', 'request_id': 'req-e1342ea1-23e6-4f40-a3a1-76cfc4bafe77'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.814133 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:55.821215 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e1342ea1-23e6-4f40-a3a1-76cfc4bafe77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa8709f22a44462fb7c9836568486bfa', 'request_id': 'req-e1342ea1-23e6-4f40-a3a1-76cfc4bafe77'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.828807 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e1342ea1-23e6-4f40-a3a1-76cfc4bafe77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa8709f22a44462fb7c9836568486bfa', 'request_id': 'req-e1342ea1-23e6-4f40-a3a1-76cfc4bafe77'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.842266 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e1342ea1-23e6-4f40-a3a1-76cfc4bafe77 admin admin] The token cache is being invalidate because project fa8709f22a44462fb7c9836568486bfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:18:55.842557 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e1342ea1-23e6-4f40-a3a1-76cfc4bafe77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.843461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-e1342ea1-23e6-4f40-a3a1-76cfc4bafe77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:55.845074 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1310/2629] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:18:55 2022] DELETE /identity/v3/projects/fa8709f22a44462fb7c9836568486bfa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:55.849966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae74c9-b8b0-4728-a7fb-0fe1334e0073 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:55.850262 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae74c9-b8b0-4728-a7fb-0fe1334e0073 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:55.850548 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae74c9-b8b0-4728-a7fb-0fe1334e0073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:55.862780 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e79a3-83c8-40ea-bf23-696d45f3f552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:55.863453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e79a3-83c8-40ea-bf23-696d45f3f552 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:55.863758 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e79a3-83c8-40ea-bf23-696d45f3f552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:55.864018 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e79a3-83c8-40ea-bf23-696d45f3f552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:55.864749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e79a3-83c8-40ea-bf23-696d45f3f552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:55.866408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e79a3-83c8-40ea-bf23-696d45f3f552 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:55.869281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-d3ae74c9-b8b0-4728-a7fb-0fe1334e0073 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:55.870962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d3ae74c9-b8b0-4728-a7fb-0fe1334e0073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:55.881910 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1320/2630] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:18:55.882096 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1311/2631] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:18:55.883091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e79a3-83c8-40ea-bf23-696d45f3f552 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:55.884849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7c9e79a3-83c8-40ea-bf23-696d45f3f552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:55.890126 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bb92f-203a-4316-88d9-8103c482a64a None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:55.890417 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bb92f-203a-4316-88d9-8103c482a64a None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:55.890705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bb92f-203a-4316-88d9-8103c482a64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:55.897596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e79a3-83c8-40ea-bf23-696d45f3f552 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:55.902355 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599723d-eed0-47f3-b55c-27273c1088d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:55.903014 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599723d-eed0-47f3-b55c-27273c1088d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:55.903302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599723d-eed0-47f3-b55c-27273c1088d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:55.903577 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599723d-eed0-47f3-b55c-27273c1088d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:55.904565 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599723d-eed0-47f3-b55c-27273c1088d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:55.906241 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599723d-eed0-47f3-b55c-27273c1088d7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:55.912014 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4d8bb92f-203a-4316-88d9-8103c482a64a None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:55.913327 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4d8bb92f-203a-4316-88d9-8103c482a64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:55.916597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1321/2632] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:18:55.920792 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599723d-eed0-47f3-b55c-27273c1088d7 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:55.921616 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1312/2633] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:18:55.926019 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bb92f-203a-4316-88d9-8103c482a64a None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:55.932036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599723d-eed0-47f3-b55c-27273c1088d7 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:55.935288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bb92f-203a-4316-88d9-8103c482a64a None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:55.936782 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714e95c-9d07-463b-935b-1bcbc0ea01c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:55.937670 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714e95c-9d07-463b-935b-1bcbc0ea01c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:55.937968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714e95c-9d07-463b-935b-1bcbc0ea01c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:55.938246 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714e95c-9d07-463b-935b-1bcbc0ea01c7 admin admin] PATH_INFO: `/v3/projects/f8faf0d708934020a699b82062b6c1df/users/1e53dc03ea104166a0792e166f0cb6da/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:55.940630 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8801b-f8a3-4a75-84e7-d03a2ffd89f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:55.941279 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8801b-f8a3-4a75-84e7-d03a2ffd89f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:55.941563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8801b-f8a3-4a75-84e7-d03a2ffd89f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:55.941874 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8801b-f8a3-4a75-84e7-d03a2ffd89f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:55.942606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8801b-f8a3-4a75-84e7-d03a2ffd89f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:18:55.943581 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8801b-f8a3-4a75-84e7-d03a2ffd89f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:55.945195 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8801b-f8a3-4a75-84e7-d03a2ffd89f9 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:55.954180 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714e95c-9d07-463b-935b-1bcbc0ea01c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8faf0d708934020a699b82062b6c1df, user_id=1e53dc03ea104166a0792e166f0cb6da, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:55.956904 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714e95c-9d07-463b-935b-1bcbc0ea01c7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:55.957469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1313/2634] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 17:18:55.961925 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8801b-f8a3-4a75-84e7-d03a2ffd89f9 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:55.974382 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1322/2635] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:18:55 2022] PUT /identity/v3/projects/f8faf0d708934020a699b82062b6c1df/users/1e53dc03ea104166a0792e166f0cb6da/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:18:55.975554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8801b-f8a3-4a75-84e7-d03a2ffd89f9 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:55.984805 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d4642-e6a0-4c02-8155-a300619301c8 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:55.985094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d4642-e6a0-4c02-8155-a300619301c8 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:55.985374 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d4642-e6a0-4c02-8155-a300619301c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:56.013997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a04d4642-e6a0-4c02-8155-a300619301c8 None None] MFA Rules not processed for user `1e53dc03ea104166a0792e166f0cb6da`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:56.015419 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a04d4642-e6a0-4c02-8155-a300619301c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:56.043501 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93013e4f-2df8-4a66-95b6-50352dd84dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:56.044175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93013e4f-2df8-4a66-95b6-50352dd84dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:56.044455 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93013e4f-2df8-4a66-95b6-50352dd84dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:56.044732 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93013e4f-2df8-4a66-95b6-50352dd84dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:56.045433 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93013e4f-2df8-4a66-95b6-50352dd84dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:56.047420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93013e4f-2df8-4a66-95b6-50352dd84dfb admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:56.078765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1314/2636] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:18:55 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:18:56.082850 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93013e4f-2df8-4a66-95b6-50352dd84dfb admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:56.088596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1323/2637] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:18:56.099752 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d4642-e6a0-4c02-8155-a300619301c8 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:56.101223 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a04d4642-e6a0-4c02-8155-a300619301c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:56.149391 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93013e4f-2df8-4a66-95b6-50352dd84dfb admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:56.154117 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167870a4-6f2a-4921-8042-a60db0c1d777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:56.154793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167870a4-6f2a-4921-8042-a60db0c1d777 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:56.155108 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167870a4-6f2a-4921-8042-a60db0c1d777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:56.155391 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167870a4-6f2a-4921-8042-a60db0c1d777 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:56.156081 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167870a4-6f2a-4921-8042-a60db0c1d777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:56.158064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167870a4-6f2a-4921-8042-a60db0c1d777 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:56.160369 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d4642-e6a0-4c02-8155-a300619301c8 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:56.175329 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:56.180130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1315/2638] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:18:56 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:18:56.184136 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167870a4-6f2a-4921-8042-a60db0c1d777 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:56.195182 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167870a4-6f2a-4921-8042-a60db0c1d777 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:56.199763 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a296f17-aa2c-4d31-b90d-adaaba9aaf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:56.200419 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a296f17-aa2c-4d31-b90d-adaaba9aaf47 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:56.200707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a296f17-aa2c-4d31-b90d-adaaba9aaf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:56.200989 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a296f17-aa2c-4d31-b90d-adaaba9aaf47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:56.201769 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a296f17-aa2c-4d31-b90d-adaaba9aaf47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:56.203377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a296f17-aa2c-4d31-b90d-adaaba9aaf47 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:56.213977 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1316/2639] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:18:56.215302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610a3d4-b007-450a-97df-f1a71e408fa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:56.216055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610a3d4-b007-450a-97df-f1a71e408fa8 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:56.216445 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610a3d4-b007-450a-97df-f1a71e408fa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:56.217102 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610a3d4-b007-450a-97df-f1a71e408fa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:56.217771 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a296f17-aa2c-4d31-b90d-adaaba9aaf47 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:56.228660 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a296f17-aa2c-4d31-b90d-adaaba9aaf47 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:56.233671 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d53edd-d8f7-4ff7-a0b2-287bdf78bcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:56.234340 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d53edd-d8f7-4ff7-a0b2-287bdf78bcb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:56.234626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d53edd-d8f7-4ff7-a0b2-287bdf78bcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:56.234901 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d53edd-d8f7-4ff7-a0b2-287bdf78bcb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:56.235641 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d53edd-d8f7-4ff7-a0b2-287bdf78bcb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:56.237831 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d53edd-d8f7-4ff7-a0b2-287bdf78bcb0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:56.248945 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1317/2640] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:18:56.253407 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d53edd-d8f7-4ff7-a0b2-287bdf78bcb0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:56.259480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:56.263438 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d53edd-d8f7-4ff7-a0b2-287bdf78bcb0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:56.270340 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e0de7-172d-4374-8b18-48513655ff7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:56.271288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e0de7-172d-4374-8b18-48513655ff7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:56.271643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e0de7-172d-4374-8b18-48513655ff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:56.272225 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e0de7-172d-4374-8b18-48513655ff7a admin admin] PATH_INFO: `/v3/projects/d741bac6869b43d98d54ba5d2b09e548/users/f2fe66df75b147bf87b6025e13740234/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:56.281876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610a3d4-b007-450a-97df-f1a71e408fa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:56.283924 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610a3d4-b007-450a-97df-f1a71e408fa8 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:56.288440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e0de7-172d-4374-8b18-48513655ff7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d741bac6869b43d98d54ba5d2b09e548, user_id=f2fe66df75b147bf87b6025e13740234, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:56.291187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e0de7-172d-4374-8b18-48513655ff7a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:56.293385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1324/2641] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:18:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:18:56.305640 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1318/2642] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:18:56 2022] PUT /identity/v3/projects/d741bac6869b43d98d54ba5d2b09e548/users/f2fe66df75b147bf87b6025e13740234/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:18:56.316173 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dbea6-7bfd-4103-b982-d86803988c5c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:56.316463 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dbea6-7bfd-4103-b982-d86803988c5c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:56.316743 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dbea6-7bfd-4103-b982-d86803988c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:56.346260 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0b9dbea6-7bfd-4103-b982-d86803988c5c None None] MFA Rules not processed for user `f2fe66df75b147bf87b6025e13740234`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:56.347513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0b9dbea6-7bfd-4103-b982-d86803988c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:56.412547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1325/2643] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:18:56.417165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e0de7-172d-4374-8b18-48513655ff7a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:56.482324 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e0de7-172d-4374-8b18-48513655ff7a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:56.487852 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a7923-1df1-401d-9892-639a5e9d3065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:56.488554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a7923-1df1-401d-9892-639a5e9d3065 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:56.488850 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a7923-1df1-401d-9892-639a5e9d3065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:56.489125 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a7923-1df1-401d-9892-639a5e9d3065 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:56.489853 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a7923-1df1-401d-9892-639a5e9d3065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:56.491772 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a7923-1df1-401d-9892-639a5e9d3065 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:56.521021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1319/2644] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:18:56 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:18:56.525208 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dbea6-7bfd-4103-b982-d86803988c5c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:56.542175 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dbea6-7bfd-4103-b982-d86803988c5c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:56.606942 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab2887-ad70-4b14-9705-a7c48c28bf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:56.607900 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab2887-ad70-4b14-9705-a7c48c28bf49 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:56.608835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab2887-ad70-4b14-9705-a7c48c28bf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:56.609357 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab2887-ad70-4b14-9705-a7c48c28bf49 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:56.610178 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab2887-ad70-4b14-9705-a7c48c28bf49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:56.612929 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab2887-ad70-4b14-9705-a7c48c28bf49 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:56.630099 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:56.650757 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1326/2645] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:18:56 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:18:56.654598 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a7923-1df1-401d-9892-639a5e9d3065 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:56.671856 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a7923-1df1-401d-9892-639a5e9d3065 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:56.677010 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44acd1-6a82-4110-b7b9-a7a86018e7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:56.677579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44acd1-6a82-4110-b7b9-a7a86018e7ec admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:56.677896 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44acd1-6a82-4110-b7b9-a7a86018e7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:56.678177 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44acd1-6a82-4110-b7b9-a7a86018e7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:56.679418 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44acd1-6a82-4110-b7b9-a7a86018e7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:56.681086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44acd1-6a82-4110-b7b9-a7a86018e7ec admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:56.700770 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1320/2646] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:18:56.704922 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab2887-ad70-4b14-9705-a7c48c28bf49 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:56.717688 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab2887-ad70-4b14-9705-a7c48c28bf49 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:56.725934 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fc07a-c28e-4d7a-8d6e-19bbeea6ad19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:56.726907 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fc07a-c28e-4d7a-8d6e-19bbeea6ad19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:56.727195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fc07a-c28e-4d7a-8d6e-19bbeea6ad19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:56.727722 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fc07a-c28e-4d7a-8d6e-19bbeea6ad19 admin admin] PATH_INFO: `/v3/projects/56bf4ae6eb244c8e845a744848792ad2/users/2a3c6525c80b4545afa84a4325ce4c29/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:56.747045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fc07a-c28e-4d7a-8d6e-19bbeea6ad19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56bf4ae6eb244c8e845a744848792ad2, user_id=2a3c6525c80b4545afa84a4325ce4c29, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:56.749965 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fc07a-c28e-4d7a-8d6e-19bbeea6ad19 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:56.768482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1327/2647] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:18:56 2022] PUT /identity/v3/projects/56bf4ae6eb244c8e845a744848792ad2/users/2a3c6525c80b4545afa84a4325ce4c29/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:56.773335 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44acd1-6a82-4110-b7b9-a7a86018e7ec admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:56.785808 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44acd1-6a82-4110-b7b9-a7a86018e7ec admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:56.853797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3cdc32-c8f2-44ec-a705-e29c237275ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:56.854472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cdc32-c8f2-44ec-a705-e29c237275ea admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:56.854759 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cdc32-c8f2-44ec-a705-e29c237275ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:56.855036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cdc32-c8f2-44ec-a705-e29c237275ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:56.855762 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3cdc32-c8f2-44ec-a705-e29c237275ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:56.857369 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3cdc32-c8f2-44ec-a705-e29c237275ea admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:56.867115 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1321/2648] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:18:56.871213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fc07a-c28e-4d7a-8d6e-19bbeea6ad19 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:56.882389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fc07a-c28e-4d7a-8d6e-19bbeea6ad19 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:56.887055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381377ca-7010-484e-836d-3e64a426c8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:56.887960 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381377ca-7010-484e-836d-3e64a426c8c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:56.888241 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381377ca-7010-484e-836d-3e64a426c8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:56.888519 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381377ca-7010-484e-836d-3e64a426c8c9 admin admin] PATH_INFO: `/v3/projects/56bf4ae6eb244c8e845a744848792ad2/users/2a3c6525c80b4545afa84a4325ce4c29/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:56.890513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381377ca-7010-484e-836d-3e64a426c8c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56bf4ae6eb244c8e845a744848792ad2, user_id=2a3c6525c80b4545afa84a4325ce4c29, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:56.893767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381377ca-7010-484e-836d-3e64a426c8c9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:56.903965 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1328/2649] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:18:56 2022] PUT /identity/v3/projects/56bf4ae6eb244c8e845a744848792ad2/users/2a3c6525c80b4545afa84a4325ce4c29/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:56.914695 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07fe91-214f-4998-a576-3d5b1738cbf1 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:56.914985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07fe91-214f-4998-a576-3d5b1738cbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:56.915259 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07fe91-214f-4998-a576-3d5b1738cbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:56.942296 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-ae07fe91-214f-4998-a576-3d5b1738cbf1 None None] MFA Rules not processed for user `2a3c6525c80b4545afa84a4325ce4c29`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:56.943444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-ae07fe91-214f-4998-a576-3d5b1738cbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:56.983243 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:57.020458 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1322/2650] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:57.031433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381377ca-7010-484e-836d-3e64a426c8c9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:57.033171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-381377ca-7010-484e-836d-3e64a426c8c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:57.094245 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381377ca-7010-484e-836d-3e64a426c8c9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:57.098219 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9452c9-34d3-4ed9-a569-4840660e46ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:57.098869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9452c9-34d3-4ed9-a569-4840660e46ff service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:57.099156 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9452c9-34d3-4ed9-a569-4840660e46ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:57.099435 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9452c9-34d3-4ed9-a569-4840660e46ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:57.108633 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9452c9-34d3-4ed9-a569-4840660e46ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:57.110098 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9452c9-34d3-4ed9-a569-4840660e46ff service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:57.120135 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1329/2651] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:18:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:18:57.490606 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07fe91-214f-4998-a576-3d5b1738cbf1 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:57.553934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07fe91-214f-4998-a576-3d5b1738cbf1 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:57.558474 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb4370-bc53-4576-af02-de00fe86a2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:57.559351 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb4370-bc53-4576-af02-de00fe86a2ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:57.559639 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb4370-bc53-4576-af02-de00fe86a2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:57.559923 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb4370-bc53-4576-af02-de00fe86a2ea admin admin] PATH_INFO: `/v3/users/f2fe66df75b147bf87b6025e13740234` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:57.561127 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb4370-bc53-4576-af02-de00fe86a2ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2fe66df75b147bf87b6025e13740234)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:57.563097 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb4370-bc53-4576-af02-de00fe86a2ea admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:57.613940 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f4eb4370-bc53-4576-af02-de00fe86a2ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2fe66df75b147bf87b6025e13740234'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:57.621698 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f4eb4370-bc53-4576-af02-de00fe86a2ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2fe66df75b147bf87b6025e13740234'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:57.634406 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f4eb4370-bc53-4576-af02-de00fe86a2ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2fe66df75b147bf87b6025e13740234'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:57.635174 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f4eb4370-bc53-4576-af02-de00fe86a2ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2fe66df75b147bf87b6025e13740234'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:57.635862 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-f4eb4370-bc53-4576-af02-de00fe86a2ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2fe66df75b147bf87b6025e13740234'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:57.648325 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1323/2652] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:18:57 2022] DELETE /identity/v3/users/f2fe66df75b147bf87b6025e13740234 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:57.652863 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3634d0-075b-4d9c-b7b9-0c26e0b9a53e None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:57.653384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3634d0-075b-4d9c-b7b9-0c26e0b9a53e None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:57.653482 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3634d0-075b-4d9c-b7b9-0c26e0b9a53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:57.671366 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9d3634d0-075b-4d9c-b7b9-0c26e0b9a53e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:57.672573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9d3634d0-075b-4d9c-b7b9-0c26e0b9a53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:57.735090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1330/2653] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:57.745795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb4370-bc53-4576-af02-de00fe86a2ea admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:57.747143 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f4eb4370-bc53-4576-af02-de00fe86a2ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:57.807145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb4370-bc53-4576-af02-de00fe86a2ea admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:57.810838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1eba1d-3404-430d-8408-9e7b989e14bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:57.811518 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1eba1d-3404-430d-8408-9e7b989e14bc service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:57.811800 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1eba1d-3404-430d-8408-9e7b989e14bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:57.812076 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1eba1d-3404-430d-8408-9e7b989e14bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:57.822119 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1eba1d-3404-430d-8408-9e7b989e14bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:57.823546 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1eba1d-3404-430d-8408-9e7b989e14bc service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:57.827675 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:57.834838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1324/2654] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:18:58.157471 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3634d0-075b-4d9c-b7b9-0c26e0b9a53e None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:58.159983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9d3634d0-075b-4d9c-b7b9-0c26e0b9a53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:58.174666 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3634d0-075b-4d9c-b7b9-0c26e0b9a53e None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:58.179450 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a1f40-490c-49cc-b299-799e11ac0989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:58.180352 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a1f40-490c-49cc-b299-799e11ac0989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:58.180598 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a1f40-490c-49cc-b299-799e11ac0989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:58.180877 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a1f40-490c-49cc-b299-799e11ac0989 admin admin] PATH_INFO: `/v3/projects/d741bac6869b43d98d54ba5d2b09e548` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:58.182319 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a1f40-490c-49cc-b299-799e11ac0989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d741bac6869b43d98d54ba5d2b09e548)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:58.184195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a1f40-490c-49cc-b299-799e11ac0989 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:58.234678 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-129a1f40-490c-49cc-b299-799e11ac0989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd741bac6869b43d98d54ba5d2b09e548', 'request_id': 'req-129a1f40-490c-49cc-b299-799e11ac0989'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:58.237838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:58.244152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-129a1f40-490c-49cc-b299-799e11ac0989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd741bac6869b43d98d54ba5d2b09e548', 'request_id': 'req-129a1f40-490c-49cc-b299-799e11ac0989'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:58.251815 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-129a1f40-490c-49cc-b299-799e11ac0989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd741bac6869b43d98d54ba5d2b09e548', 'request_id': 'req-129a1f40-490c-49cc-b299-799e11ac0989'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:58.262676 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-129a1f40-490c-49cc-b299-799e11ac0989 admin admin] The token cache is being invalidate because project d741bac6869b43d98d54ba5d2b09e548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:18:58.262962 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-129a1f40-490c-49cc-b299-799e11ac0989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:58.263617 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-129a1f40-490c-49cc-b299-799e11ac0989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:58.265156 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1331/2655] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:18:58 2022] DELETE /identity/v3/projects/d741bac6869b43d98d54ba5d2b09e548 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:58.269611 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1eba1d-3404-430d-8408-9e7b989e14bc service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:58.279435 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1eba1d-3404-430d-8408-9e7b989e14bc service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:58.336866 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30603e-a0ef-49f3-8264-eeaa91edf9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:58.337686 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30603e-a0ef-49f3-8264-eeaa91edf9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:58.337985 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30603e-a0ef-49f3-8264-eeaa91edf9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:58.338256 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30603e-a0ef-49f3-8264-eeaa91edf9c6 admin admin] PATH_INFO: `/v3/users/2a3c6525c80b4545afa84a4325ce4c29` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:58.339519 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30603e-a0ef-49f3-8264-eeaa91edf9c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3c6525c80b4545afa84a4325ce4c29)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:58.341427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30603e-a0ef-49f3-8264-eeaa91edf9c6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:58.387895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-da30603e-a0ef-49f3-8264-eeaa91edf9c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3c6525c80b4545afa84a4325ce4c29'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:58.395726 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-da30603e-a0ef-49f3-8264-eeaa91edf9c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3c6525c80b4545afa84a4325ce4c29'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:58.407538 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-da30603e-a0ef-49f3-8264-eeaa91edf9c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3c6525c80b4545afa84a4325ce4c29'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:58.408230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-da30603e-a0ef-49f3-8264-eeaa91edf9c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3c6525c80b4545afa84a4325ce4c29'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:58.408844 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-da30603e-a0ef-49f3-8264-eeaa91edf9c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3c6525c80b4545afa84a4325ce4c29'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:58.421784 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1325/2656] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:18:58 2022] DELETE /identity/v3/users/2a3c6525c80b4545afa84a4325ce4c29 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:58.694410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a1f40-490c-49cc-b299-799e11ac0989 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:58.695919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-129a1f40-490c-49cc-b299-799e11ac0989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:58.710374 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a1f40-490c-49cc-b299-799e11ac0989 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:58.775818 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3a4a3-06bd-4566-86ee-c59349768b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:58.776696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3a4a3-06bd-4566-86ee-c59349768b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:58.776981 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3a4a3-06bd-4566-86ee-c59349768b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:58.777263 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3a4a3-06bd-4566-86ee-c59349768b25 admin admin] PATH_INFO: `/v3/projects/56bf4ae6eb244c8e845a744848792ad2` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:58.778624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3a4a3-06bd-4566-86ee-c59349768b25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56bf4ae6eb244c8e845a744848792ad2)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:58.780413 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3a4a3-06bd-4566-86ee-c59349768b25 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:58.829768 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a0e3a4a3-06bd-4566-86ee-c59349768b25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56bf4ae6eb244c8e845a744848792ad2', 'request_id': 'req-a0e3a4a3-06bd-4566-86ee-c59349768b25'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:58.838654 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a0e3a4a3-06bd-4566-86ee-c59349768b25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56bf4ae6eb244c8e845a744848792ad2', 'request_id': 'req-a0e3a4a3-06bd-4566-86ee-c59349768b25'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:58.845473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a0e3a4a3-06bd-4566-86ee-c59349768b25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56bf4ae6eb244c8e845a744848792ad2', 'request_id': 'req-a0e3a4a3-06bd-4566-86ee-c59349768b25'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:58.856284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a0e3a4a3-06bd-4566-86ee-c59349768b25 admin admin] The token cache is being invalidate because project 56bf4ae6eb244c8e845a744848792ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:18:58.856577 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a0e3a4a3-06bd-4566-86ee-c59349768b25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:58.857208 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a0e3a4a3-06bd-4566-86ee-c59349768b25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:18:58.858806 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1332/2657] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:18:58 2022] DELETE /identity/v3/projects/56bf4ae6eb244c8e845a744848792ad2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:58.864371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e178375-606d-4ffa-a211-0a0fd2371f4b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:58.864909 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e178375-606d-4ffa-a211-0a0fd2371f4b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:58.864909 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e178375-606d-4ffa-a211-0a0fd2371f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:58.888478 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4e178375-606d-4ffa-a211-0a0fd2371f4b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:58.889620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4e178375-606d-4ffa-a211-0a0fd2371f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:58.954995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1326/2658] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:58.963959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333ef84-7a0d-494e-ac87-374a80c81855 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:58.964308 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333ef84-7a0d-494e-ac87-374a80c81855 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:58.964601 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333ef84-7a0d-494e-ac87-374a80c81855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:58.984879 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6333ef84-7a0d-494e-ac87-374a80c81855 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:58.986282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6333ef84-7a0d-494e-ac87-374a80c81855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:58.995078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1333/2659] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:58.999758 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e178375-606d-4ffa-a211-0a0fd2371f4b None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:59.010994 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e178375-606d-4ffa-a211-0a0fd2371f4b None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:59.016043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1641ce1-03c0-47bf-a83b-b7bc30f96e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:59.016806 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1641ce1-03c0-47bf-a83b-b7bc30f96e75 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:59.017052 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1641ce1-03c0-47bf-a83b-b7bc30f96e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:59.017332 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1641ce1-03c0-47bf-a83b-b7bc30f96e75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:59.018152 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1641ce1-03c0-47bf-a83b-b7bc30f96e75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:18:59.018463 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1641ce1-03c0-47bf-a83b-b7bc30f96e75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:59.020582 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1641ce1-03c0-47bf-a83b-b7bc30f96e75 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:59.035070 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1327/2660] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:18:59.039755 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333ef84-7a0d-494e-ac87-374a80c81855 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:59.050056 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333ef84-7a0d-494e-ac87-374a80c81855 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:59.054910 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554898d0-1d0f-49a7-9376-90801ee216f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:59.055581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554898d0-1d0f-49a7-9376-90801ee216f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:59.055872 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554898d0-1d0f-49a7-9376-90801ee216f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:59.056152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554898d0-1d0f-49a7-9376-90801ee216f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:59.056853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554898d0-1d0f-49a7-9376-90801ee216f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:59.058827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554898d0-1d0f-49a7-9376-90801ee216f5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:59.089385 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1334/2661] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:18:59 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:18:59.094081 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1641ce1-03c0-47bf-a83b-b7bc30f96e75 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:59.102005 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:59.106630 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1641ce1-03c0-47bf-a83b-b7bc30f96e75 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:59.194842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10e822-f6d5-4772-bbbb-6d36a2d59ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:59.195702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10e822-f6d5-4772-bbbb-6d36a2d59ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:59.195993 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10e822-f6d5-4772-bbbb-6d36a2d59ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:59.196268 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10e822-f6d5-4772-bbbb-6d36a2d59ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:59.196978 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10e822-f6d5-4772-bbbb-6d36a2d59ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:59.198924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10e822-f6d5-4772-bbbb-6d36a2d59ca0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:59.223057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1328/2662] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:18:59 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:18:59.227365 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554898d0-1d0f-49a7-9376-90801ee216f5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:59.239392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554898d0-1d0f-49a7-9376-90801ee216f5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:59.245484 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b428a-d1d5-4722-ad52-69d20dea8456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:59.246281 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b428a-d1d5-4722-ad52-69d20dea8456 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:59.246636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b428a-d1d5-4722-ad52-69d20dea8456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:59.246982 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b428a-d1d5-4722-ad52-69d20dea8456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:59.248012 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b428a-d1d5-4722-ad52-69d20dea8456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:59.249688 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b428a-d1d5-4722-ad52-69d20dea8456 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:59.262053 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1335/2663] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:18:59.265956 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10e822-f6d5-4772-bbbb-6d36a2d59ca0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:59.276997 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10e822-f6d5-4772-bbbb-6d36a2d59ca0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:59.282696 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4c46e-0432-40cb-92a1-0cf431c1cd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:59.283532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4c46e-0432-40cb-92a1-0cf431c1cd50 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:59.283874 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4c46e-0432-40cb-92a1-0cf431c1cd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:59.284152 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4c46e-0432-40cb-92a1-0cf431c1cd50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:59.284901 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4c46e-0432-40cb-92a1-0cf431c1cd50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:59.286574 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4c46e-0432-40cb-92a1-0cf431c1cd50 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:59.301037 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1329/2664] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:18:59.303289 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b428a-d1d5-4722-ad52-69d20dea8456 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:59.315824 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b428a-d1d5-4722-ad52-69d20dea8456 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:59.320952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98497682-d5e8-4a55-8328-af9da9cec552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:59.322011 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98497682-d5e8-4a55-8328-af9da9cec552 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:59.322362 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98497682-d5e8-4a55-8328-af9da9cec552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:59.322710 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98497682-d5e8-4a55-8328-af9da9cec552 admin admin] PATH_INFO: `/v3/projects/73a1d41bf5e24b54972ce29acb4b11a2/users/ae6e9f34c1e0408bac7c252f9ecdd7e7/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:59.342204 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98497682-d5e8-4a55-8328-af9da9cec552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73a1d41bf5e24b54972ce29acb4b11a2, user_id=ae6e9f34c1e0408bac7c252f9ecdd7e7, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:59.345189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98497682-d5e8-4a55-8328-af9da9cec552 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:59.359353 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1336/2665] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:18:59 2022] PUT /identity/v3/projects/73a1d41bf5e24b54972ce29acb4b11a2/users/ae6e9f34c1e0408bac7c252f9ecdd7e7/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:18:59.365790 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869e856-21f7-4aac-b333-16d2857babb4 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:59.366165 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869e856-21f7-4aac-b333-16d2857babb4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:59.366417 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869e856-21f7-4aac-b333-16d2857babb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:59.386830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-7869e856-21f7-4aac-b333-16d2857babb4 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:18:59.388054 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-7869e856-21f7-4aac-b333-16d2857babb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:59.461629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1330/2666] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:18:59.475789 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98497682-d5e8-4a55-8328-af9da9cec552 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:18:59.478185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-98497682-d5e8-4a55-8328-af9da9cec552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:18:59.490265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:59.552658 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98497682-d5e8-4a55-8328-af9da9cec552 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:18:59.556790 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8043a50-497e-4436-8d76-d5988dbfa659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:18:59.557441 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8043a50-497e-4436-8d76-d5988dbfa659 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:18:59.557756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8043a50-497e-4436-8d76-d5988dbfa659 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:18:59.558056 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8043a50-497e-4436-8d76-d5988dbfa659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:18:59.568688 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8043a50-497e-4436-8d76-d5988dbfa659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:18:59.570265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8043a50-497e-4436-8d76-d5988dbfa659 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:18:59.580185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1337/2667] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:19:00.264260 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a247e5-1ce5-477d-ab4b-3fa3291e4a34 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:00.264846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a247e5-1ce5-477d-ab4b-3fa3291e4a34 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:00.264966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a247e5-1ce5-477d-ab4b-3fa3291e4a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:00.295138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-66a247e5-1ce5-477d-ab4b-3fa3291e4a34 None None] MFA Rules not processed for user `ae6e9f34c1e0408bac7c252f9ecdd7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:00.296102 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-66a247e5-1ce5-477d-ab4b-3fa3291e4a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:00.379708 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1331/2668] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:00.392067 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8043a50-497e-4436-8d76-d5988dbfa659 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:00.395098 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c8043a50-497e-4436-8d76-d5988dbfa659 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:00.462578 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8043a50-497e-4436-8d76-d5988dbfa659 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:00.467168 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd8c42-2b50-4a10-be98-b1f627661b3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:00.467838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd8c42-2b50-4a10-be98-b1f627661b3f service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:00.468383 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd8c42-2b50-4a10-be98-b1f627661b3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:00.468657 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd8c42-2b50-4a10-be98-b1f627661b3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:00.478843 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd8c42-2b50-4a10-be98-b1f627661b3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:00.480386 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd8c42-2b50-4a10-be98-b1f627661b3f service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:00.491023 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1338/2669] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:19:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:19:01.987789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bf153-a9b7-4652-bbc0-1cafd8bfb617 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:01.988380 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bf153-a9b7-4652-bbc0-1cafd8bfb617 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:01.988380 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bf153-a9b7-4652-bbc0-1cafd8bfb617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:02.012832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-545bf153-a9b7-4652-bbc0-1cafd8bfb617 None None] MFA Rules not processed for user `ae6e9f34c1e0408bac7c252f9ecdd7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:02.012832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-545bf153-a9b7-4652-bbc0-1cafd8bfb617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:02.019465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1332/2670] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:02.278278 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd8c42-2b50-4a10-be98-b1f627661b3f service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:02.289941 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd8c42-2b50-4a10-be98-b1f627661b3f service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:02.293574 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e460f49-5347-4abc-b399-68a86f704705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:02.294610 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e460f49-5347-4abc-b399-68a86f704705 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:02.294895 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e460f49-5347-4abc-b399-68a86f704705 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:02.295170 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e460f49-5347-4abc-b399-68a86f704705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:02.297986 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8e460f49-5347-4abc-b399-68a86f704705 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:02.308752 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e460f49-5347-4abc-b399-68a86f704705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:02.310239 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e460f49-5347-4abc-b399-68a86f704705 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:02.320109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1339/2671] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:19:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:19:06.345213 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bf153-a9b7-4652-bbc0-1cafd8bfb617 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:06.347175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-545bf153-a9b7-4652-bbc0-1cafd8bfb617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:06.360791 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bf153-a9b7-4652-bbc0-1cafd8bfb617 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:06.366079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4da87b-b28f-4bc0-ad43-48401022955b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:06.366982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4da87b-b28f-4bc0-ad43-48401022955b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:06.367260 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4da87b-b28f-4bc0-ad43-48401022955b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:06.367537 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4da87b-b28f-4bc0-ad43-48401022955b admin admin] PATH_INFO: `/v3/users/1e53dc03ea104166a0792e166f0cb6da` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:06.368825 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4da87b-b28f-4bc0-ad43-48401022955b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e53dc03ea104166a0792e166f0cb6da)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:06.370805 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4da87b-b28f-4bc0-ad43-48401022955b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:06.372371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:06.417594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9e4da87b-b28f-4bc0-ad43-48401022955b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e53dc03ea104166a0792e166f0cb6da'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:06.425418 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9e4da87b-b28f-4bc0-ad43-48401022955b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e53dc03ea104166a0792e166f0cb6da'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:06.438326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9e4da87b-b28f-4bc0-ad43-48401022955b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e53dc03ea104166a0792e166f0cb6da'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:06.439040 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9e4da87b-b28f-4bc0-ad43-48401022955b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e53dc03ea104166a0792e166f0cb6da'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:06.439676 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-9e4da87b-b28f-4bc0-ad43-48401022955b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e53dc03ea104166a0792e166f0cb6da'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:06.452459 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1333/2672] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:19:06 2022] DELETE /identity/v3/users/1e53dc03ea104166a0792e166f0cb6da => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:06.457415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b080484-da9d-4082-81a8-e02e2417e9f0 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:06.457936 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b080484-da9d-4082-81a8-e02e2417e9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:06.458060 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b080484-da9d-4082-81a8-e02e2417e9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:06.475453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-6b080484-da9d-4082-81a8-e02e2417e9f0 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:06.476653 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6b080484-da9d-4082-81a8-e02e2417e9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:06.535844 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1340/2673] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:06.545572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4da87b-b28f-4bc0-ad43-48401022955b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:06.547061 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9e4da87b-b28f-4bc0-ad43-48401022955b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:06.607456 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4da87b-b28f-4bc0-ad43-48401022955b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:06.611829 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b45ca-6348-4dad-9155-611718ffc688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:06.613059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b45ca-6348-4dad-9155-611718ffc688 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:06.613305 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b45ca-6348-4dad-9155-611718ffc688 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:06.613496 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b45ca-6348-4dad-9155-611718ffc688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:06.622804 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b45ca-6348-4dad-9155-611718ffc688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:06.624237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b45ca-6348-4dad-9155-611718ffc688 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:06.634171 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1334/2674] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:19:06.915653 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b080484-da9d-4082-81a8-e02e2417e9f0 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:06.917146 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6b080484-da9d-4082-81a8-e02e2417e9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:06.935413 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b080484-da9d-4082-81a8-e02e2417e9f0 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:06.941431 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceee8ac-d0d9-4635-92bc-10fe834d8d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:06.942324 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceee8ac-d0d9-4635-92bc-10fe834d8d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:06.942606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceee8ac-d0d9-4635-92bc-10fe834d8d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:06.943036 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceee8ac-d0d9-4635-92bc-10fe834d8d42 admin admin] PATH_INFO: `/v3/projects/f8faf0d708934020a699b82062b6c1df` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:06.944231 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceee8ac-d0d9-4635-92bc-10fe834d8d42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8faf0d708934020a699b82062b6c1df)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:06.946168 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceee8ac-d0d9-4635-92bc-10fe834d8d42 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:06.983568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:06.994804 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cceee8ac-d0d9-4635-92bc-10fe834d8d42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8faf0d708934020a699b82062b6c1df', 'request_id': 'req-cceee8ac-d0d9-4635-92bc-10fe834d8d42'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:07.002568 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cceee8ac-d0d9-4635-92bc-10fe834d8d42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8faf0d708934020a699b82062b6c1df', 'request_id': 'req-cceee8ac-d0d9-4635-92bc-10fe834d8d42'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:07.008943 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cceee8ac-d0d9-4635-92bc-10fe834d8d42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8faf0d708934020a699b82062b6c1df', 'request_id': 'req-cceee8ac-d0d9-4635-92bc-10fe834d8d42'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:07.023749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cceee8ac-d0d9-4635-92bc-10fe834d8d42 admin admin] The token cache is being invalidate because project f8faf0d708934020a699b82062b6c1df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:19:07.024153 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cceee8ac-d0d9-4635-92bc-10fe834d8d42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:07.024726 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-cceee8ac-d0d9-4635-92bc-10fe834d8d42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:07.026313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1341/2675] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:19:06 2022] DELETE /identity/v3/projects/f8faf0d708934020a699b82062b6c1df => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:07.031175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacdef4-3d98-47fb-9833-a2e41c004b55 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:07.031465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacdef4-3d98-47fb-9833-a2e41c004b55 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:07.031739 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacdef4-3d98-47fb-9833-a2e41c004b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:07.053788 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-dcacdef4-3d98-47fb-9833-a2e41c004b55 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:07.055046 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-dcacdef4-3d98-47fb-9833-a2e41c004b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:07.118184 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1335/2676] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:07.126046 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448af07-f37d-485f-bbb9-e4f3cea938e3 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:07.126340 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448af07-f37d-485f-bbb9-e4f3cea938e3 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:07.126630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448af07-f37d-485f-bbb9-e4f3cea938e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:07.145049 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-b448af07-f37d-485f-bbb9-e4f3cea938e3 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:07.146284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b448af07-f37d-485f-bbb9-e4f3cea938e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:07.154327 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1342/2677] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:07.159398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacdef4-3d98-47fb-9833-a2e41c004b55 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:07.169398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacdef4-3d98-47fb-9833-a2e41c004b55 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:07.174706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c668804-f88d-4774-bfda-94607c64672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:07.175367 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c668804-f88d-4774-bfda-94607c64672c admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:07.175649 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c668804-f88d-4774-bfda-94607c64672c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:07.175924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c668804-f88d-4774-bfda-94607c64672c admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:07.176652 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c668804-f88d-4774-bfda-94607c64672c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:19:07.176955 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c668804-f88d-4774-bfda-94607c64672c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:07.178583 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c668804-f88d-4774-bfda-94607c64672c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:07.190411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1336/2678] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:19:07.194952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448af07-f37d-485f-bbb9-e4f3cea938e3 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:07.204524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448af07-f37d-485f-bbb9-e4f3cea938e3 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:07.209244 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67e899-f32d-4330-892e-87c66a61aa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:07.210044 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67e899-f32d-4330-892e-87c66a61aa4a admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:07.210332 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67e899-f32d-4330-892e-87c66a61aa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:07.210616 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67e899-f32d-4330-892e-87c66a61aa4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:07.211307 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67e899-f32d-4330-892e-87c66a61aa4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:07.213221 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67e899-f32d-4330-892e-87c66a61aa4a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:07.240763 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1343/2679] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:19:07 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:19:07.244852 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c668804-f88d-4774-bfda-94607c64672c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:07.255049 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c668804-f88d-4774-bfda-94607c64672c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:07.259779 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:07.313782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae591c-d1f7-4638-a87a-a7bb868e4d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:07.314491 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae591c-d1f7-4638-a87a-a7bb868e4d93 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:07.314775 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae591c-d1f7-4638-a87a-a7bb868e4d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:07.315050 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae591c-d1f7-4638-a87a-a7bb868e4d93 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:07.315751 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae591c-d1f7-4638-a87a-a7bb868e4d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:07.317720 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae591c-d1f7-4638-a87a-a7bb868e4d93 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:07.337741 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1337/2680] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:19:07 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:19:07.342001 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67e899-f32d-4330-892e-87c66a61aa4a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:07.354808 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67e899-f32d-4330-892e-87c66a61aa4a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:07.359668 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cc764-ca0d-4b40-8b28-3e2d390b7861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:07.360336 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cc764-ca0d-4b40-8b28-3e2d390b7861 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:07.360744 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cc764-ca0d-4b40-8b28-3e2d390b7861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:07.360895 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cc764-ca0d-4b40-8b28-3e2d390b7861 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:07.362357 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333cc764-ca0d-4b40-8b28-3e2d390b7861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:07.363969 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333cc764-ca0d-4b40-8b28-3e2d390b7861 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:07.375091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1344/2681] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:19:07.379389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae591c-d1f7-4638-a87a-a7bb868e4d93 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:07.389445 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae591c-d1f7-4638-a87a-a7bb868e4d93 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:07.395740 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df0886-27af-4ebf-a1c2-b5dc6f807479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:07.396445 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df0886-27af-4ebf-a1c2-b5dc6f807479 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:07.396734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df0886-27af-4ebf-a1c2-b5dc6f807479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:07.397014 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df0886-27af-4ebf-a1c2-b5dc6f807479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:07.397795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df0886-27af-4ebf-a1c2-b5dc6f807479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:07.399445 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df0886-27af-4ebf-a1c2-b5dc6f807479 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:07.414314 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1338/2682] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:19:07.415785 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cc764-ca0d-4b40-8b28-3e2d390b7861 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:07.426624 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cc764-ca0d-4b40-8b28-3e2d390b7861 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:07.431428 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614c43c-7802-4daf-ab22-af5cc44a65d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:07.432313 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614c43c-7802-4daf-ab22-af5cc44a65d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:07.432596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614c43c-7802-4daf-ab22-af5cc44a65d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:07.432872 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614c43c-7802-4daf-ab22-af5cc44a65d1 admin admin] PATH_INFO: `/v3/projects/467c9f16c74546a68e59acbff2542cc2/users/53394412ea1f463196acd85c7e11621c/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:07.448991 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614c43c-7802-4daf-ab22-af5cc44a65d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=467c9f16c74546a68e59acbff2542cc2, user_id=53394412ea1f463196acd85c7e11621c, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:07.451699 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614c43c-7802-4daf-ab22-af5cc44a65d1 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:07.466373 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1345/2683] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:19:07 2022] PUT /identity/v3/projects/467c9f16c74546a68e59acbff2542cc2/users/53394412ea1f463196acd85c7e11621c/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:07.472882 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80c68f-1066-4c21-a244-206a38a9a32b None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:07.473175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80c68f-1066-4c21-a244-206a38a9a32b None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:07.473460 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80c68f-1066-4c21-a244-206a38a9a32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:07.492007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-cc80c68f-1066-4c21-a244-206a38a9a32b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:07.493230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cc80c68f-1066-4c21-a244-206a38a9a32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:07.554401 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1339/2684] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:07.564084 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614c43c-7802-4daf-ab22-af5cc44a65d1 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:07.566091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e614c43c-7802-4daf-ab22-af5cc44a65d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:07.625802 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614c43c-7802-4daf-ab22-af5cc44a65d1 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:07.630061 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46564064-150c-4c93-ab0e-331ab00ee439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:07.630713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46564064-150c-4c93-ab0e-331ab00ee439 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:07.631003 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46564064-150c-4c93-ab0e-331ab00ee439 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:07.631282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46564064-150c-4c93-ab0e-331ab00ee439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:07.640527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46564064-150c-4c93-ab0e-331ab00ee439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:07.642010 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46564064-150c-4c93-ab0e-331ab00ee439 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:07.652618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1346/2685] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:19:12.662189 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213ec4-4a1b-4a19-b541-a2edc647b51d None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:12.663099 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213ec4-4a1b-4a19-b541-a2edc647b51d None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:12.663379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213ec4-4a1b-4a19-b541-a2edc647b51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:12.698249 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-6c213ec4-4a1b-4a19-b541-a2edc647b51d None None] MFA Rules not processed for user `53394412ea1f463196acd85c7e11621c`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:12.699670 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6c213ec4-4a1b-4a19-b541-a2edc647b51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:12.791814 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1340/2686] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:12.796982 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46564064-150c-4c93-ab0e-331ab00ee439 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:12.809849 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46564064-150c-4c93-ab0e-331ab00ee439 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:12.814748 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ee685-9bd9-4011-bf5e-69bd21ae7a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:12.815684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ee685-9bd9-4011-bf5e-69bd21ae7a27 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:12.816173 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ee685-9bd9-4011-bf5e-69bd21ae7a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:12.816606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ee685-9bd9-4011-bf5e-69bd21ae7a27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:12.817559 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ee685-9bd9-4011-bf5e-69bd21ae7a27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:12.819730 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ee685-9bd9-4011-bf5e-69bd21ae7a27 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:12.856878 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1347/2687] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:19:12 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:19:12.861050 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c213ec4-4a1b-4a19-b541-a2edc647b51d None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:12.893564 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c213ec4-4a1b-4a19-b541-a2edc647b51d None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:12.912942 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:12.978360 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfda0f-2550-4c29-ae32-42fafa769fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:12.979177 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfda0f-2550-4c29-ae32-42fafa769fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:12.979532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfda0f-2550-4c29-ae32-42fafa769fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:12.979870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfda0f-2550-4c29-ae32-42fafa769fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:12.980690 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfda0f-2550-4c29-ae32-42fafa769fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:12.982690 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfda0f-2550-4c29-ae32-42fafa769fb0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:13.005189 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1341/2688] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:19:12 2022] POST /identity/v3/users => generated 296 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:19:13.009271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ee685-9bd9-4011-bf5e-69bd21ae7a27 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:13.021207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ee685-9bd9-4011-bf5e-69bd21ae7a27 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:13.026157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25a95b-2ff9-41c0-9a22-71c7744dec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:13.026838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25a95b-2ff9-41c0-9a22-71c7744dec2b admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:13.027125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25a95b-2ff9-41c0-9a22-71c7744dec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:13.027402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25a95b-2ff9-41c0-9a22-71c7744dec2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:13.028146 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25a95b-2ff9-41c0-9a22-71c7744dec2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:13.029872 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25a95b-2ff9-41c0-9a22-71c7744dec2b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:13.045169 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1348/2689] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:19:13.046472 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfda0f-2550-4c29-ae32-42fafa769fb0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:13.060353 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfda0f-2550-4c29-ae32-42fafa769fb0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:13.067361 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a8dbd-d8d9-4099-a579-9e959e1f72ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:13.068523 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a8dbd-d8d9-4099-a579-9e959e1f72ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:13.068882 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a8dbd-d8d9-4099-a579-9e959e1f72ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:13.069237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a8dbd-d8d9-4099-a579-9e959e1f72ed admin admin] PATH_INFO: `/v3/projects/2ae8219dbb294d1aafcba849c0574a7d/users/bc074e5b10d74c129d1d0a33481a9b26/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:13.091756 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a8dbd-d8d9-4099-a579-9e959e1f72ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae8219dbb294d1aafcba849c0574a7d, user_id=bc074e5b10d74c129d1d0a33481a9b26, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:13.094861 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a8dbd-d8d9-4099-a579-9e959e1f72ed admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:13.119951 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1342/2690] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:19:13 2022] PUT /identity/v3/projects/2ae8219dbb294d1aafcba849c0574a7d/users/bc074e5b10d74c129d1d0a33481a9b26/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:13.121288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25a95b-2ff9-41c0-9a22-71c7744dec2b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:13.133253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25a95b-2ff9-41c0-9a22-71c7744dec2b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:13.178741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:13.222192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d2c48-2c10-4cb6-b4c2-618e76738282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:13.223925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d2c48-2c10-4cb6-b4c2-618e76738282 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:13.224276 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d2c48-2c10-4cb6-b4c2-618e76738282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:13.225456 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d2c48-2c10-4cb6-b4c2-618e76738282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:13.226304 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d2c48-2c10-4cb6-b4c2-618e76738282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:13.228318 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d2c48-2c10-4cb6-b4c2-618e76738282 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:13.242094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1349/2691] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:19:13.246357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a8dbd-d8d9-4099-a579-9e959e1f72ed admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:13.260385 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a8dbd-d8d9-4099-a579-9e959e1f72ed admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:13.265451 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f423a-28de-41c8-9da7-60434c1fc32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:13.266461 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f423a-28de-41c8-9da7-60434c1fc32a admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:13.266745 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f423a-28de-41c8-9da7-60434c1fc32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:13.267024 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f423a-28de-41c8-9da7-60434c1fc32a admin admin] PATH_INFO: `/v3/projects/2ae8219dbb294d1aafcba849c0574a7d/users/bc074e5b10d74c129d1d0a33481a9b26/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:13.269791 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f423a-28de-41c8-9da7-60434c1fc32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae8219dbb294d1aafcba849c0574a7d, user_id=bc074e5b10d74c129d1d0a33481a9b26, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:13.272558 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f423a-28de-41c8-9da7-60434c1fc32a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:13.291412 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1343/2692] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:19:13 2022] PUT /identity/v3/projects/2ae8219dbb294d1aafcba849c0574a7d/users/bc074e5b10d74c129d1d0a33481a9b26/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:19:13.948972 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d2c48-2c10-4cb6-b4c2-618e76738282 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:13.950973 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3a6d2c48-2c10-4cb6-b4c2-618e76738282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:14.015390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d2c48-2c10-4cb6-b4c2-618e76738282 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:14.086026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabdfba-fef0-41f7-8eef-2ab72e9f628e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:14.086770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabdfba-fef0-41f7-8eef-2ab72e9f628e service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:14.087171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabdfba-fef0-41f7-8eef-2ab72e9f628e service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:14.087510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabdfba-fef0-41f7-8eef-2ab72e9f628e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:14.090415 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-dfabdfba-fef0-41f7-8eef-2ab72e9f628e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:14.220208 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabdfba-fef0-41f7-8eef-2ab72e9f628e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:14.223242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabdfba-fef0-41f7-8eef-2ab72e9f628e service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:14.273731 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1350/2693] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:19:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:19:18.579755 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f423a-28de-41c8-9da7-60434c1fc32a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:18.583120 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-808f423a-28de-41c8-9da7-60434c1fc32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:18.711753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f423a-28de-41c8-9da7-60434c1fc32a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:18.727078 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a09a97-14f3-4216-bd3b-d78afd902559 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:18.727763 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a09a97-14f3-4216-bd3b-d78afd902559 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:18.728079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a09a97-14f3-4216-bd3b-d78afd902559 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:18.728329 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a09a97-14f3-4216-bd3b-d78afd902559 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:18.731042 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d2a09a97-14f3-4216-bd3b-d78afd902559 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:18.755630 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a09a97-14f3-4216-bd3b-d78afd902559 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:18.757490 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a09a97-14f3-4216-bd3b-d78afd902559 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:18.776803 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1344/2694] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:19:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:19:19.888927 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7a8b9-b186-4eec-954f-d4f5b24eed3c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:19.889557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7a8b9-b186-4eec-954f-d4f5b24eed3c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:19.889557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7a8b9-b186-4eec-954f-d4f5b24eed3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:19.913011 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:19.915306 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee065ce-a806-42e2-aa92-1459830d50db None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:19.915844 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee065ce-a806-42e2-aa92-1459830d50db None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:19.915844 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee065ce-a806-42e2-aa92-1459830d50db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:19.932591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-9fa7a8b9-b186-4eec-954f-d4f5b24eed3c None None] MFA Rules not processed for user `bc074e5b10d74c129d1d0a33481a9b26`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:19.934290 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-9fa7a8b9-b186-4eec-954f-d4f5b24eed3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:19.935239 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-dee065ce-a806-42e2-aa92-1459830d50db None None] MFA Rules not processed for user `ae6e9f34c1e0408bac7c252f9ecdd7e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:19.937043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-dee065ce-a806-42e2-aa92-1459830d50db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:20.046694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:20.051218 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1351/2695] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:20.058663 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1345/2696] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:19:20.070101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7a8b9-b186-4eec-954f-d4f5b24eed3c None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:20.084062 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7a8b9-b186-4eec-954f-d4f5b24eed3c None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:20.090686 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f1368-926f-42aa-9d8a-fd58f8219fcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:20.091373 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f1368-926f-42aa-9d8a-fd58f8219fcf service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:20.091729 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f1368-926f-42aa-9d8a-fd58f8219fcf service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:20.092076 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f1368-926f-42aa-9d8a-fd58f8219fcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:20.185055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f1368-926f-42aa-9d8a-fd58f8219fcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:20.186724 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f1368-926f-42aa-9d8a-fd58f8219fcf service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:20.198159 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1352/2697] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:19:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:19:24.208816 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee065ce-a806-42e2-aa92-1459830d50db None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:24.210325 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-dee065ce-a806-42e2-aa92-1459830d50db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:24.279237 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee065ce-a806-42e2-aa92-1459830d50db None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:24.283509 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337627c1-ea92-4819-bb13-4ca6acd86d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:24.284443 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337627c1-ea92-4819-bb13-4ca6acd86d00 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:24.284669 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337627c1-ea92-4819-bb13-4ca6acd86d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:24.285115 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337627c1-ea92-4819-bb13-4ca6acd86d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:24.289853 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-337627c1-ea92-4819-bb13-4ca6acd86d00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:24.372887 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337627c1-ea92-4819-bb13-4ca6acd86d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:24.374446 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337627c1-ea92-4819-bb13-4ca6acd86d00 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:24.386605 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1346/2698] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:19:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:19:28.412646 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f1368-926f-42aa-9d8a-fd58f8219fcf service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:28.414445 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3c2f1368-926f-42aa-9d8a-fd58f8219fcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:28.433157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f1368-926f-42aa-9d8a-fd58f8219fcf service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:28.437935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30a8d3-5de0-4d9a-ba53-02b2a98fdbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:28.439739 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30a8d3-5de0-4d9a-ba53-02b2a98fdbe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:28.440026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30a8d3-5de0-4d9a-ba53-02b2a98fdbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:28.440306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30a8d3-5de0-4d9a-ba53-02b2a98fdbe6 admin admin] PATH_INFO: `/v3/users/13b9ab17cee74e8282cd86a37eaf19aa` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:28.441560 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30a8d3-5de0-4d9a-ba53-02b2a98fdbe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b9ab17cee74e8282cd86a37eaf19aa)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:28.443547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30a8d3-5de0-4d9a-ba53-02b2a98fdbe6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:28.517431 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a30a8d3-5de0-4d9a-ba53-02b2a98fdbe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b9ab17cee74e8282cd86a37eaf19aa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:28.518863 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a30a8d3-5de0-4d9a-ba53-02b2a98fdbe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b9ab17cee74e8282cd86a37eaf19aa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:28.541843 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a30a8d3-5de0-4d9a-ba53-02b2a98fdbe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b9ab17cee74e8282cd86a37eaf19aa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:28.553223 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a30a8d3-5de0-4d9a-ba53-02b2a98fdbe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b9ab17cee74e8282cd86a37eaf19aa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:28.565792 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a30a8d3-5de0-4d9a-ba53-02b2a98fdbe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b9ab17cee74e8282cd86a37eaf19aa'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:28.574418 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1353/2699] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:19:28 2022] DELETE /identity/v3/users/13b9ab17cee74e8282cd86a37eaf19aa => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:28.769556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337627c1-ea92-4819-bb13-4ca6acd86d00 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:28.781389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337627c1-ea92-4819-bb13-4ca6acd86d00 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:28.851103 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f3326-7e0f-46b8-947c-09f1c8115774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:28.852124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f3326-7e0f-46b8-947c-09f1c8115774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:28.852418 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f3326-7e0f-46b8-947c-09f1c8115774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:28.852698 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f3326-7e0f-46b8-947c-09f1c8115774 admin admin] PATH_INFO: `/v3/projects/6fe001ad764a40839c0a87e48dedb14f` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:28.854029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f3326-7e0f-46b8-947c-09f1c8115774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe001ad764a40839c0a87e48dedb14f)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:28.855997 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f3326-7e0f-46b8-947c-09f1c8115774 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:28.925155 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0c7f3326-7e0f-46b8-947c-09f1c8115774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe001ad764a40839c0a87e48dedb14f', 'request_id': 'req-0c7f3326-7e0f-46b8-947c-09f1c8115774'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:28.928826 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:28.937980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0c7f3326-7e0f-46b8-947c-09f1c8115774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe001ad764a40839c0a87e48dedb14f', 'request_id': 'req-0c7f3326-7e0f-46b8-947c-09f1c8115774'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:28.945522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0c7f3326-7e0f-46b8-947c-09f1c8115774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe001ad764a40839c0a87e48dedb14f', 'request_id': 'req-0c7f3326-7e0f-46b8-947c-09f1c8115774'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:28.976613 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0c7f3326-7e0f-46b8-947c-09f1c8115774 admin admin] The token cache is being invalidate because project 6fe001ad764a40839c0a87e48dedb14f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:19:28.977007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0c7f3326-7e0f-46b8-947c-09f1c8115774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:28.977793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-0c7f3326-7e0f-46b8-947c-09f1c8115774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:28.979632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1347/2700] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:19:28 2022] DELETE /identity/v3/projects/6fe001ad764a40839c0a87e48dedb14f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:28.984781 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bd31f-3703-4e91-98d3-738db72d1d81 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:28.985069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bd31f-3703-4e91-98d3-738db72d1d81 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:28.985348 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bd31f-3703-4e91-98d3-738db72d1d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:29.003242 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:29.018463 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-a60bd31f-3703-4e91-98d3-738db72d1d81 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:29.020054 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a60bd31f-3703-4e91-98d3-738db72d1d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:29.095997 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1354/2701] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:29.104109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17e614-c9e8-45fe-a614-e99718ed9582 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:29.104524 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17e614-c9e8-45fe-a614-e99718ed9582 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:29.104914 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17e614-c9e8-45fe-a614-e99718ed9582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:29.124436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9c17e614-c9e8-45fe-a614-e99718ed9582 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:29.125692 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9c17e614-c9e8-45fe-a614-e99718ed9582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:29.135060 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1348/2702] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:29.139264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bd31f-3703-4e91-98d3-738db72d1d81 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:29.149445 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bd31f-3703-4e91-98d3-738db72d1d81 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:29.154189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b037f21-8323-4f20-970f-0b405c766f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:29.155334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b037f21-8323-4f20-970f-0b405c766f90 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:29.155334 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b037f21-8323-4f20-970f-0b405c766f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:29.155648 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b037f21-8323-4f20-970f-0b405c766f90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:29.156285 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b037f21-8323-4f20-970f-0b405c766f90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:19:29.156719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b037f21-8323-4f20-970f-0b405c766f90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:29.159071 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b037f21-8323-4f20-970f-0b405c766f90 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:29.176091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1355/2703] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:19:29.180507 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17e614-c9e8-45fe-a614-e99718ed9582 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:29.191043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17e614-c9e8-45fe-a614-e99718ed9582 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:29.196091 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac45cfe-d176-42e7-b486-4f10b398d18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:29.197201 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac45cfe-d176-42e7-b486-4f10b398d18d admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:29.197503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac45cfe-d176-42e7-b486-4f10b398d18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:29.197836 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac45cfe-d176-42e7-b486-4f10b398d18d admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:29.198567 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac45cfe-d176-42e7-b486-4f10b398d18d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:29.200478 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac45cfe-d176-42e7-b486-4f10b398d18d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:29.230830 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1349/2704] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:19:29 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:19:29.236393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b037f21-8323-4f20-970f-0b405c766f90 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:29.247323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b037f21-8323-4f20-970f-0b405c766f90 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:29.308409 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50bcee-26bb-40a7-a063-82f8919863f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:29.309467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50bcee-26bb-40a7-a063-82f8919863f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:29.309793 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50bcee-26bb-40a7-a063-82f8919863f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:29.310074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50bcee-26bb-40a7-a063-82f8919863f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:29.310760 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50bcee-26bb-40a7-a063-82f8919863f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:29.312675 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e50bcee-26bb-40a7-a063-82f8919863f8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:29.333280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1356/2705] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:19:29 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:19:29.338089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac45cfe-d176-42e7-b486-4f10b398d18d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:29.349464 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac45cfe-d176-42e7-b486-4f10b398d18d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:29.354121 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693993b-9344-44bc-8d7e-e93732419259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:29.354785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693993b-9344-44bc-8d7e-e93732419259 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:29.355067 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693993b-9344-44bc-8d7e-e93732419259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:29.355342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693993b-9344-44bc-8d7e-e93732419259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:29.356067 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693993b-9344-44bc-8d7e-e93732419259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:29.357681 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693993b-9344-44bc-8d7e-e93732419259 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:29.369085 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1350/2706] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:19:29.373508 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50bcee-26bb-40a7-a063-82f8919863f8 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:29.385767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e50bcee-26bb-40a7-a063-82f8919863f8 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:29.401146 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6920c7f-1746-421a-9885-02d6e62075ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:29.401858 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6920c7f-1746-421a-9885-02d6e62075ef admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:29.402144 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6920c7f-1746-421a-9885-02d6e62075ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:29.402421 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6920c7f-1746-421a-9885-02d6e62075ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:29.403185 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6920c7f-1746-421a-9885-02d6e62075ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:29.404787 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6920c7f-1746-421a-9885-02d6e62075ef admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:29.417145 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1357/2707] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:19:29.421603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693993b-9344-44bc-8d7e-e93732419259 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:29.432911 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693993b-9344-44bc-8d7e-e93732419259 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:29.437688 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c840a3-e90e-4225-bca1-6bb002fad7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:29.438656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c840a3-e90e-4225-bca1-6bb002fad7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:29.438993 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c840a3-e90e-4225-bca1-6bb002fad7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:29.439449 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c840a3-e90e-4225-bca1-6bb002fad7f2 admin admin] PATH_INFO: `/v3/projects/0225c1c1f1de442690d4c2436b2f921d/users/ec95176d98aa407195ea9eb98cea3968/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:29.458525 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c840a3-e90e-4225-bca1-6bb002fad7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0225c1c1f1de442690d4c2436b2f921d, user_id=ec95176d98aa407195ea9eb98cea3968, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:29.461499 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c840a3-e90e-4225-bca1-6bb002fad7f2 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:29.481093 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1351/2708] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:19:29 2022] PUT /identity/v3/projects/0225c1c1f1de442690d4c2436b2f921d/users/ec95176d98aa407195ea9eb98cea3968/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:29.494397 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cf59e-d604-4b7e-90ce-0fd76a73563f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:29.494795 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cf59e-d604-4b7e-90ce-0fd76a73563f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:29.495014 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cf59e-d604-4b7e-90ce-0fd76a73563f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:29.526400 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-205cf59e-d604-4b7e-90ce-0fd76a73563f None None] MFA Rules not processed for user `ec95176d98aa407195ea9eb98cea3968`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:29.527626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-205cf59e-d604-4b7e-90ce-0fd76a73563f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:29.591224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:29.599201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1358/2709] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:29.610503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c840a3-e90e-4225-bca1-6bb002fad7f2 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:29.612391 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-70c840a3-e90e-4225-bca1-6bb002fad7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:29.694585 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c840a3-e90e-4225-bca1-6bb002fad7f2 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:29.700282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a4313-4ccc-49b3-a342-aeb912f0a094 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:29.700971 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a4313-4ccc-49b3-a342-aeb912f0a094 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:29.701258 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a4313-4ccc-49b3-a342-aeb912f0a094 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:29.701535 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a4313-4ccc-49b3-a342-aeb912f0a094 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:29.712572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a4313-4ccc-49b3-a342-aeb912f0a094 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:29.714886 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a4313-4ccc-49b3-a342-aeb912f0a094 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:29.725200 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1352/2710] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:19:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:19:39.600701 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:39.720750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=67,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:41.293811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cf59e-d604-4b7e-90ce-0fd76a73563f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:41.357021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cf59e-d604-4b7e-90ce-0fd76a73563f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:41.361830 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931f7c6-5c99-4f56-a49d-77e2511b8313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:41.362695 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931f7c6-5c99-4f56-a49d-77e2511b8313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:41.362979 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931f7c6-5c99-4f56-a49d-77e2511b8313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:41.363253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931f7c6-5c99-4f56-a49d-77e2511b8313 admin admin] PATH_INFO: `/v3/users/ec95176d98aa407195ea9eb98cea3968` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:41.364442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931f7c6-5c99-4f56-a49d-77e2511b8313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec95176d98aa407195ea9eb98cea3968)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:41.366400 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931f7c6-5c99-4f56-a49d-77e2511b8313 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:41.413161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1931f7c6-5c99-4f56-a49d-77e2511b8313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec95176d98aa407195ea9eb98cea3968'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:41.413865 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1931f7c6-5c99-4f56-a49d-77e2511b8313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec95176d98aa407195ea9eb98cea3968'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:41.422031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1931f7c6-5c99-4f56-a49d-77e2511b8313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec95176d98aa407195ea9eb98cea3968'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:41.429911 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1931f7c6-5c99-4f56-a49d-77e2511b8313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec95176d98aa407195ea9eb98cea3968'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:41.443143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1931f7c6-5c99-4f56-a49d-77e2511b8313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec95176d98aa407195ea9eb98cea3968'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:41.449122 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1359/2711] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:19:41 2022] DELETE /identity/v3/users/ec95176d98aa407195ea9eb98cea3968 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:41.453870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e0462-2067-4dcb-ad22-b3e858dc71ac None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:41.455010 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e0462-2067-4dcb-ad22-b3e858dc71ac None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:41.455010 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e0462-2067-4dcb-ad22-b3e858dc71ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:41.472731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-af4e0462-2067-4dcb-ad22-b3e858dc71ac None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:41.473939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-af4e0462-2067-4dcb-ad22-b3e858dc71ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:41.536010 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1353/2712] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:19:41.545562 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931f7c6-5c99-4f56-a49d-77e2511b8313 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:41.547038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1931f7c6-5c99-4f56-a49d-77e2511b8313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:41.606893 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931f7c6-5c99-4f56-a49d-77e2511b8313 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:41.611572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b8dc3-4d4b-467e-88c5-10614c9cc2e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:41.612222 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b8dc3-4d4b-467e-88c5-10614c9cc2e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:41.612507 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b8dc3-4d4b-467e-88c5-10614c9cc2e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:41.612785 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b8dc3-4d4b-467e-88c5-10614c9cc2e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:41.622080 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b8dc3-4d4b-467e-88c5-10614c9cc2e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:41.623507 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b8dc3-4d4b-467e-88c5-10614c9cc2e6 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:41.634400 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1360/2713] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:19:41.911137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e0462-2067-4dcb-ad22-b3e858dc71ac None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:41.912903 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-af4e0462-2067-4dcb-ad22-b3e858dc71ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:41.926806 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e0462-2067-4dcb-ad22-b3e858dc71ac None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:41.931639 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cd05e-4f39-4acb-9190-155ad9428bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:41.932549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cd05e-4f39-4acb-9190-155ad9428bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:41.932835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cd05e-4f39-4acb-9190-155ad9428bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:41.933115 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cd05e-4f39-4acb-9190-155ad9428bd9 admin admin] PATH_INFO: `/v3/projects/0225c1c1f1de442690d4c2436b2f921d` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:41.938539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204cd05e-4f39-4acb-9190-155ad9428bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0225c1c1f1de442690d4c2436b2f921d)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:41.941881 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204cd05e-4f39-4acb-9190-155ad9428bd9 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:41.995838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-204cd05e-4f39-4acb-9190-155ad9428bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0225c1c1f1de442690d4c2436b2f921d', 'request_id': 'req-204cd05e-4f39-4acb-9190-155ad9428bd9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:42.003036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-204cd05e-4f39-4acb-9190-155ad9428bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0225c1c1f1de442690d4c2436b2f921d', 'request_id': 'req-204cd05e-4f39-4acb-9190-155ad9428bd9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:42.010602 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-204cd05e-4f39-4acb-9190-155ad9428bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0225c1c1f1de442690d4c2436b2f921d', 'request_id': 'req-204cd05e-4f39-4acb-9190-155ad9428bd9'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:42.024808 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-204cd05e-4f39-4acb-9190-155ad9428bd9 admin admin] The token cache is being invalidate because project 0225c1c1f1de442690d4c2436b2f921d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:19:42.025130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-204cd05e-4f39-4acb-9190-155ad9428bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:42.025786 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-204cd05e-4f39-4acb-9190-155ad9428bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:42.027412 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1354/2714] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:19:41 2022] DELETE /identity/v3/projects/0225c1c1f1de442690d4c2436b2f921d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:42.032853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c180dee-f72a-4da8-a031-576c0f1459fa None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:42.033173 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c180dee-f72a-4da8-a031-576c0f1459fa None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:42.033448 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c180dee-f72a-4da8-a031-576c0f1459fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:42.051864 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-7c180dee-f72a-4da8-a031-576c0f1459fa None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:42.052979 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7c180dee-f72a-4da8-a031-576c0f1459fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:42.073576 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:42.121093 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1361/2715] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:42.130469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b225f51-d09c-4aa5-b179-89f735cfc39e None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:42.130765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b225f51-d09c-4aa5-b179-89f735cfc39e None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:42.131045 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b225f51-d09c-4aa5-b179-89f735cfc39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:42.149635 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9b225f51-d09c-4aa5-b179-89f735cfc39e None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:42.150881 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9b225f51-d09c-4aa5-b179-89f735cfc39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:42.159600 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1355/2716] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:42.163875 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c180dee-f72a-4da8-a031-576c0f1459fa None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:42.175004 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c180dee-f72a-4da8-a031-576c0f1459fa None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:42.179652 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b034c-abc4-4a03-ae1a-e63c558e9781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:42.180305 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b034c-abc4-4a03-ae1a-e63c558e9781 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:42.180603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b034c-abc4-4a03-ae1a-e63c558e9781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:42.180876 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b034c-abc4-4a03-ae1a-e63c558e9781 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:42.181606 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b034c-abc4-4a03-ae1a-e63c558e9781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:19:42.181944 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b034c-abc4-4a03-ae1a-e63c558e9781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:42.183532 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b034c-abc4-4a03-ae1a-e63c558e9781 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:42.196458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1362/2717] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:19:42.199820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b225f51-d09c-4aa5-b179-89f735cfc39e None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:42.209543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b225f51-d09c-4aa5-b179-89f735cfc39e None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:42.214395 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa956f-9f31-4271-859c-3976c70d1160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:42.215058 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa956f-9f31-4271-859c-3976c70d1160 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:42.215346 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa956f-9f31-4271-859c-3976c70d1160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:42.215629 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa956f-9f31-4271-859c-3976c70d1160 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:42.216333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa956f-9f31-4271-859c-3976c70d1160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:42.218314 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa956f-9f31-4271-859c-3976c70d1160 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:42.246984 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1356/2718] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:19:42 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:19:42.251192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b034c-abc4-4a03-ae1a-e63c558e9781 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:42.263111 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b034c-abc4-4a03-ae1a-e63c558e9781 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:42.330345 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab085e-0407-41ef-bf84-0a8bbb581d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:42.331312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab085e-0407-41ef-bf84-0a8bbb581d6b admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:42.331312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab085e-0407-41ef-bf84-0a8bbb581d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:42.331560 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab085e-0407-41ef-bf84-0a8bbb581d6b admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:42.332258 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab085e-0407-41ef-bf84-0a8bbb581d6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:42.334266 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab085e-0407-41ef-bf84-0a8bbb581d6b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:42.356312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1363/2719] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:19:42 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:19:42.360430 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa956f-9f31-4271-859c-3976c70d1160 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:42.371649 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa956f-9f31-4271-859c-3976c70d1160 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:42.376456 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fe82a-3ad7-4050-844a-b5ecb250898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:42.377126 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fe82a-3ad7-4050-844a-b5ecb250898d admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:42.377414 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fe82a-3ad7-4050-844a-b5ecb250898d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:42.377728 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fe82a-3ad7-4050-844a-b5ecb250898d admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:42.378523 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fe82a-3ad7-4050-844a-b5ecb250898d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:42.380144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fe82a-3ad7-4050-844a-b5ecb250898d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:42.392169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1357/2720] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:19:42.396246 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab085e-0407-41ef-bf84-0a8bbb581d6b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:42.406383 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab085e-0407-41ef-bf84-0a8bbb581d6b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:42.412288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8822d-6073-48fe-be23-6c2a92747a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:42.412945 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8822d-6073-48fe-be23-6c2a92747a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:42.413233 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8822d-6073-48fe-be23-6c2a92747a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:42.413514 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8822d-6073-48fe-be23-6c2a92747a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:42.414302 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8822d-6073-48fe-be23-6c2a92747a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:42.415897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8822d-6073-48fe-be23-6c2a92747a74 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:42.426393 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1364/2721] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:19:42.430554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fe82a-3ad7-4050-844a-b5ecb250898d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:42.440945 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fe82a-3ad7-4050-844a-b5ecb250898d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:42.445707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329cfa6-7e56-4e60-9d03-eedbbeed222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:42.446591 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329cfa6-7e56-4e60-9d03-eedbbeed222b admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:42.446877 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329cfa6-7e56-4e60-9d03-eedbbeed222b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:42.447155 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329cfa6-7e56-4e60-9d03-eedbbeed222b admin admin] PATH_INFO: `/v3/projects/2fa25a8e4cd4489a9b804806be3a2db8/users/afe6265f02664e7ea8795e9f1bab3c6c/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:42.463520 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329cfa6-7e56-4e60-9d03-eedbbeed222b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa25a8e4cd4489a9b804806be3a2db8, user_id=afe6265f02664e7ea8795e9f1bab3c6c, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:42.466246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329cfa6-7e56-4e60-9d03-eedbbeed222b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:42.481289 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1358/2722] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:19:42 2022] PUT /identity/v3/projects/2fa25a8e4cd4489a9b804806be3a2db8/users/afe6265f02664e7ea8795e9f1bab3c6c/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:42.492336 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec4ff9-c727-4a1b-a084-c8359d41e752 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:42.492670 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec4ff9-c727-4a1b-a084-c8359d41e752 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:42.492996 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec4ff9-c727-4a1b-a084-c8359d41e752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:42.520301 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-cbec4ff9-c727-4a1b-a084-c8359d41e752 None None] MFA Rules not processed for user `afe6265f02664e7ea8795e9f1bab3c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:42.521431 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cbec4ff9-c727-4a1b-a084-c8359d41e752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:42.589028 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1365/2723] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:19:42.593974 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329cfa6-7e56-4e60-9d03-eedbbeed222b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:42.615593 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:42.660096 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329cfa6-7e56-4e60-9d03-eedbbeed222b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:42.664912 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba505500-ec0f-40a1-8846-9cc20576dac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:42.665572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba505500-ec0f-40a1-8846-9cc20576dac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:42.665891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba505500-ec0f-40a1-8846-9cc20576dac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:42.666172 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba505500-ec0f-40a1-8846-9cc20576dac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:42.666873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba505500-ec0f-40a1-8846-9cc20576dac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:42.668789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba505500-ec0f-40a1-8846-9cc20576dac0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:42.695993 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1359/2724] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:19:42 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:19:42.700197 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec4ff9-c727-4a1b-a084-c8359d41e752 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:42.711816 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec4ff9-c727-4a1b-a084-c8359d41e752 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:42.725698 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:42.772375 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdc7d8-7c5f-4ead-babc-8bdad071b0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:42.772988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdc7d8-7c5f-4ead-babc-8bdad071b0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:42.773273 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdc7d8-7c5f-4ead-babc-8bdad071b0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:42.773553 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdc7d8-7c5f-4ead-babc-8bdad071b0c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:42.774282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdc7d8-7c5f-4ead-babc-8bdad071b0c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:42.776208 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdc7d8-7c5f-4ead-babc-8bdad071b0c9 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:42.798366 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1366/2725] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:19:42 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:19:42.802506 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba505500-ec0f-40a1-8846-9cc20576dac0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:42.812981 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba505500-ec0f-40a1-8846-9cc20576dac0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:42.818228 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35df8d4-9340-4a35-bd28-de1e997232cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:42.818886 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df8d4-9340-4a35-bd28-de1e997232cb admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:42.819167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df8d4-9340-4a35-bd28-de1e997232cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:42.819447 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df8d4-9340-4a35-bd28-de1e997232cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:42.820175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35df8d4-9340-4a35-bd28-de1e997232cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:42.821804 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35df8d4-9340-4a35-bd28-de1e997232cb admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:42.833525 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1360/2726] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:19:42.837742 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdc7d8-7c5f-4ead-babc-8bdad071b0c9 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:42.848287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdc7d8-7c5f-4ead-babc-8bdad071b0c9 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:42.853003 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9413f09-f250-4608-bcc8-64a0eedbf754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:42.853930 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9413f09-f250-4608-bcc8-64a0eedbf754 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:42.854212 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9413f09-f250-4608-bcc8-64a0eedbf754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:42.854493 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9413f09-f250-4608-bcc8-64a0eedbf754 admin admin] PATH_INFO: `/v3/projects/5ebf44b669064c92bbb44a9757569ee8/users/e3f049ac3f0242eb91b96bc149ffd946/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:42.870406 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9413f09-f250-4608-bcc8-64a0eedbf754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ebf44b669064c92bbb44a9757569ee8, user_id=e3f049ac3f0242eb91b96bc149ffd946, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:42.873118 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9413f09-f250-4608-bcc8-64a0eedbf754 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:42.889117 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1367/2727] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:19:42 2022] PUT /identity/v3/projects/5ebf44b669064c92bbb44a9757569ee8/users/e3f049ac3f0242eb91b96bc149ffd946/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:42.893972 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35df8d4-9340-4a35-bd28-de1e997232cb admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:42.903964 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35df8d4-9340-4a35-bd28-de1e997232cb admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:42.960877 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4a9a6-26fb-4867-9a36-0390fccb6354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:42.961547 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4a9a6-26fb-4867-9a36-0390fccb6354 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:42.961865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4a9a6-26fb-4867-9a36-0390fccb6354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:42.962147 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4a9a6-26fb-4867-9a36-0390fccb6354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:42.962872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4a9a6-26fb-4867-9a36-0390fccb6354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:42.964485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4a9a6-26fb-4867-9a36-0390fccb6354 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:42.974949 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1361/2728] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:19:42.979216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9413f09-f250-4608-bcc8-64a0eedbf754 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:42.990014 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9413f09-f250-4608-bcc8-64a0eedbf754 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:42.994583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5987c5-3c34-4cb8-8144-746be87e0c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:42.995460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5987c5-3c34-4cb8-8144-746be87e0c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:42.995742 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5987c5-3c34-4cb8-8144-746be87e0c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:42.996020 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5987c5-3c34-4cb8-8144-746be87e0c61 admin admin] PATH_INFO: `/v3/projects/5ebf44b669064c92bbb44a9757569ee8/users/e3f049ac3f0242eb91b96bc149ffd946/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:42.998031 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5987c5-3c34-4cb8-8144-746be87e0c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ebf44b669064c92bbb44a9757569ee8, user_id=e3f049ac3f0242eb91b96bc149ffd946, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:43.000676 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5987c5-3c34-4cb8-8144-746be87e0c61 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:43.011972 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1368/2729] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:19:42 2022] PUT /identity/v3/projects/5ebf44b669064c92bbb44a9757569ee8/users/e3f049ac3f0242eb91b96bc149ffd946/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:43.022774 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11f28a-2750-41e4-9efd-7b2dbbd78868 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:43.023024 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11f28a-2750-41e4-9efd-7b2dbbd78868 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:43.023304 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11f28a-2750-41e4-9efd-7b2dbbd78868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:43.049388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-cd11f28a-2750-41e4-9efd-7b2dbbd78868 None None] MFA Rules not processed for user `e3f049ac3f0242eb91b96bc149ffd946`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:43.050667 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cd11f28a-2750-41e4-9efd-7b2dbbd78868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:43.127633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1362/2730] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:43.140152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5987c5-3c34-4cb8-8144-746be87e0c61 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:43.142043 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7b5987c5-3c34-4cb8-8144-746be87e0c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:43.205524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5987c5-3c34-4cb8-8144-746be87e0c61 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:43.209380 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac30499-4fe2-4ffa-999a-01fdf14370c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:43.210064 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac30499-4fe2-4ffa-999a-01fdf14370c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:43.210347 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac30499-4fe2-4ffa-999a-01fdf14370c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:43.210626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac30499-4fe2-4ffa-999a-01fdf14370c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:43.224160 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac30499-4fe2-4ffa-999a-01fdf14370c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:43.225632 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac30499-4fe2-4ffa-999a-01fdf14370c3 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:43.239404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1369/2731] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:19:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:19:43.668622 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11f28a-2750-41e4-9efd-7b2dbbd78868 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:43.686115 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:43.737110 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11f28a-2750-41e4-9efd-7b2dbbd78868 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:43.741757 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880ff8b-122c-4773-9476-8f0728b7fe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:43.742585 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880ff8b-122c-4773-9476-8f0728b7fe22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:43.742870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880ff8b-122c-4773-9476-8f0728b7fe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:43.743160 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880ff8b-122c-4773-9476-8f0728b7fe22 admin admin] PATH_INFO: `/v3/users/afe6265f02664e7ea8795e9f1bab3c6c` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:43.744339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880ff8b-122c-4773-9476-8f0728b7fe22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe6265f02664e7ea8795e9f1bab3c6c)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:43.746763 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880ff8b-122c-4773-9476-8f0728b7fe22 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:43.798789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2880ff8b-122c-4773-9476-8f0728b7fe22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe6265f02664e7ea8795e9f1bab3c6c'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:43.806536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2880ff8b-122c-4773-9476-8f0728b7fe22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe6265f02664e7ea8795e9f1bab3c6c'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:43.819665 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2880ff8b-122c-4773-9476-8f0728b7fe22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe6265f02664e7ea8795e9f1bab3c6c'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:43.820542 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2880ff8b-122c-4773-9476-8f0728b7fe22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe6265f02664e7ea8795e9f1bab3c6c'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:43.821162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2880ff8b-122c-4773-9476-8f0728b7fe22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe6265f02664e7ea8795e9f1bab3c6c'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:43.835949 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1363/2732] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:19:43 2022] DELETE /identity/v3/users/afe6265f02664e7ea8795e9f1bab3c6c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:43.840471 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01549a0b-6c96-43aa-95ba-c86a28de3a7f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:43.840946 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01549a0b-6c96-43aa-95ba-c86a28de3a7f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:43.841048 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01549a0b-6c96-43aa-95ba-c86a28de3a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:43.861403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-01549a0b-6c96-43aa-95ba-c86a28de3a7f None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:43.862718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-01549a0b-6c96-43aa-95ba-c86a28de3a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:43.929829 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1370/2733] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:43.939532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880ff8b-122c-4773-9476-8f0728b7fe22 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:43.940968 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-2880ff8b-122c-4773-9476-8f0728b7fe22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:44.000252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880ff8b-122c-4773-9476-8f0728b7fe22 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:44.004041 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe4f04-a0ce-48c0-ae42-8b6fce944bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:44.004682 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe4f04-a0ce-48c0-ae42-8b6fce944bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:44.004964 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe4f04-a0ce-48c0-ae42-8b6fce944bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:44.005238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe4f04-a0ce-48c0-ae42-8b6fce944bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:44.014593 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe4f04-a0ce-48c0-ae42-8b6fce944bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:44.016089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe4f04-a0ce-48c0-ae42-8b6fce944bb8 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:44.026681 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1364/2734] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:19:44.298790 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01549a0b-6c96-43aa-95ba-c86a28de3a7f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:44.301100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-01549a0b-6c96-43aa-95ba-c86a28de3a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:44.330098 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01549a0b-6c96-43aa-95ba-c86a28de3a7f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:44.335395 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a735ed-307b-47d4-a272-492f8ebdac24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:44.336258 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a735ed-307b-47d4-a272-492f8ebdac24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:44.336573 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a735ed-307b-47d4-a272-492f8ebdac24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:44.336859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a735ed-307b-47d4-a272-492f8ebdac24 admin admin] PATH_INFO: `/v3/projects/2fa25a8e4cd4489a9b804806be3a2db8` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:44.338091 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a735ed-307b-47d4-a272-492f8ebdac24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fa25a8e4cd4489a9b804806be3a2db8)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:44.340007 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a735ed-307b-47d4-a272-492f8ebdac24 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:44.350555 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:44.399563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b4a735ed-307b-47d4-a272-492f8ebdac24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fa25a8e4cd4489a9b804806be3a2db8', 'request_id': 'req-b4a735ed-307b-47d4-a272-492f8ebdac24'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:44.408480 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b4a735ed-307b-47d4-a272-492f8ebdac24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fa25a8e4cd4489a9b804806be3a2db8', 'request_id': 'req-b4a735ed-307b-47d4-a272-492f8ebdac24'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:44.425477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b4a735ed-307b-47d4-a272-492f8ebdac24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fa25a8e4cd4489a9b804806be3a2db8', 'request_id': 'req-b4a735ed-307b-47d4-a272-492f8ebdac24'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:44.443575 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b4a735ed-307b-47d4-a272-492f8ebdac24 admin admin] The token cache is being invalidate because project 2fa25a8e4cd4489a9b804806be3a2db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:19:44.443706 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b4a735ed-307b-47d4-a272-492f8ebdac24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:44.444473 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-b4a735ed-307b-47d4-a272-492f8ebdac24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:44.447640 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1371/2735] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:19:44 2022] DELETE /identity/v3/projects/2fa25a8e4cd4489a9b804806be3a2db8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:44.451602 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe4f04-a0ce-48c0-ae42-8b6fce944bb8 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:44.461178 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe4f04-a0ce-48c0-ae42-8b6fce944bb8 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:44.496378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:44.523769 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db3d9b-7d35-4808-86c7-70c4bc2cef36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:44.524677 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db3d9b-7d35-4808-86c7-70c4bc2cef36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:44.524963 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db3d9b-7d35-4808-86c7-70c4bc2cef36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:44.525251 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db3d9b-7d35-4808-86c7-70c4bc2cef36 admin admin] PATH_INFO: `/v3/users/e3f049ac3f0242eb91b96bc149ffd946` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:44.526547 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db3d9b-7d35-4808-86c7-70c4bc2cef36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3f049ac3f0242eb91b96bc149ffd946)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:44.528549 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82db3d9b-7d35-4808-86c7-70c4bc2cef36 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:44.581608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-82db3d9b-7d35-4808-86c7-70c4bc2cef36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3f049ac3f0242eb91b96bc149ffd946'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:44.589153 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-82db3d9b-7d35-4808-86c7-70c4bc2cef36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3f049ac3f0242eb91b96bc149ffd946'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:44.605536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-82db3d9b-7d35-4808-86c7-70c4bc2cef36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3f049ac3f0242eb91b96bc149ffd946'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:44.606420 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-82db3d9b-7d35-4808-86c7-70c4bc2cef36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3f049ac3f0242eb91b96bc149ffd946'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:44.607109 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-82db3d9b-7d35-4808-86c7-70c4bc2cef36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3f049ac3f0242eb91b96bc149ffd946'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:44.624018 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1365/2736] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:19:44 2022] DELETE /identity/v3/users/e3f049ac3f0242eb91b96bc149ffd946 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:44.961379 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a735ed-307b-47d4-a272-492f8ebdac24 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:44.963286 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b4a735ed-307b-47d4-a272-492f8ebdac24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:44.978116 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a735ed-307b-47d4-a272-492f8ebdac24 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:45.056937 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb2557-4918-433d-8948-bde20ef29450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:45.058230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb2557-4918-433d-8948-bde20ef29450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:45.058511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb2557-4918-433d-8948-bde20ef29450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:45.058787 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb2557-4918-433d-8948-bde20ef29450 admin admin] PATH_INFO: `/v3/projects/5ebf44b669064c92bbb44a9757569ee8` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:45.060883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb2557-4918-433d-8948-bde20ef29450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ebf44b669064c92bbb44a9757569ee8)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:45.063278 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb2557-4918-433d-8948-bde20ef29450 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:45.119220 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-74bb2557-4918-433d-8948-bde20ef29450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ebf44b669064c92bbb44a9757569ee8', 'request_id': 'req-74bb2557-4918-433d-8948-bde20ef29450'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:45.128796 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-74bb2557-4918-433d-8948-bde20ef29450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ebf44b669064c92bbb44a9757569ee8', 'request_id': 'req-74bb2557-4918-433d-8948-bde20ef29450'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:45.136070 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-74bb2557-4918-433d-8948-bde20ef29450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ebf44b669064c92bbb44a9757569ee8', 'request_id': 'req-74bb2557-4918-433d-8948-bde20ef29450'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:45.149152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-74bb2557-4918-433d-8948-bde20ef29450 admin admin] The token cache is being invalidate because project 5ebf44b669064c92bbb44a9757569ee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:19:45.149428 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-74bb2557-4918-433d-8948-bde20ef29450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:45.150214 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-74bb2557-4918-433d-8948-bde20ef29450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:19:45.151825 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1372/2737] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:19:44 2022] DELETE /identity/v3/projects/5ebf44b669064c92bbb44a9757569ee8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:45.157175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64062884-ce96-4f93-aac8-a258efa9e5af None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:45.157896 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64062884-ce96-4f93-aac8-a258efa9e5af None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:45.157896 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64062884-ce96-4f93-aac8-a258efa9e5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:45.179280 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-64062884-ce96-4f93-aac8-a258efa9e5af None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:45.180649 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-64062884-ce96-4f93-aac8-a258efa9e5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:45.248563 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1366/2738] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:45.257183 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca471b-1526-4b77-bd73-0db7450bc75b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:45.257472 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca471b-1526-4b77-bd73-0db7450bc75b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:45.257789 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca471b-1526-4b77-bd73-0db7450bc75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:45.277621 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-4bca471b-1526-4b77-bd73-0db7450bc75b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:45.279000 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4bca471b-1526-4b77-bd73-0db7450bc75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:45.287234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1373/2739] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:45.291571 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64062884-ce96-4f93-aac8-a258efa9e5af None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:45.301546 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64062884-ce96-4f93-aac8-a258efa9e5af None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:45.306517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef43b9d-490b-487d-b33d-520e39d60b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:45.307187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef43b9d-490b-487d-b33d-520e39d60b5e admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:45.307469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef43b9d-490b-487d-b33d-520e39d60b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:45.307742 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef43b9d-490b-487d-b33d-520e39d60b5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:45.308516 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef43b9d-490b-487d-b33d-520e39d60b5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:19:45.308822 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef43b9d-490b-487d-b33d-520e39d60b5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:45.310477 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef43b9d-490b-487d-b33d-520e39d60b5e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:45.324365 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1367/2740] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:19:45.328710 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca471b-1526-4b77-bd73-0db7450bc75b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:45.339063 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca471b-1526-4b77-bd73-0db7450bc75b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:45.344255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecedba0-a794-46a8-ad7e-3e4b3f082bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:45.345203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecedba0-a794-46a8-ad7e-3e4b3f082bdf admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:45.345822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecedba0-a794-46a8-ad7e-3e4b3f082bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:45.345822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecedba0-a794-46a8-ad7e-3e4b3f082bdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:45.346517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecedba0-a794-46a8-ad7e-3e4b3f082bdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:45.348432 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecedba0-a794-46a8-ad7e-3e4b3f082bdf admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:45.370914 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:45.381440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1374/2741] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:19:45 2022] POST /identity/v3/projects => generated 407 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:19:45.385635 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef43b9d-490b-487d-b33d-520e39d60b5e admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:45.396213 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef43b9d-490b-487d-b33d-520e39d60b5e admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:45.441738 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:45.459891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b441814-2419-45c5-b70b-1cd6f630df1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:45.460575 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b441814-2419-45c5-b70b-1cd6f630df1a admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:45.460862 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b441814-2419-45c5-b70b-1cd6f630df1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:45.461142 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b441814-2419-45c5-b70b-1cd6f630df1a admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:45.461898 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b441814-2419-45c5-b70b-1cd6f630df1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:45.463891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b441814-2419-45c5-b70b-1cd6f630df1a admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:45.489998 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1368/2742] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:19:45 2022] POST /identity/v3/users => generated 304 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:19:45.491754 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecedba0-a794-46a8-ad7e-3e4b3f082bdf admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:45.503224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecedba0-a794-46a8-ad7e-3e4b3f082bdf admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:45.508188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f4a82-31b5-41f6-9e5e-d95d82d9b6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:45.508977 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f4a82-31b5-41f6-9e5e-d95d82d9b6df admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:45.509267 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f4a82-31b5-41f6-9e5e-d95d82d9b6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:45.509544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f4a82-31b5-41f6-9e5e-d95d82d9b6df admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:45.510316 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f4a82-31b5-41f6-9e5e-d95d82d9b6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:45.511942 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f4a82-31b5-41f6-9e5e-d95d82d9b6df admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:45.523203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1375/2743] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:19:45.527522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b441814-2419-45c5-b70b-1cd6f630df1a admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:45.539431 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b441814-2419-45c5-b70b-1cd6f630df1a admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:45.544537 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517b41c-b992-4e23-a265-12375d5bd604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:45.545238 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517b41c-b992-4e23-a265-12375d5bd604 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:45.545522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517b41c-b992-4e23-a265-12375d5bd604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:45.545822 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517b41c-b992-4e23-a265-12375d5bd604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:45.546551 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517b41c-b992-4e23-a265-12375d5bd604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:45.548751 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517b41c-b992-4e23-a265-12375d5bd604 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:45.559532 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1369/2744] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:19:45.564043 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f4a82-31b5-41f6-9e5e-d95d82d9b6df admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:45.574910 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f4a82-31b5-41f6-9e5e-d95d82d9b6df admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:45.579549 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efbea1-9ebd-4f6c-8d78-8b97118e215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:45.580594 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efbea1-9ebd-4f6c-8d78-8b97118e215a admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:45.580897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efbea1-9ebd-4f6c-8d78-8b97118e215a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:45.581169 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efbea1-9ebd-4f6c-8d78-8b97118e215a admin admin] PATH_INFO: `/v3/projects/c9cc9bb4560f49809b2612b1be8aa84d/users/92896cd280b341b99680be7c2e72f104/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:45.596891 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efbea1-9ebd-4f6c-8d78-8b97118e215a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9cc9bb4560f49809b2612b1be8aa84d, user_id=92896cd280b341b99680be7c2e72f104, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:45.599644 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efbea1-9ebd-4f6c-8d78-8b97118e215a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:45.614006 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1376/2745] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:19:45 2022] PUT /identity/v3/projects/c9cc9bb4560f49809b2612b1be8aa84d/users/92896cd280b341b99680be7c2e72f104/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:45.624832 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59890b-9839-48b7-aaed-b2b9f420317c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:45.625042 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59890b-9839-48b7-aaed-b2b9f420317c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:45.625328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59890b-9839-48b7-aaed-b2b9f420317c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:45.653860 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-3e59890b-9839-48b7-aaed-b2b9f420317c None None] MFA Rules not processed for user `92896cd280b341b99680be7c2e72f104`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:45.655088 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3e59890b-9839-48b7-aaed-b2b9f420317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:45.723639 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1370/2746] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:45.728155 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efbea1-9ebd-4f6c-8d78-8b97118e215a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:45.789259 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efbea1-9ebd-4f6c-8d78-8b97118e215a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:45.793887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acb59e-f1ae-4ef4-9dc7-714c72a87533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:45.794540 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acb59e-f1ae-4ef4-9dc7-714c72a87533 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:45.794822 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acb59e-f1ae-4ef4-9dc7-714c72a87533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:45.795094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acb59e-f1ae-4ef4-9dc7-714c72a87533 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:45.795790 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6acb59e-f1ae-4ef4-9dc7-714c72a87533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:45.797692 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6acb59e-f1ae-4ef4-9dc7-714c72a87533 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:45.823700 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1377/2747] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:19:45 2022] POST /identity/v3/projects => generated 409 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:19:45.827801 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59890b-9839-48b7-aaed-b2b9f420317c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:45.838598 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59890b-9839-48b7-aaed-b2b9f420317c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:45.897596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf2707-4543-4ee8-8d6c-8b28dd3a5494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:45.898239 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf2707-4543-4ee8-8d6c-8b28dd3a5494 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:45.898520 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf2707-4543-4ee8-8d6c-8b28dd3a5494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:45.898793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf2707-4543-4ee8-8d6c-8b28dd3a5494 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:45.899492 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf2707-4543-4ee8-8d6c-8b28dd3a5494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:45.901437 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf2707-4543-4ee8-8d6c-8b28dd3a5494 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:45.922101 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1371/2748] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:19:45 2022] POST /identity/v3/users => generated 311 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:19:45.927582 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acb59e-f1ae-4ef4-9dc7-714c72a87533 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:45.938279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acb59e-f1ae-4ef4-9dc7-714c72a87533 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:45.943267 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3afd8-b20b-4789-a381-7566ae2f55c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:45.943928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3afd8-b20b-4789-a381-7566ae2f55c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:45.944216 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3afd8-b20b-4789-a381-7566ae2f55c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:45.944500 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3afd8-b20b-4789-a381-7566ae2f55c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:45.945231 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3afd8-b20b-4789-a381-7566ae2f55c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:45.946883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3afd8-b20b-4789-a381-7566ae2f55c3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:45.957873 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1378/2749] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:19:45.962065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf2707-4543-4ee8-8d6c-8b28dd3a5494 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:45.973510 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf2707-4543-4ee8-8d6c-8b28dd3a5494 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:45.978211 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e0fb1-2c1e-4e4b-876a-ad7be9ce6e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:45.979089 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e0fb1-2c1e-4e4b-876a-ad7be9ce6e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:45.979372 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e0fb1-2c1e-4e4b-876a-ad7be9ce6e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:45.979648 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e0fb1-2c1e-4e4b-876a-ad7be9ce6e96 admin admin] PATH_INFO: `/v3/projects/840710e49cd04f438b48e0d1d94c4f11/users/34a20234900d46b98e530bc069609411/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:45.996036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e0fb1-2c1e-4e4b-876a-ad7be9ce6e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=840710e49cd04f438b48e0d1d94c4f11, user_id=34a20234900d46b98e530bc069609411, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:45.999121 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e0fb1-2c1e-4e4b-876a-ad7be9ce6e96 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:46.012913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1372/2750] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:19:45 2022] PUT /identity/v3/projects/840710e49cd04f438b48e0d1d94c4f11/users/34a20234900d46b98e530bc069609411/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:46.016893 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3afd8-b20b-4789-a381-7566ae2f55c3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:46.027384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3afd8-b20b-4789-a381-7566ae2f55c3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:46.089926 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4a567-2fed-4800-a404-4d975f9b32a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:46.090595 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4a567-2fed-4800-a404-4d975f9b32a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:46.090881 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4a567-2fed-4800-a404-4d975f9b32a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:46.091159 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4a567-2fed-4800-a404-4d975f9b32a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:46.091883 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4a567-2fed-4800-a404-4d975f9b32a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:46.093807 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4a567-2fed-4800-a404-4d975f9b32a5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:46.104699 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1379/2751] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:19:46.108921 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e0fb1-2c1e-4e4b-876a-ad7be9ce6e96 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:46.120011 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e0fb1-2c1e-4e4b-876a-ad7be9ce6e96 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:46.124943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53246e-bd79-48bf-a3bb-0eca76f5180c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:46.125892 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53246e-bd79-48bf-a3bb-0eca76f5180c admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:46.126299 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53246e-bd79-48bf-a3bb-0eca76f5180c admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:46.126807 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53246e-bd79-48bf-a3bb-0eca76f5180c admin admin] PATH_INFO: `/v3/projects/840710e49cd04f438b48e0d1d94c4f11/users/34a20234900d46b98e530bc069609411/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:46.128751 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53246e-bd79-48bf-a3bb-0eca76f5180c admin admin] RBAC: Authorizing `identity:create_grant(project_id=840710e49cd04f438b48e0d1d94c4f11, user_id=34a20234900d46b98e530bc069609411, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:46.131518 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53246e-bd79-48bf-a3bb-0eca76f5180c admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:46.144485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1373/2752] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:19:46 2022] PUT /identity/v3/projects/840710e49cd04f438b48e0d1d94c4f11/users/34a20234900d46b98e530bc069609411/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:19:46.155835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960ed7a-1864-46bd-8773-d534bf2a8a88 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:46.156032 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960ed7a-1864-46bd-8773-d534bf2a8a88 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:46.156323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960ed7a-1864-46bd-8773-d534bf2a8a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:46.184764 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-d960ed7a-1864-46bd-8773-d534bf2a8a88 None None] MFA Rules not processed for user `34a20234900d46b98e530bc069609411`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:46.186035 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d960ed7a-1864-46bd-8773-d534bf2a8a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:46.209749 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:46.262707 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1380/2753] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:46 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:46.273871 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53246e-bd79-48bf-a3bb-0eca76f5180c admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:46.276208 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bc53246e-bd79-48bf-a3bb-0eca76f5180c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:46.283754 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:46.342580 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53246e-bd79-48bf-a3bb-0eca76f5180c admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:46.347295 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0e935-e264-40c6-8bcf-06d375ecf370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:46.347939 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0e935-e264-40c6-8bcf-06d375ecf370 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:46.348222 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0e935-e264-40c6-8bcf-06d375ecf370 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:46.348500 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0e935-e264-40c6-8bcf-06d375ecf370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:46.358131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0e935-e264-40c6-8bcf-06d375ecf370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:46.359565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0e935-e264-40c6-8bcf-06d375ecf370 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:46.369550 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1374/2754] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:19:46 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:19:46.530520 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960ed7a-1864-46bd-8773-d534bf2a8a88 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:46.532000 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-d960ed7a-1864-46bd-8773-d534bf2a8a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:46.545078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960ed7a-1864-46bd-8773-d534bf2a8a88 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:19:46.549143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979a532-25b2-443c-bdb6-8d13e63a55cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:19:46.550054 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979a532-25b2-443c-bdb6-8d13e63a55cd service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:46.550343 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979a532-25b2-443c-bdb6-8d13e63a55cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:46.550618 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979a532-25b2-443c-bdb6-8d13e63a55cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:46.611087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979a532-25b2-443c-bdb6-8d13e63a55cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:19:46.612533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979a532-25b2-443c-bdb6-8d13e63a55cd service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:19:46.621506 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1381/2755] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:19:46 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:19:49.809341 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50828bc9-0d55-492c-8a84-283cd4e50c18 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:49.810259 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50828bc9-0d55-492c-8a84-283cd4e50c18 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:49.810429 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50828bc9-0d55-492c-8a84-283cd4e50c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:49.837033 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-50828bc9-0d55-492c-8a84-283cd4e50c18 None None] MFA Rules not processed for user `53394412ea1f463196acd85c7e11621c`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:49.838318 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-50828bc9-0d55-492c-8a84-283cd4e50c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:49.903722 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1375/2756] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:19:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:56.617547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=47 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:59.796011 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a7d38-3b7e-4345-b9d2-4f73c19ae91d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:19:59.796596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a7d38-3b7e-4345-b9d2-4f73c19ae91d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:19:59.796596 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a7d38-3b7e-4345-b9d2-4f73c19ae91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:19:59.829898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-c79a7d38-3b7e-4345-b9d2-4f73c19ae91d None None] MFA Rules not processed for user `9692d55c8c924544a1bff62054731ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:19:59.831448 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-c79a7d38-3b7e-4345-b9d2-4f73c19ae91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:19:59.896823 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=49 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:59.901647 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1382/2757] 10.222.0.49 () {58 vars in 1009 bytes} [Wed May 18 17:19:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:19:59.964441 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50828bc9-0d55-492c-8a84-283cd4e50c18 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:19:59.966041 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-50828bc9-0d55-492c-8a84-283cd4e50c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:00.065589 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50828bc9-0d55-492c-8a84-283cd4e50c18 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:00.071689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0f640-a3a9-4790-961a-b4af1de44923 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b712c7f5fce54fe2a89d63863f3845f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:00.072436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0f640-a3a9-4790-961a-b4af1de44923 service swift] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:00.072733 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0f640-a3a9-4790-961a-b4af1de44923 service swift] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:00.073015 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0f640-a3a9-4790-961a-b4af1de44923 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:00.083062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0f640-a3a9-4790-961a-b4af1de44923 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:00.084711 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0f640-a3a9-4790-961a-b4af1de44923 service swift] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:00.093822 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1376/2758] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 18 17:19:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 17:20:00.461726 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a7d38-3b7e-4345-b9d2-4f73c19ae91d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:00.539752 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a7d38-3b7e-4345-b9d2-4f73c19ae91d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:00.544642 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cb998-4baa-40bf-b123-92655af81238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:00.545533 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cb998-4baa-40bf-b123-92655af81238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:00.545847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cb998-4baa-40bf-b123-92655af81238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:00.546126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cb998-4baa-40bf-b123-92655af81238 admin admin] PATH_INFO: `/v3/users/92896cd280b341b99680be7c2e72f104` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:00.548404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cb998-4baa-40bf-b123-92655af81238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92896cd280b341b99680be7c2e72f104)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:00.550630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cb998-4baa-40bf-b123-92655af81238 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:00.614392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1e4cb998-4baa-40bf-b123-92655af81238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92896cd280b341b99680be7c2e72f104'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:00.615458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1e4cb998-4baa-40bf-b123-92655af81238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92896cd280b341b99680be7c2e72f104'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:00.629024 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1e4cb998-4baa-40bf-b123-92655af81238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92896cd280b341b99680be7c2e72f104'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:00.642669 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1e4cb998-4baa-40bf-b123-92655af81238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92896cd280b341b99680be7c2e72f104'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:00.661410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-1e4cb998-4baa-40bf-b123-92655af81238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92896cd280b341b99680be7c2e72f104'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:00.674733 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1383/2759] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:20:00 2022] DELETE /identity/v3/users/92896cd280b341b99680be7c2e72f104 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:00.677187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738520ee-c7cd-4a3d-a1a1-b402e801b3a7 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:00.677469 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738520ee-c7cd-4a3d-a1a1-b402e801b3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:00.677768 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738520ee-c7cd-4a3d-a1a1-b402e801b3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:00.698815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-738520ee-c7cd-4a3d-a1a1-b402e801b3a7 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:00.700101 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-738520ee-c7cd-4a3d-a1a1-b402e801b3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:00.806285 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1377/2760] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:00.818750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cb998-4baa-40bf-b123-92655af81238 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:00.820619 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-1e4cb998-4baa-40bf-b123-92655af81238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:00.846976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:00.906644 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cb998-4baa-40bf-b123-92655af81238 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:00.914040 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1538e-6348-4b69-a041-5e78ea927158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:00.915228 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1538e-6348-4b69-a041-5e78ea927158 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:00.915874 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1538e-6348-4b69-a041-5e78ea927158 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:00.916366 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1538e-6348-4b69-a041-5e78ea927158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:00.930377 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1538e-6348-4b69-a041-5e78ea927158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:00.932322 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1538e-6348-4b69-a041-5e78ea927158 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:00.946433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1384/2761] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:20:01.374806 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738520ee-c7cd-4a3d-a1a1-b402e801b3a7 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:01.378834 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-738520ee-c7cd-4a3d-a1a1-b402e801b3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:01.436703 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738520ee-c7cd-4a3d-a1a1-b402e801b3a7 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:01.451514 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2c70a-1029-4b27-b93e-d43fa0ea0f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:01.452686 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2c70a-1029-4b27-b93e-d43fa0ea0f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:01.453077 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2c70a-1029-4b27-b93e-d43fa0ea0f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:01.453462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2c70a-1029-4b27-b93e-d43fa0ea0f53 admin admin] PATH_INFO: `/v3/projects/c9cc9bb4560f49809b2612b1be8aa84d` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:01.455226 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2c70a-1029-4b27-b93e-d43fa0ea0f53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9cc9bb4560f49809b2612b1be8aa84d)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:01.457484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2c70a-1029-4b27-b93e-d43fa0ea0f53 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:01.527583 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dba2c70a-1029-4b27-b93e-d43fa0ea0f53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9cc9bb4560f49809b2612b1be8aa84d', 'request_id': 'req-dba2c70a-1029-4b27-b93e-d43fa0ea0f53'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:01.536776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dba2c70a-1029-4b27-b93e-d43fa0ea0f53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9cc9bb4560f49809b2612b1be8aa84d', 'request_id': 'req-dba2c70a-1029-4b27-b93e-d43fa0ea0f53'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:01.546303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dba2c70a-1029-4b27-b93e-d43fa0ea0f53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9cc9bb4560f49809b2612b1be8aa84d', 'request_id': 'req-dba2c70a-1029-4b27-b93e-d43fa0ea0f53'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:01.562283 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dba2c70a-1029-4b27-b93e-d43fa0ea0f53 admin admin] The token cache is being invalidate because project c9cc9bb4560f49809b2612b1be8aa84d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:20:01.562687 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dba2c70a-1029-4b27-b93e-d43fa0ea0f53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:01.563379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-dba2c70a-1029-4b27-b93e-d43fa0ea0f53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:01.568341 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1378/2762] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:20:01 2022] DELETE /identity/v3/projects/c9cc9bb4560f49809b2612b1be8aa84d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:01.570500 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1538e-6348-4b69-a041-5e78ea927158 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:01.581589 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1538e-6348-4b69-a041-5e78ea927158 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:01.665229 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92390e5-392a-4572-8908-4d765f21be33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:01.666421 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92390e5-392a-4572-8908-4d765f21be33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:01.666734 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92390e5-392a-4572-8908-4d765f21be33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:01.667110 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92390e5-392a-4572-8908-4d765f21be33 admin admin] PATH_INFO: `/v3/users/34a20234900d46b98e530bc069609411` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:01.668719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92390e5-392a-4572-8908-4d765f21be33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a20234900d46b98e530bc069609411)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:01.670708 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92390e5-392a-4572-8908-4d765f21be33 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:01.741699 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c92390e5-392a-4572-8908-4d765f21be33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a20234900d46b98e530bc069609411'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:01.742694 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c92390e5-392a-4572-8908-4d765f21be33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a20234900d46b98e530bc069609411'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:01.752460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c92390e5-392a-4572-8908-4d765f21be33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a20234900d46b98e530bc069609411'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:01.760421 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c92390e5-392a-4572-8908-4d765f21be33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a20234900d46b98e530bc069609411'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:01.777195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c92390e5-392a-4572-8908-4d765f21be33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a20234900d46b98e530bc069609411'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:01.787079 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1385/2763] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:20:01 2022] DELETE /identity/v3/users/34a20234900d46b98e530bc069609411 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:02.153757 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2c70a-1029-4b27-b93e-d43fa0ea0f53 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:02.155594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-dba2c70a-1029-4b27-b93e-d43fa0ea0f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:02.196819 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2c70a-1029-4b27-b93e-d43fa0ea0f53 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:02.211975 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:02.283023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a697a7-56f0-49f5-bbaa-ee2b8b7c0f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:02.284276 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a697a7-56f0-49f5-bbaa-ee2b8b7c0f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:02.284633 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a697a7-56f0-49f5-bbaa-ee2b8b7c0f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:02.284993 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a697a7-56f0-49f5-bbaa-ee2b8b7c0f74 admin admin] PATH_INFO: `/v3/projects/840710e49cd04f438b48e0d1d94c4f11` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:02.286330 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a697a7-56f0-49f5-bbaa-ee2b8b7c0f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=840710e49cd04f438b48e0d1d94c4f11)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:02.288446 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a697a7-56f0-49f5-bbaa-ee2b8b7c0f74 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:02.353568 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-31a697a7-56f0-49f5-bbaa-ee2b8b7c0f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '840710e49cd04f438b48e0d1d94c4f11', 'request_id': 'req-31a697a7-56f0-49f5-bbaa-ee2b8b7c0f74'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:02.362368 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-31a697a7-56f0-49f5-bbaa-ee2b8b7c0f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '840710e49cd04f438b48e0d1d94c4f11', 'request_id': 'req-31a697a7-56f0-49f5-bbaa-ee2b8b7c0f74'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:02.369441 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-31a697a7-56f0-49f5-bbaa-ee2b8b7c0f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '840710e49cd04f438b48e0d1d94c4f11', 'request_id': 'req-31a697a7-56f0-49f5-bbaa-ee2b8b7c0f74'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:02.387738 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-31a697a7-56f0-49f5-bbaa-ee2b8b7c0f74 admin admin] The token cache is being invalidate because project 840710e49cd04f438b48e0d1d94c4f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:20:02.388409 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-31a697a7-56f0-49f5-bbaa-ee2b8b7c0f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:02.388839 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-31a697a7-56f0-49f5-bbaa-ee2b8b7c0f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:02.390706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1379/2764] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:20:02 2022] DELETE /identity/v3/projects/840710e49cd04f438b48e0d1d94c4f11 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:02.395966 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c662c1-cd09-4f9d-bb7a-3c041e21920f None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:02.397163 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c662c1-cd09-4f9d-bb7a-3c041e21920f None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:02.397460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c662c1-cd09-4f9d-bb7a-3c041e21920f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:02.436832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-87c662c1-cd09-4f9d-bb7a-3c041e21920f None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:02.438220 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-87c662c1-cd09-4f9d-bb7a-3c041e21920f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:02.485898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:02.529308 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1386/2765] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:20:02.539896 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd9754-0310-4232-8fe4-1d75dff245df None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:02.540263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd9754-0310-4232-8fe4-1d75dff245df None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:02.540612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd9754-0310-4232-8fe4-1d75dff245df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:02.561719 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-99dd9754-0310-4232-8fe4-1d75dff245df None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:02.563116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-99dd9754-0310-4232-8fe4-1d75dff245df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:02.576087 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1380/2766] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:02.577261 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c662c1-cd09-4f9d-bb7a-3c041e21920f None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:02.596798 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c662c1-cd09-4f9d-bb7a-3c041e21920f None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:02.606299 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418cfc0-e8ac-4eff-8138-d6ee26480822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:02.606636 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418cfc0-e8ac-4eff-8138-d6ee26480822 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:02.606884 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418cfc0-e8ac-4eff-8138-d6ee26480822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:02.607169 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418cfc0-e8ac-4eff-8138-d6ee26480822 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:02.607912 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418cfc0-e8ac-4eff-8138-d6ee26480822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:20:02.608221 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418cfc0-e8ac-4eff-8138-d6ee26480822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:02.610244 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418cfc0-e8ac-4eff-8138-d6ee26480822 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:02.629820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1387/2767] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 18 17:20:02.631486 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd9754-0310-4232-8fe4-1d75dff245df None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:02.642992 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd9754-0310-4232-8fe4-1d75dff245df None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:02.648381 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a7d9f-15d9-4972-80d9-097975ed79c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:02.649181 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a7d9f-15d9-4972-80d9-097975ed79c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:02.649535 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a7d9f-15d9-4972-80d9-097975ed79c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:02.649920 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a7d9f-15d9-4972-80d9-097975ed79c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:02.650944 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a7d9f-15d9-4972-80d9-097975ed79c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:02.652938 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087a7d9f-15d9-4972-80d9-097975ed79c0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:02.696102 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1381/2768] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:20:02 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:20:02.700376 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418cfc0-e8ac-4eff-8138-d6ee26480822 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:02.713996 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418cfc0-e8ac-4eff-8138-d6ee26480822 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:02.789295 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348607f6-56e0-452c-a725-1ebce1afda4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:02.789936 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348607f6-56e0-452c-a725-1ebce1afda4e admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:02.790225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348607f6-56e0-452c-a725-1ebce1afda4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:02.790506 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348607f6-56e0-452c-a725-1ebce1afda4e admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:02.791220 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348607f6-56e0-452c-a725-1ebce1afda4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:02.793191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348607f6-56e0-452c-a725-1ebce1afda4e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:02.821689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1388/2769] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:20:02 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:20:02.823444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a7d9f-15d9-4972-80d9-097975ed79c0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:02.835295 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a7d9f-15d9-4972-80d9-097975ed79c0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:02.840188 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88db87-91a6-42ac-9d3d-b088d00f9268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:02.840886 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88db87-91a6-42ac-9d3d-b088d00f9268 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:02.841171 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88db87-91a6-42ac-9d3d-b088d00f9268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:02.841451 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88db87-91a6-42ac-9d3d-b088d00f9268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:02.842232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88db87-91a6-42ac-9d3d-b088d00f9268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:02.844139 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88db87-91a6-42ac-9d3d-b088d00f9268 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:02.857137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1382/2770] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:20:02.862033 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348607f6-56e0-452c-a725-1ebce1afda4e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:02.873265 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348607f6-56e0-452c-a725-1ebce1afda4e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:02.879557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890305cc-2074-4d67-8e2d-10b714d79630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:02.880362 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890305cc-2074-4d67-8e2d-10b714d79630 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:02.880791 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890305cc-2074-4d67-8e2d-10b714d79630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:02.881168 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890305cc-2074-4d67-8e2d-10b714d79630 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:02.882014 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890305cc-2074-4d67-8e2d-10b714d79630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:02.883852 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890305cc-2074-4d67-8e2d-10b714d79630 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:02.895836 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1389/2771] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:20:02.900375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88db87-91a6-42ac-9d3d-b088d00f9268 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:02.911310 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88db87-91a6-42ac-9d3d-b088d00f9268 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:02.916105 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef5179-81c5-4b7c-a856-f1411175c1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:02.917044 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef5179-81c5-4b7c-a856-f1411175c1e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:02.917403 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef5179-81c5-4b7c-a856-f1411175c1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:02.917709 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef5179-81c5-4b7c-a856-f1411175c1e5 admin admin] PATH_INFO: `/v3/projects/97d38c99509f4209921ebf564a048c29/users/0a4eea85159044b6b0f5a7c1d361c9f1/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:02.934709 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef5179-81c5-4b7c-a856-f1411175c1e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d38c99509f4209921ebf564a048c29, user_id=0a4eea85159044b6b0f5a7c1d361c9f1, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:02.937413 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef5179-81c5-4b7c-a856-f1411175c1e5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:02.956186 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1383/2772] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:20:02 2022] PUT /identity/v3/projects/97d38c99509f4209921ebf564a048c29/users/0a4eea85159044b6b0f5a7c1d361c9f1/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:02.975629 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb02a6-821c-430e-99da-558d6e50f1bf None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:02.977327 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb02a6-821c-430e-99da-558d6e50f1bf None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:02.977611 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb02a6-821c-430e-99da-558d6e50f1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:03.038281 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-bcfb02a6-821c-430e-99da-558d6e50f1bf None None] MFA Rules not processed for user `0a4eea85159044b6b0f5a7c1d361c9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:03.039958 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-bcfb02a6-821c-430e-99da-558d6e50f1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:03.135517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1390/2773] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:03.140063 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef5179-81c5-4b7c-a856-f1411175c1e5 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:03.199130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:03.240746 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef5179-81c5-4b7c-a856-f1411175c1e5 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:03.248366 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf1f3e-1e91-4ce4-8b95-e8bae2ef77b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:03.249845 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf1f3e-1e91-4ce4-8b95-e8bae2ef77b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:03.250306 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf1f3e-1e91-4ce4-8b95-e8bae2ef77b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:03.250725 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf1f3e-1e91-4ce4-8b95-e8bae2ef77b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:03.251774 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf1f3e-1e91-4ce4-8b95-e8bae2ef77b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:03.254598 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf1f3e-1e91-4ce4-8b95-e8bae2ef77b0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:03.296794 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1384/2774] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:20:03 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:20:03.300135 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb02a6-821c-430e-99da-558d6e50f1bf None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:03.316073 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb02a6-821c-430e-99da-558d6e50f1bf None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:03.355214 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:03.401338 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91d2aa-e8a2-43f2-9636-c6f3a0f7b4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:03.402451 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91d2aa-e8a2-43f2-9636-c6f3a0f7b4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:03.402451 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91d2aa-e8a2-43f2-9636-c6f3a0f7b4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:03.403214 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91d2aa-e8a2-43f2-9636-c6f3a0f7b4c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:03.403450 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91d2aa-e8a2-43f2-9636-c6f3a0f7b4c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:03.405362 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91d2aa-e8a2-43f2-9636-c6f3a0f7b4c6 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:03.430563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1391/2775] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:20:03 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:20:03.433423 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf1f3e-1e91-4ce4-8b95-e8bae2ef77b0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:03.447796 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf1f3e-1e91-4ce4-8b95-e8bae2ef77b0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:03.452793 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301003a0-5d6f-4aac-85d0-3bf7b6ff1ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:03.453521 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301003a0-5d6f-4aac-85d0-3bf7b6ff1ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:03.455049 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301003a0-5d6f-4aac-85d0-3bf7b6ff1ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:03.455049 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301003a0-5d6f-4aac-85d0-3bf7b6ff1ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:03.456365 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301003a0-5d6f-4aac-85d0-3bf7b6ff1ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:03.459216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301003a0-5d6f-4aac-85d0-3bf7b6ff1ab1 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:03.476895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1385/2776] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:20:03.480885 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91d2aa-e8a2-43f2-9636-c6f3a0f7b4c6 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:03.492194 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91d2aa-e8a2-43f2-9636-c6f3a0f7b4c6 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:03.497370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224225b-e90c-4af6-b582-2dc6eee18250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:03.498124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224225b-e90c-4af6-b582-2dc6eee18250 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:03.498534 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224225b-e90c-4af6-b582-2dc6eee18250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:03.498718 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224225b-e90c-4af6-b582-2dc6eee18250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:03.499527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224225b-e90c-4af6-b582-2dc6eee18250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:03.501231 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224225b-e90c-4af6-b582-2dc6eee18250 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:03.512928 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1392/2777] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:20:03.518190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301003a0-5d6f-4aac-85d0-3bf7b6ff1ab1 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:03.529379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301003a0-5d6f-4aac-85d0-3bf7b6ff1ab1 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:03.536191 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184eb6b-8627-4458-81ce-61f3293e120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:03.537131 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184eb6b-8627-4458-81ce-61f3293e120f admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:03.537440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184eb6b-8627-4458-81ce-61f3293e120f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:03.537698 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184eb6b-8627-4458-81ce-61f3293e120f admin admin] PATH_INFO: `/v3/projects/7623c96e797a4b649ccb54e90caf7086/users/11ddcdb75c434fec88339a2536545117/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:03.555274 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184eb6b-8627-4458-81ce-61f3293e120f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7623c96e797a4b649ccb54e90caf7086, user_id=11ddcdb75c434fec88339a2536545117, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:03.558264 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184eb6b-8627-4458-81ce-61f3293e120f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:03.573842 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1386/2778] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:20:03 2022] PUT /identity/v3/projects/7623c96e797a4b649ccb54e90caf7086/users/11ddcdb75c434fec88339a2536545117/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:20:03.585534 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e404501-c227-42f8-8ff1-fcdef3535611 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:03.585886 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e404501-c227-42f8-8ff1-fcdef3535611 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:03.586171 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e404501-c227-42f8-8ff1-fcdef3535611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:03.632305 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-0e404501-c227-42f8-8ff1-fcdef3535611 None None] MFA Rules not processed for user `11ddcdb75c434fec88339a2536545117`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:03.633572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-0e404501-c227-42f8-8ff1-fcdef3535611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:03.725643 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1393/2779] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:03.729821 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184eb6b-8627-4458-81ce-61f3293e120f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:03.850328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184eb6b-8627-4458-81ce-61f3293e120f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:03.864757 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18599149-f4b9-4c73-8435-45ca0675734d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:03.865415 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18599149-f4b9-4c73-8435-45ca0675734d admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:03.865757 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18599149-f4b9-4c73-8435-45ca0675734d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:03.866186 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18599149-f4b9-4c73-8435-45ca0675734d admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:03.867148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18599149-f4b9-4c73-8435-45ca0675734d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:03.869160 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18599149-f4b9-4c73-8435-45ca0675734d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:03.905784 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1387/2780] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:20:03 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:20:03.906925 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e404501-c227-42f8-8ff1-fcdef3535611 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:03.919851 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e404501-c227-42f8-8ff1-fcdef3535611 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:03.998511 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b9266-06ea-4db7-8ba0-8c982af934e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:03.999268 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b9266-06ea-4db7-8ba0-8c982af934e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:03.999559 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b9266-06ea-4db7-8ba0-8c982af934e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:03.999863 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b9266-06ea-4db7-8ba0-8c982af934e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:04.001076 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b9266-06ea-4db7-8ba0-8c982af934e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:04.003032 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b9266-06ea-4db7-8ba0-8c982af934e5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:04.030018 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1394/2781] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:20:03 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:20:04.031787 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18599149-f4b9-4c73-8435-45ca0675734d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:04.043226 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18599149-f4b9-4c73-8435-45ca0675734d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:04.048295 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a1b8c-681d-4b3d-9abb-856a0f85d846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:04.048995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a1b8c-681d-4b3d-9abb-856a0f85d846 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:04.049426 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a1b8c-681d-4b3d-9abb-856a0f85d846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:04.049970 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a1b8c-681d-4b3d-9abb-856a0f85d846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:04.050766 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a1b8c-681d-4b3d-9abb-856a0f85d846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:04.052453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a1b8c-681d-4b3d-9abb-856a0f85d846 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:04.078043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1388/2782] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:20:04.084501 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b9266-06ea-4db7-8ba0-8c982af934e5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:04.096474 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b9266-06ea-4db7-8ba0-8c982af934e5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:04.101509 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b862a-7be7-4ef0-a50f-a3b2c6a0b20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:04.102460 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b862a-7be7-4ef0-a50f-a3b2c6a0b20a admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:04.102740 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b862a-7be7-4ef0-a50f-a3b2c6a0b20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:04.103008 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b862a-7be7-4ef0-a50f-a3b2c6a0b20a admin admin] PATH_INFO: `/v3/projects/cb96970f2f1e4299b692e1c37c0affd0/users/61daf7626e804766898c439bffdff34f/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:04.120347 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b862a-7be7-4ef0-a50f-a3b2c6a0b20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb96970f2f1e4299b692e1c37c0affd0, user_id=61daf7626e804766898c439bffdff34f, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:04.123816 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b862a-7be7-4ef0-a50f-a3b2c6a0b20a admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:04.142303 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1395/2783] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:20:04 2022] PUT /identity/v3/projects/cb96970f2f1e4299b692e1c37c0affd0/users/61daf7626e804766898c439bffdff34f/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:04.146387 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a1b8c-681d-4b3d-9abb-856a0f85d846 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:04.159167 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a1b8c-681d-4b3d-9abb-856a0f85d846 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:04.231949 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd539a69-be45-4fdb-a5c2-2e8bc763e4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:04.232899 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd539a69-be45-4fdb-a5c2-2e8bc763e4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:04.233453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd539a69-be45-4fdb-a5c2-2e8bc763e4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:04.233890 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd539a69-be45-4fdb-a5c2-2e8bc763e4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:04.235308 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd539a69-be45-4fdb-a5c2-2e8bc763e4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:04.237377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd539a69-be45-4fdb-a5c2-2e8bc763e4b6 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:04.244021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:04.256633 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b862a-7be7-4ef0-a50f-a3b2c6a0b20a admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:04.257056 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1389/2784] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:20:04.272608 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b862a-7be7-4ef0-a50f-a3b2c6a0b20a admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:04.278416 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ded66a-8897-48dc-a214-16d4f362c86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:04.279553 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ded66a-8897-48dc-a214-16d4f362c86e admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:04.279901 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ded66a-8897-48dc-a214-16d4f362c86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:04.280254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ded66a-8897-48dc-a214-16d4f362c86e admin admin] PATH_INFO: `/v3/projects/cb96970f2f1e4299b692e1c37c0affd0/users/61daf7626e804766898c439bffdff34f/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:04.283234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ded66a-8897-48dc-a214-16d4f362c86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb96970f2f1e4299b692e1c37c0affd0, user_id=61daf7626e804766898c439bffdff34f, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:04.286279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ded66a-8897-48dc-a214-16d4f362c86e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:04.289074 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:04.313707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9210079-7b86-4b4d-b81a-635039c1fccf None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:04.313968 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9210079-7b86-4b4d-b81a-635039c1fccf None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:04.314339 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9210079-7b86-4b4d-b81a-635039c1fccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:04.315885 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1396/2785] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:20:04 2022] PUT /identity/v3/projects/cb96970f2f1e4299b692e1c37c0affd0/users/61daf7626e804766898c439bffdff34f/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:04.348943 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-c9210079-7b86-4b4d-b81a-635039c1fccf None None] MFA Rules not processed for user `61daf7626e804766898c439bffdff34f`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:04.350302 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c9210079-7b86-4b4d-b81a-635039c1fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:04.442913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1390/2786] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:04.456436 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ded66a-8897-48dc-a214-16d4f362c86e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:04.459120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-79ded66a-8897-48dc-a214-16d4f362c86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:04.563464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ded66a-8897-48dc-a214-16d4f362c86e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:04.570172 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f586f-09f3-448e-b1c8-bbb054f41756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:04.571402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f586f-09f3-448e-b1c8-bbb054f41756 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:04.571837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f586f-09f3-448e-b1c8-bbb054f41756 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:04.572202 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f586f-09f3-448e-b1c8-bbb054f41756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:04.588402 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f586f-09f3-448e-b1c8-bbb054f41756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:04.591057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f586f-09f3-448e-b1c8-bbb054f41756 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:04.610538 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1397/2787] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:20:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:20:04.666916 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9210079-7b86-4b4d-b81a-635039c1fccf None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:04.668731 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c9210079-7b86-4b4d-b81a-635039c1fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:04.684474 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9210079-7b86-4b4d-b81a-635039c1fccf None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:04.690870 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d727420-8ec0-4fb3-b3a6-4e456a998df5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:04.691638 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d727420-8ec0-4fb3-b3a6-4e456a998df5 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:04.691917 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d727420-8ec0-4fb3-b3a6-4e456a998df5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:04.692231 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d727420-8ec0-4fb3-b3a6-4e456a998df5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:04.772288 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d727420-8ec0-4fb3-b3a6-4e456a998df5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:04.774891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d727420-8ec0-4fb3-b3a6-4e456a998df5 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:04.789036 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1391/2788] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:20:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:20:08.027864 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f586f-09f3-448e-b1c8-bbb054f41756 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:08.117716 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d727420-8ec0-4fb3-b3a6-4e456a998df5 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:08.121213 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9d727420-8ec0-4fb3-b3a6-4e456a998df5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:08.156668 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f586f-09f3-448e-b1c8-bbb054f41756 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:08.164616 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9895b-3f33-4bb1-9451-6bcf41e76f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:08.165875 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9895b-3f33-4bb1-9451-6bcf41e76f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:08.166583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9895b-3f33-4bb1-9451-6bcf41e76f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:08.167026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9895b-3f33-4bb1-9451-6bcf41e76f38 admin admin] PATH_INFO: `/v3/users/0a4eea85159044b6b0f5a7c1d361c9f1` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:08.168495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9895b-3f33-4bb1-9451-6bcf41e76f38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4eea85159044b6b0f5a7c1d361c9f1)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:08.171808 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9895b-3f33-4bb1-9451-6bcf41e76f38 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:08.255154 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-22e9895b-3f33-4bb1-9451-6bcf41e76f38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4eea85159044b6b0f5a7c1d361c9f1'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:08.256408 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-22e9895b-3f33-4bb1-9451-6bcf41e76f38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4eea85159044b6b0f5a7c1d361c9f1'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:08.270235 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-22e9895b-3f33-4bb1-9451-6bcf41e76f38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4eea85159044b6b0f5a7c1d361c9f1'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:08.293713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-22e9895b-3f33-4bb1-9451-6bcf41e76f38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4eea85159044b6b0f5a7c1d361c9f1'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:08.315536 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-22e9895b-3f33-4bb1-9451-6bcf41e76f38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4eea85159044b6b0f5a7c1d361c9f1'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:08.324586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1398/2789] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:20:08 2022] DELETE /identity/v3/users/0a4eea85159044b6b0f5a7c1d361c9f1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:08.329770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ebfeb-7463-4804-bf46-a45d1f83751b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:08.330191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ebfeb-7463-4804-bf46-a45d1f83751b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:08.330613 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ebfeb-7463-4804-bf46-a45d1f83751b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:08.336049 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d727420-8ec0-4fb3-b3a6-4e456a998df5 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:08.339957 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:08.354887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-183ebfeb-7463-4804-bf46-a45d1f83751b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:08.356141 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-183ebfeb-7463-4804-bf46-a45d1f83751b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:08.376069 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:08.430894 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57038cbe-c66a-4688-b5f1-41366cdaa0f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bebc8414d01a40c8ab34afa9b1312a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:08.432217 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57038cbe-c66a-4688-b5f1-41366cdaa0f5 service placement] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:08.432760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57038cbe-c66a-4688-b5f1-41366cdaa0f5 service placement] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:08.433459 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57038cbe-c66a-4688-b5f1-41366cdaa0f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:08.435872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-57038cbe-c66a-4688-b5f1-41366cdaa0f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:08.446376 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1399/2790] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:20:08.451028 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57038cbe-c66a-4688-b5f1-41366cdaa0f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:08.452664 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57038cbe-c66a-4688-b5f1-41366cdaa0f5 service placement] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:08.457432 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ebfeb-7463-4804-bf46-a45d1f83751b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:08.459166 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-183ebfeb-7463-4804-bf46-a45d1f83751b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:08.467804 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1392/2791] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:20:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:20:08.571288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ebfeb-7463-4804-bf46-a45d1f83751b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:08.579191 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffb548-11d4-4f06-aa87-2c8b3ac3ffce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:08.580509 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffb548-11d4-4f06-aa87-2c8b3ac3ffce service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:08.580832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffb548-11d4-4f06-aa87-2c8b3ac3ffce service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:08.581141 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffb548-11d4-4f06-aa87-2c8b3ac3ffce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:08.594737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffb548-11d4-4f06-aa87-2c8b3ac3ffce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:08.596980 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffb548-11d4-4f06-aa87-2c8b3ac3ffce service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:08.622569 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1400/2792] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:20:09.242398 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57038cbe-c66a-4688-b5f1-41366cdaa0f5 service placement] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:09.245423 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-57038cbe-c66a-4688-b5f1-41366cdaa0f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:09.263478 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57038cbe-c66a-4688-b5f1-41366cdaa0f5 service placement] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:09.270714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a761f14-80db-45a3-83ce-1d80c6bd4258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:09.271774 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a761f14-80db-45a3-83ce-1d80c6bd4258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:09.272064 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a761f14-80db-45a3-83ce-1d80c6bd4258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:09.272343 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a761f14-80db-45a3-83ce-1d80c6bd4258 admin admin] PATH_INFO: `/v3/projects/97d38c99509f4209921ebf564a048c29` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:09.279593 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a761f14-80db-45a3-83ce-1d80c6bd4258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97d38c99509f4209921ebf564a048c29)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:09.286397 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a761f14-80db-45a3-83ce-1d80c6bd4258 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:09.414439 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8a761f14-80db-45a3-83ce-1d80c6bd4258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97d38c99509f4209921ebf564a048c29', 'request_id': 'req-8a761f14-80db-45a3-83ce-1d80c6bd4258'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:09.420247 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8a761f14-80db-45a3-83ce-1d80c6bd4258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97d38c99509f4209921ebf564a048c29', 'request_id': 'req-8a761f14-80db-45a3-83ce-1d80c6bd4258'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:09.427615 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8a761f14-80db-45a3-83ce-1d80c6bd4258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97d38c99509f4209921ebf564a048c29', 'request_id': 'req-8a761f14-80db-45a3-83ce-1d80c6bd4258'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:09.442320 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8a761f14-80db-45a3-83ce-1d80c6bd4258 admin admin] The token cache is being invalidate because project 97d38c99509f4209921ebf564a048c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:20:09.442513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8a761f14-80db-45a3-83ce-1d80c6bd4258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:09.443194 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8a761f14-80db-45a3-83ce-1d80c6bd4258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:09.445462 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1393/2793] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:20:09 2022] DELETE /identity/v3/projects/97d38c99509f4209921ebf564a048c29 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:09.449293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffb548-11d4-4f06-aa87-2c8b3ac3ffce service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:09.460906 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffb548-11d4-4f06-aa87-2c8b3ac3ffce service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:09.534895 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9a4ab-9995-4c3a-9893-6918ac512927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:09.535782 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9a4ab-9995-4c3a-9893-6918ac512927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:09.536064 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9a4ab-9995-4c3a-9893-6918ac512927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:09.536339 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9a4ab-9995-4c3a-9893-6918ac512927 admin admin] PATH_INFO: `/v3/users/11ddcdb75c434fec88339a2536545117` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:09.537571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9a4ab-9995-4c3a-9893-6918ac512927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ddcdb75c434fec88339a2536545117)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:09.539590 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9a4ab-9995-4c3a-9893-6918ac512927 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:09.596291 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2bb9a4ab-9995-4c3a-9893-6918ac512927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ddcdb75c434fec88339a2536545117'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:09.597287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2bb9a4ab-9995-4c3a-9893-6918ac512927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ddcdb75c434fec88339a2536545117'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:09.606115 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2bb9a4ab-9995-4c3a-9893-6918ac512927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ddcdb75c434fec88339a2536545117'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:09.615470 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:09.617874 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2bb9a4ab-9995-4c3a-9893-6918ac512927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ddcdb75c434fec88339a2536545117'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:09.635045 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-2bb9a4ab-9995-4c3a-9893-6918ac512927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ddcdb75c434fec88339a2536545117'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:09.643737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1401/2794] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:20:09 2022] DELETE /identity/v3/users/11ddcdb75c434fec88339a2536545117 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:10.006820 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a761f14-80db-45a3-83ce-1d80c6bd4258 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:10.008800 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8a761f14-80db-45a3-83ce-1d80c6bd4258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:10.039312 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a761f14-80db-45a3-83ce-1d80c6bd4258 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:10.158059 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30e148-ed37-435d-a057-57e2679c577f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:10.159022 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30e148-ed37-435d-a057-57e2679c577f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:10.159317 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30e148-ed37-435d-a057-57e2679c577f admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:10.159600 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30e148-ed37-435d-a057-57e2679c577f admin admin] PATH_INFO: `/v3/projects/7623c96e797a4b649ccb54e90caf7086` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:10.160966 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30e148-ed37-435d-a057-57e2679c577f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7623c96e797a4b649ccb54e90caf7086)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:10.163210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30e148-ed37-435d-a057-57e2679c577f admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:10.199327 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:10.243477 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8e30e148-ed37-435d-a057-57e2679c577f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7623c96e797a4b649ccb54e90caf7086', 'request_id': 'req-8e30e148-ed37-435d-a057-57e2679c577f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:10.255095 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8e30e148-ed37-435d-a057-57e2679c577f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7623c96e797a4b649ccb54e90caf7086', 'request_id': 'req-8e30e148-ed37-435d-a057-57e2679c577f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:10.263545 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8e30e148-ed37-435d-a057-57e2679c577f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7623c96e797a4b649ccb54e90caf7086', 'request_id': 'req-8e30e148-ed37-435d-a057-57e2679c577f'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:10.291913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8e30e148-ed37-435d-a057-57e2679c577f admin admin] The token cache is being invalidate because project 7623c96e797a4b649ccb54e90caf7086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:20:10.292267 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8e30e148-ed37-435d-a057-57e2679c577f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:10.299807 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-8e30e148-ed37-435d-a057-57e2679c577f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:10.301697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1394/2795] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:20:10 2022] DELETE /identity/v3/projects/7623c96e797a4b649ccb54e90caf7086 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:10.306047 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9a4ab-9995-4c3a-9893-6918ac512927 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:10.308458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2bb9a4ab-9995-4c3a-9893-6918ac512927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:10.333922 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9a4ab-9995-4c3a-9893-6918ac512927 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:10.446248 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433248e-a5e7-4fad-8347-d11c37e4117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:10.447142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433248e-a5e7-4fad-8347-d11c37e4117e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:10.447649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433248e-a5e7-4fad-8347-d11c37e4117e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:10.447764 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433248e-a5e7-4fad-8347-d11c37e4117e admin admin] PATH_INFO: `/v3/users/61daf7626e804766898c439bffdff34f` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:10.450522 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433248e-a5e7-4fad-8347-d11c37e4117e admin admin] RBAC: Authorizing `identity:delete_user(user_id=61daf7626e804766898c439bffdff34f)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:10.452459 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433248e-a5e7-4fad-8347-d11c37e4117e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:10.513199 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c433248e-a5e7-4fad-8347-d11c37e4117e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61daf7626e804766898c439bffdff34f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:10.513957 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c433248e-a5e7-4fad-8347-d11c37e4117e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61daf7626e804766898c439bffdff34f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:10.523558 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c433248e-a5e7-4fad-8347-d11c37e4117e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61daf7626e804766898c439bffdff34f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:10.531477 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c433248e-a5e7-4fad-8347-d11c37e4117e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61daf7626e804766898c439bffdff34f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:10.545783 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-c433248e-a5e7-4fad-8347-d11c37e4117e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61daf7626e804766898c439bffdff34f'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:10.553587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1402/2796] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:20:10 2022] DELETE /identity/v3/users/61daf7626e804766898c439bffdff34f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:10.875148 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30e148-ed37-435d-a057-57e2679c577f admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:10.877379 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-8e30e148-ed37-435d-a057-57e2679c577f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:10.898302 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30e148-ed37-435d-a057-57e2679c577f admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:10.974539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de661f-25a1-4ff4-a55a-78cb6fb20e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:10.975416 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de661f-25a1-4ff4-a55a-78cb6fb20e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:10.975703 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de661f-25a1-4ff4-a55a-78cb6fb20e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:10.975981 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de661f-25a1-4ff4-a55a-78cb6fb20e12 admin admin] PATH_INFO: `/v3/projects/cb96970f2f1e4299b692e1c37c0affd0` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:10.977206 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de661f-25a1-4ff4-a55a-78cb6fb20e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb96970f2f1e4299b692e1c37c0affd0)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:10.979351 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de661f-25a1-4ff4-a55a-78cb6fb20e12 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:11.039390 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-77de661f-25a1-4ff4-a55a-78cb6fb20e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb96970f2f1e4299b692e1c37c0affd0', 'request_id': 'req-77de661f-25a1-4ff4-a55a-78cb6fb20e12'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:11.050998 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-77de661f-25a1-4ff4-a55a-78cb6fb20e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb96970f2f1e4299b692e1c37c0affd0', 'request_id': 'req-77de661f-25a1-4ff4-a55a-78cb6fb20e12'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:11.071173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-77de661f-25a1-4ff4-a55a-78cb6fb20e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb96970f2f1e4299b692e1c37c0affd0', 'request_id': 'req-77de661f-25a1-4ff4-a55a-78cb6fb20e12'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:11.088628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-77de661f-25a1-4ff4-a55a-78cb6fb20e12 admin admin] The token cache is being invalidate because project cb96970f2f1e4299b692e1c37c0affd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:20:11.089370 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-77de661f-25a1-4ff4-a55a-78cb6fb20e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:11.090631 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-77de661f-25a1-4ff4-a55a-78cb6fb20e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:11.094848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1395/2797] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:20:10 2022] DELETE /identity/v3/projects/cb96970f2f1e4299b692e1c37c0affd0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:11.101014 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8037b09-f7e1-4367-be89-08bdb39c9d29 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:11.101500 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8037b09-f7e1-4367-be89-08bdb39c9d29 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:11.102129 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8037b09-f7e1-4367-be89-08bdb39c9d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:11.123762 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f8037b09-f7e1-4367-be89-08bdb39c9d29 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:11.127277 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f8037b09-f7e1-4367-be89-08bdb39c9d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:11.199506 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:11.214039 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1403/2798] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:11.223537 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd6148-8df2-4911-909b-560ab28641e4 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:11.223964 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd6148-8df2-4911-909b-560ab28641e4 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:11.224245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd6148-8df2-4911-909b-560ab28641e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:11.246952 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-f3bd6148-8df2-4911-909b-560ab28641e4 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:11.248698 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f3bd6148-8df2-4911-909b-560ab28641e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:11.264079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1396/2799] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:11.268707 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8037b09-f7e1-4367-be89-08bdb39c9d29 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:11.280797 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8037b09-f7e1-4367-be89-08bdb39c9d29 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:11.286429 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf531da7-7284-4541-a2a1-a52b1f4c1783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:11.287649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531da7-7284-4541-a2a1-a52b1f4c1783 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:11.288004 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531da7-7284-4541-a2a1-a52b1f4c1783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:11.288425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531da7-7284-4541-a2a1-a52b1f4c1783 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:11.289498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf531da7-7284-4541-a2a1-a52b1f4c1783 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:20:11.289845 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf531da7-7284-4541-a2a1-a52b1f4c1783 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:11.292215 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf531da7-7284-4541-a2a1-a52b1f4c1783 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:11.309723 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1404/2800] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:20:11.312229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd6148-8df2-4911-909b-560ab28641e4 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:11.325765 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd6148-8df2-4911-909b-560ab28641e4 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:11.331287 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4740a74-948d-4d77-98f9-1d2f43484f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:11.331949 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4740a74-948d-4d77-98f9-1d2f43484f97 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:11.332232 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4740a74-948d-4d77-98f9-1d2f43484f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:11.332511 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4740a74-948d-4d77-98f9-1d2f43484f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:11.333270 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4740a74-948d-4d77-98f9-1d2f43484f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:11.336419 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4740a74-948d-4d77-98f9-1d2f43484f97 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:11.373706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1397/2801] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:20:11 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:20:11.377988 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf531da7-7284-4541-a2a1-a52b1f4c1783 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:11.389184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf531da7-7284-4541-a2a1-a52b1f4c1783 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:11.469500 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bd1b7-8047-451f-8929-7ce797f6c2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:11.470458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bd1b7-8047-451f-8929-7ce797f6c2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:11.470670 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bd1b7-8047-451f-8929-7ce797f6c2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:11.471041 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bd1b7-8047-451f-8929-7ce797f6c2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:11.471499 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bd1b7-8047-451f-8929-7ce797f6c2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:11.473404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bd1b7-8047-451f-8929-7ce797f6c2e8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:11.495121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1405/2802] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:20:11 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:20:11.499891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4740a74-948d-4d77-98f9-1d2f43484f97 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:11.512568 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4740a74-948d-4d77-98f9-1d2f43484f97 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:11.519661 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6a868-62a8-4618-af86-9856b3f130b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:11.520586 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6a868-62a8-4618-af86-9856b3f130b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:11.520946 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6a868-62a8-4618-af86-9856b3f130b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:11.521303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6a868-62a8-4618-af86-9856b3f130b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:11.522200 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6a868-62a8-4618-af86-9856b3f130b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:11.523897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6a868-62a8-4618-af86-9856b3f130b4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:11.531416 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:11.541326 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1398/2803] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:20:11.544748 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bd1b7-8047-451f-8929-7ce797f6c2e8 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:11.559450 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bd1b7-8047-451f-8929-7ce797f6c2e8 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:11.565224 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b43ab1-919e-497d-adc6-47e978a3dd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:11.566179 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b43ab1-919e-497d-adc6-47e978a3dd63 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:11.566638 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b43ab1-919e-497d-adc6-47e978a3dd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:11.567057 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b43ab1-919e-497d-adc6-47e978a3dd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:11.567956 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b43ab1-919e-497d-adc6-47e978a3dd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:11.570591 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b43ab1-919e-497d-adc6-47e978a3dd63 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:11.585236 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1406/2804] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:20:11.586807 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6a868-62a8-4618-af86-9856b3f130b4 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:11.600034 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6a868-62a8-4618-af86-9856b3f130b4 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:11.605967 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f325cb8-77b3-4b8a-9b0e-1cf3b47a1a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:11.606998 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f325cb8-77b3-4b8a-9b0e-1cf3b47a1a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:11.607373 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f325cb8-77b3-4b8a-9b0e-1cf3b47a1a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:11.607794 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f325cb8-77b3-4b8a-9b0e-1cf3b47a1a59 admin admin] PATH_INFO: `/v3/projects/f6bf9200d72b4199967591479dde56c9/users/f98a2dfca4964f4ba1a0509c6f76c7f9/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:11.629129 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f325cb8-77b3-4b8a-9b0e-1cf3b47a1a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6bf9200d72b4199967591479dde56c9, user_id=f98a2dfca4964f4ba1a0509c6f76c7f9, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:11.632225 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f325cb8-77b3-4b8a-9b0e-1cf3b47a1a59 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:11.658114 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1399/2805] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:20:11 2022] PUT /identity/v3/projects/f6bf9200d72b4199967591479dde56c9/users/f98a2dfca4964f4ba1a0509c6f76c7f9/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:20:11.670700 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48662c1f-cc50-4f74-aa97-4a7a6c9f1a68 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:11.671134 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48662c1f-cc50-4f74-aa97-4a7a6c9f1a68 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:11.671563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48662c1f-cc50-4f74-aa97-4a7a6c9f1a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:11.704919 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-48662c1f-cc50-4f74-aa97-4a7a6c9f1a68 None None] MFA Rules not processed for user `f98a2dfca4964f4ba1a0509c6f76c7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:11.706248 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-48662c1f-cc50-4f74-aa97-4a7a6c9f1a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:11.800782 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1407/2806] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:11.802120 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f325cb8-77b3-4b8a-9b0e-1cf3b47a1a59 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:11.896219 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f325cb8-77b3-4b8a-9b0e-1cf3b47a1a59 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:11.901743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7654e8-1e43-48ad-8f7f-b25138cea94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:11.902490 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7654e8-1e43-48ad-8f7f-b25138cea94b admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:11.902781 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7654e8-1e43-48ad-8f7f-b25138cea94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:11.903061 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7654e8-1e43-48ad-8f7f-b25138cea94b admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:11.903817 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7654e8-1e43-48ad-8f7f-b25138cea94b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:11.905976 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7654e8-1e43-48ad-8f7f-b25138cea94b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:11.935664 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1400/2807] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:20:11 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:20:11.940255 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48662c1f-cc50-4f74-aa97-4a7a6c9f1a68 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:11.952935 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48662c1f-cc50-4f74-aa97-4a7a6c9f1a68 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:12.018220 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:12.032090 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf39e5-8b0d-4de4-9a36-9680c9fd521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:12.032898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf39e5-8b0d-4de4-9a36-9680c9fd521b admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:12.033193 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf39e5-8b0d-4de4-9a36-9680c9fd521b admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:12.033592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf39e5-8b0d-4de4-9a36-9680c9fd521b admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:12.034434 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf39e5-8b0d-4de4-9a36-9680c9fd521b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:12.036669 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf39e5-8b0d-4de4-9a36-9680c9fd521b admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:12.062577 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1408/2808] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:20:11 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:20:12.064392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7654e8-1e43-48ad-8f7f-b25138cea94b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:12.077800 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7654e8-1e43-48ad-8f7f-b25138cea94b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:12.083534 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbfc24-3efa-4f54-9eac-549a19de4cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:12.084247 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbfc24-3efa-4f54-9eac-549a19de4cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:12.084568 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbfc24-3efa-4f54-9eac-549a19de4cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:12.084913 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbfc24-3efa-4f54-9eac-549a19de4cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:12.085807 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbfc24-3efa-4f54-9eac-549a19de4cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:12.088023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbfc24-3efa-4f54-9eac-549a19de4cb5 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:12.109087 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1401/2809] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:20:12.111838 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf39e5-8b0d-4de4-9a36-9680c9fd521b admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:12.127940 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf39e5-8b0d-4de4-9a36-9680c9fd521b admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:12.134070 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c52eeb-90d1-49d2-8a71-d690cdb19082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:12.135006 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c52eeb-90d1-49d2-8a71-d690cdb19082 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:12.135306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c52eeb-90d1-49d2-8a71-d690cdb19082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:12.135604 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c52eeb-90d1-49d2-8a71-d690cdb19082 admin admin] PATH_INFO: `/v3/projects/a15b8d8170104393b9ce3645a44cc082/users/a4a5a28c09aa45fea0f2c4fe62646089/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:12.154756 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c52eeb-90d1-49d2-8a71-d690cdb19082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a15b8d8170104393b9ce3645a44cc082, user_id=a4a5a28c09aa45fea0f2c4fe62646089, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:12.158196 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c52eeb-90d1-49d2-8a71-d690cdb19082 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:12.175714 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1409/2810] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:20:12 2022] PUT /identity/v3/projects/a15b8d8170104393b9ce3645a44cc082/users/a4a5a28c09aa45fea0f2c4fe62646089/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:12.179484 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbfc24-3efa-4f54-9eac-549a19de4cb5 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:12.191846 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbfc24-3efa-4f54-9eac-549a19de4cb5 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:12.290617 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2c9fd-83fa-4e40-a229-065cb1d865ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:12.291624 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2c9fd-83fa-4e40-a229-065cb1d865ab admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:12.291910 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2c9fd-83fa-4e40-a229-065cb1d865ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:12.292185 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2c9fd-83fa-4e40-a229-065cb1d865ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:12.293357 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2c9fd-83fa-4e40-a229-065cb1d865ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:12.294641 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2c9fd-83fa-4e40-a229-065cb1d865ab admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:12.308729 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1402/2811] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 18 17:20:12.312820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c52eeb-90d1-49d2-8a71-d690cdb19082 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:12.326022 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c52eeb-90d1-49d2-8a71-d690cdb19082 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:12.332404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b49a2-780c-4801-a685-f1c8901b0bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:12.333318 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b49a2-780c-4801-a685-f1c8901b0bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:12.333597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b49a2-780c-4801-a685-f1c8901b0bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:12.333905 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b49a2-780c-4801-a685-f1c8901b0bf3 admin admin] PATH_INFO: `/v3/projects/a15b8d8170104393b9ce3645a44cc082/users/a4a5a28c09aa45fea0f2c4fe62646089/roles/b3f3f4910bf646699f30b749edeef422` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:12.336321 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b49a2-780c-4801-a685-f1c8901b0bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a15b8d8170104393b9ce3645a44cc082, user_id=a4a5a28c09aa45fea0f2c4fe62646089, role_id=b3f3f4910bf646699f30b749edeef422)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:12.339139 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b49a2-780c-4801-a685-f1c8901b0bf3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:12.356696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1410/2812] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:20:12 2022] PUT /identity/v3/projects/a15b8d8170104393b9ce3645a44cc082/users/a4a5a28c09aa45fea0f2c4fe62646089/roles/b3f3f4910bf646699f30b749edeef422 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:20:12.373685 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdb6a0-ee30-449a-8d6b-d1d5e372734c None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:12.374058 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdb6a0-ee30-449a-8d6b-d1d5e372734c None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:12.374347 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdb6a0-ee30-449a-8d6b-d1d5e372734c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:12.406623 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-63cdb6a0-ee30-449a-8d6b-d1d5e372734c None None] MFA Rules not processed for user `a4a5a28c09aa45fea0f2c4fe62646089`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:12.408694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-63cdb6a0-ee30-449a-8d6b-d1d5e372734c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:12.452600 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:12.513446 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1403/2813] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:20:12.526359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b49a2-780c-4801-a685-f1c8901b0bf3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:12.528174 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cc1b49a2-780c-4801-a685-f1c8901b0bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:12.596520 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b49a2-780c-4801-a685-f1c8901b0bf3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:12.600712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245d298-da17-400d-bd66-516550a80016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:12.601400 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245d298-da17-400d-bd66-516550a80016 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:12.601726 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245d298-da17-400d-bd66-516550a80016 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:12.602012 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245d298-da17-400d-bd66-516550a80016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:12.692782 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245d298-da17-400d-bd66-516550a80016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:12.694407 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245d298-da17-400d-bd66-516550a80016 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:12.706258 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1411/2814] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:20:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:20:13.173744 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdb6a0-ee30-449a-8d6b-d1d5e372734c None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:13.175212 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-63cdb6a0-ee30-449a-8d6b-d1d5e372734c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:13.268100 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdb6a0-ee30-449a-8d6b-d1d5e372734c None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:13.274138 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25494fc-f3b8-4de0-944c-6e3182716439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:13.274804 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25494fc-f3b8-4de0-944c-6e3182716439 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:13.275086 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25494fc-f3b8-4de0-944c-6e3182716439 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:13.275360 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25494fc-f3b8-4de0-944c-6e3182716439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:13.278447 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-c25494fc-f3b8-4de0-944c-6e3182716439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:13.359923 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25494fc-f3b8-4de0-944c-6e3182716439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:13.361620 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25494fc-f3b8-4de0-944c-6e3182716439 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:13.371959 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1404/2815] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:20:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:20:15.510611 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245d298-da17-400d-bd66-516550a80016 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:15.613164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245d298-da17-400d-bd66-516550a80016 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:15.618835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7ae92-0c78-42c9-9ea7-5b1ea5892e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:15.619977 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7ae92-0c78-42c9-9ea7-5b1ea5892e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:15.620282 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7ae92-0c78-42c9-9ea7-5b1ea5892e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:15.620535 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7ae92-0c78-42c9-9ea7-5b1ea5892e40 admin admin] PATH_INFO: `/v3/users/f98a2dfca4964f4ba1a0509c6f76c7f9` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:15.621781 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7ae92-0c78-42c9-9ea7-5b1ea5892e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98a2dfca4964f4ba1a0509c6f76c7f9)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:15.623903 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7ae92-0c78-42c9-9ea7-5b1ea5892e40 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:15.625948 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:15.728469 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4ee7ae92-0c78-42c9-9ea7-5b1ea5892e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98a2dfca4964f4ba1a0509c6f76c7f9'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:15.729157 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4ee7ae92-0c78-42c9-9ea7-5b1ea5892e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98a2dfca4964f4ba1a0509c6f76c7f9'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:15.745406 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4ee7ae92-0c78-42c9-9ea7-5b1ea5892e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98a2dfca4964f4ba1a0509c6f76c7f9'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:15.758854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4ee7ae92-0c78-42c9-9ea7-5b1ea5892e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98a2dfca4964f4ba1a0509c6f76c7f9'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:15.785980 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-4ee7ae92-0c78-42c9-9ea7-5b1ea5892e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98a2dfca4964f4ba1a0509c6f76c7f9'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:15.797488 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1412/2816] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:20:15 2022] DELETE /identity/v3/users/f98a2dfca4964f4ba1a0509c6f76c7f9 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:15.802679 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5640bd0-82fb-4c61-b0c0-c14531741ef6 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:15.803582 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5640bd0-82fb-4c61-b0c0-c14531741ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:15.804063 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5640bd0-82fb-4c61-b0c0-c14531741ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:15.827236 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-e5640bd0-82fb-4c61-b0c0-c14531741ef6 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:15.829513 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e5640bd0-82fb-4c61-b0c0-c14531741ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:16.005694 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1405/2817] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:16.031559 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7ae92-0c78-42c9-9ea7-5b1ea5892e40 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:16.033188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4ee7ae92-0c78-42c9-9ea7-5b1ea5892e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:16.176983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7ae92-0c78-42c9-9ea7-5b1ea5892e40 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:16.180839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53535e-e640-4999-88cb-4f3d91546a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:16.181490 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53535e-e640-4999-88cb-4f3d91546a04 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:16.181945 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53535e-e640-4999-88cb-4f3d91546a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:16.183130 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53535e-e640-4999-88cb-4f3d91546a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:16.207287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53535e-e640-4999-88cb-4f3d91546a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:16.211048 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53535e-e640-4999-88cb-4f3d91546a04 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:16.227917 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1413/2818] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:20:17.172689 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5640bd0-82fb-4c61-b0c0-c14531741ef6 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:17.174209 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-e5640bd0-82fb-4c61-b0c0-c14531741ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:17.207919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5640bd0-82fb-4c61-b0c0-c14531741ef6 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:17.227669 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b8a7c-6bca-4f12-9167-89077b7dd866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:17.228565 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b8a7c-6bca-4f12-9167-89077b7dd866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:17.229130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b8a7c-6bca-4f12-9167-89077b7dd866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:17.229628 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b8a7c-6bca-4f12-9167-89077b7dd866 admin admin] PATH_INFO: `/v3/projects/f6bf9200d72b4199967591479dde56c9` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:17.231201 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b8a7c-6bca-4f12-9167-89077b7dd866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6bf9200d72b4199967591479dde56c9)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:17.233632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b8a7c-6bca-4f12-9167-89077b7dd866 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:17.274240 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:17.327906 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-122b8a7c-6bca-4f12-9167-89077b7dd866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6bf9200d72b4199967591479dde56c9', 'request_id': 'req-122b8a7c-6bca-4f12-9167-89077b7dd866'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:17.336007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-122b8a7c-6bca-4f12-9167-89077b7dd866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6bf9200d72b4199967591479dde56c9', 'request_id': 'req-122b8a7c-6bca-4f12-9167-89077b7dd866'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:17.348645 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-122b8a7c-6bca-4f12-9167-89077b7dd866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6bf9200d72b4199967591479dde56c9', 'request_id': 'req-122b8a7c-6bca-4f12-9167-89077b7dd866'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:17.374941 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-122b8a7c-6bca-4f12-9167-89077b7dd866 admin admin] The token cache is being invalidate because project f6bf9200d72b4199967591479dde56c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:20:17.375768 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-122b8a7c-6bca-4f12-9167-89077b7dd866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:17.380190 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-122b8a7c-6bca-4f12-9167-89077b7dd866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:17.382945 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1406/2819] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:20:17 2022] DELETE /identity/v3/projects/f6bf9200d72b4199967591479dde56c9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:17.388311 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53535e-e640-4999-88cb-4f3d91546a04 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:17.401877 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53535e-e640-4999-88cb-4f3d91546a04 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:17.481710 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c222f3a-57e7-403c-a9c8-679477153dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:17.483089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c222f3a-57e7-403c-a9c8-679477153dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:17.483772 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c222f3a-57e7-403c-a9c8-679477153dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:17.484268 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c222f3a-57e7-403c-a9c8-679477153dc7 admin admin] PATH_INFO: `/v3/users/a4a5a28c09aa45fea0f2c4fe62646089` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:17.486078 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c222f3a-57e7-403c-a9c8-679477153dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a5a28c09aa45fea0f2c4fe62646089)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:17.488326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c222f3a-57e7-403c-a9c8-679477153dc7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:17.520328 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:17.567945 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7c222f3a-57e7-403c-a9c8-679477153dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a5a28c09aa45fea0f2c4fe62646089'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:17.568565 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7c222f3a-57e7-403c-a9c8-679477153dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a5a28c09aa45fea0f2c4fe62646089'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:17.588680 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7c222f3a-57e7-403c-a9c8-679477153dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a5a28c09aa45fea0f2c4fe62646089'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:17.606857 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7c222f3a-57e7-403c-a9c8-679477153dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a5a28c09aa45fea0f2c4fe62646089'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:17.634232 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-7c222f3a-57e7-403c-a9c8-679477153dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a5a28c09aa45fea0f2c4fe62646089'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:17.658384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1414/2820] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:20:17 2022] DELETE /identity/v3/users/a4a5a28c09aa45fea0f2c4fe62646089 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:18.012050 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b8a7c-6bca-4f12-9167-89077b7dd866 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:18.013904 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-122b8a7c-6bca-4f12-9167-89077b7dd866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:18.038674 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b8a7c-6bca-4f12-9167-89077b7dd866 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:18.123084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525c33e-50f7-4d0d-a286-58ece2d15417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:18.124314 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525c33e-50f7-4d0d-a286-58ece2d15417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:18.124602 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525c33e-50f7-4d0d-a286-58ece2d15417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:18.124874 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525c33e-50f7-4d0d-a286-58ece2d15417 admin admin] PATH_INFO: `/v3/projects/a15b8d8170104393b9ce3645a44cc082` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:18.127085 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525c33e-50f7-4d0d-a286-58ece2d15417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a15b8d8170104393b9ce3645a44cc082)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:18.129752 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525c33e-50f7-4d0d-a286-58ece2d15417 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:18.181718 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c525c33e-50f7-4d0d-a286-58ece2d15417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a15b8d8170104393b9ce3645a44cc082', 'request_id': 'req-c525c33e-50f7-4d0d-a286-58ece2d15417'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:18.189392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c525c33e-50f7-4d0d-a286-58ece2d15417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a15b8d8170104393b9ce3645a44cc082', 'request_id': 'req-c525c33e-50f7-4d0d-a286-58ece2d15417'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:18.195863 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c525c33e-50f7-4d0d-a286-58ece2d15417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a15b8d8170104393b9ce3645a44cc082', 'request_id': 'req-c525c33e-50f7-4d0d-a286-58ece2d15417'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:18.209980 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c525c33e-50f7-4d0d-a286-58ece2d15417 admin admin] The token cache is being invalidate because project a15b8d8170104393b9ce3645a44cc082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:20:18.210275 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c525c33e-50f7-4d0d-a286-58ece2d15417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:18.210947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-c525c33e-50f7-4d0d-a286-58ece2d15417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:18.212503 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1407/2821] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:20:18 2022] DELETE /identity/v3/projects/a15b8d8170104393b9ce3645a44cc082 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:18.217854 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404b373-c27a-4b67-8213-d58d319f63f7 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:18.218054 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404b373-c27a-4b67-8213-d58d319f63f7 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:18.218348 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404b373-c27a-4b67-8213-d58d319f63f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:18.238327 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8404b373-c27a-4b67-8213-d58d319f63f7 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:18.239571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8404b373-c27a-4b67-8213-d58d319f63f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:18.326293 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1415/2822] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:18.341335 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cec2f-3cfa-47d4-88e8-b95a44020d32 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:18.341889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cec2f-3cfa-47d4-88e8-b95a44020d32 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:18.342411 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cec2f-3cfa-47d4-88e8-b95a44020d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:18.377436 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-5d5cec2f-3cfa-47d4-88e8-b95a44020d32 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:18.379626 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5d5cec2f-3cfa-47d4-88e8-b95a44020d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:18.395166 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1408/2823] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:20:18.399559 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404b373-c27a-4b67-8213-d58d319f63f7 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:18.410340 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404b373-c27a-4b67-8213-d58d319f63f7 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:18.416416 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b145fc1-6c8f-4e28-a389-f40251d12513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:18.417212 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b145fc1-6c8f-4e28-a389-f40251d12513 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:18.418055 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b145fc1-6c8f-4e28-a389-f40251d12513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:18.418413 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b145fc1-6c8f-4e28-a389-f40251d12513 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:18.423384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b145fc1-6c8f-4e28-a389-f40251d12513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:20:18.423384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b145fc1-6c8f-4e28-a389-f40251d12513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:18.423384 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b145fc1-6c8f-4e28-a389-f40251d12513 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:18.428922 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010c2bf-bd4f-437a-8fc1-2aa939b24503 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:18.429216 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010c2bf-bd4f-437a-8fc1-2aa939b24503 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:18.429495 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010c2bf-bd4f-437a-8fc1-2aa939b24503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:18.435818 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1416/2824] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:20:18.442059 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b145fc1-6c8f-4e28-a389-f40251d12513 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:18.451000 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-4010c2bf-bd4f-437a-8fc1-2aa939b24503 None None] MFA Rules not processed for user `9692d55c8c924544a1bff62054731ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:18.452230 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4010c2bf-bd4f-437a-8fc1-2aa939b24503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:18.452673 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b145fc1-6c8f-4e28-a389-f40251d12513 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:18.458279 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757efd85-2dc7-4e9e-9852-5901d3191ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:18.458971 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757efd85-2dc7-4e9e-9852-5901d3191ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:18.459254 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757efd85-2dc7-4e9e-9852-5901d3191ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:18.459536 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757efd85-2dc7-4e9e-9852-5901d3191ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:18.460232 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757efd85-2dc7-4e9e-9852-5901d3191ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:18.462184 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757efd85-2dc7-4e9e-9852-5901d3191ef8 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:18.499329 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:18.517709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1417/2825] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:20:18 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:20:18.519920 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757efd85-2dc7-4e9e-9852-5901d3191ef8 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:18.560162 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1409/2826] 10.222.0.49 () {58 vars in 967 bytes} [Wed May 18 17:20:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:18.576035 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010c2bf-bd4f-437a-8fc1-2aa939b24503 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:18.578723 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-4010c2bf-bd4f-437a-8fc1-2aa939b24503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:18.639741 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757efd85-2dc7-4e9e-9852-5901d3191ef8 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:18.648063 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f64b8-c360-4828-be0e-d60dfce51a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:18.649100 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f64b8-c360-4828-be0e-d60dfce51a4c admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:18.649534 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f64b8-c360-4828-be0e-d60dfce51a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:18.649983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f64b8-c360-4828-be0e-d60dfce51a4c admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:18.651161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f64b8-c360-4828-be0e-d60dfce51a4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:18.655528 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f64b8-c360-4828-be0e-d60dfce51a4c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:18.678862 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:18.685760 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010c2bf-bd4f-437a-8fc1-2aa939b24503 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:18.706121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1418/2827] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:20:18 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:20:18.707540 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f64b8-c360-4828-be0e-d60dfce51a4c admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:18.727808 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f64b8-c360-4828-be0e-d60dfce51a4c admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:18.733207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9bca4-6130-43a9-92f4-2aa9e51ff9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:18.733924 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9bca4-6130-43a9-92f4-2aa9e51ff9af admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:18.734213 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9bca4-6130-43a9-92f4-2aa9e51ff9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:18.734585 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9bca4-6130-43a9-92f4-2aa9e51ff9af admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:18.736458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9bca4-6130-43a9-92f4-2aa9e51ff9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:18.738453 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9bca4-6130-43a9-92f4-2aa9e51ff9af admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:18.757033 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1419/2828] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:20:18.758394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9bca4-6130-43a9-92f4-2aa9e51ff9af admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:18.775420 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9bca4-6130-43a9-92f4-2aa9e51ff9af admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:18.804550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc077c-3e87-49a8-a150-dfd6f6c85ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:18.804550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc077c-3e87-49a8-a150-dfd6f6c85ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:18.804550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc077c-3e87-49a8-a150-dfd6f6c85ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:18.804550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc077c-3e87-49a8-a150-dfd6f6c85ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:18.805172 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc077c-3e87-49a8-a150-dfd6f6c85ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:18.805172 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc077c-3e87-49a8-a150-dfd6f6c85ab2 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:18.805172 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1420/2829] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:20:18.811920 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc077c-3e87-49a8-a150-dfd6f6c85ab2 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:18.812466 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9d09c-8fb4-4753-98f3-c6b538c51e61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b712c7f5fce54fe2a89d63863f3845f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:18.813192 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9d09c-8fb4-4753-98f3-c6b538c51e61 service swift] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:18.813480 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9d09c-8fb4-4753-98f3-c6b538c51e61 service swift] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:18.813897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9d09c-8fb4-4753-98f3-c6b538c51e61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:18.824188 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc077c-3e87-49a8-a150-dfd6f6c85ab2 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:18.830634 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45d78f-cad1-4a21-9700-9d5723e85722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:18.832855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45d78f-cad1-4a21-9700-9d5723e85722 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:18.833614 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45d78f-cad1-4a21-9700-9d5723e85722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:18.834201 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45d78f-cad1-4a21-9700-9d5723e85722 admin admin] PATH_INFO: `/v3/projects/69a6a4423da24c85aa02f46f308fc6f0/users/fcb26a552de1498fb7f0012130fcda4c/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:18.861323 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45d78f-cad1-4a21-9700-9d5723e85722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69a6a4423da24c85aa02f46f308fc6f0, user_id=fcb26a552de1498fb7f0012130fcda4c, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:18.867357 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45d78f-cad1-4a21-9700-9d5723e85722 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:18.898516 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1421/2830] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:20:18 2022] PUT /identity/v3/projects/69a6a4423da24c85aa02f46f308fc6f0/users/fcb26a552de1498fb7f0012130fcda4c/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:20:18.912877 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b27ba4-8aad-4b30-a569-52ab652c6122 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:18.913563 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b27ba4-8aad-4b30-a569-52ab652c6122 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:18.914142 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b27ba4-8aad-4b30-a569-52ab652c6122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:18.928924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9d09c-8fb4-4753-98f3-c6b538c51e61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:18.930601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9d09c-8fb4-4753-98f3-c6b538c51e61 service swift] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:18.942312 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1410/2831] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 18 17:20:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 17:20:18.974620 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-22b27ba4-8aad-4b30-a569-52ab652c6122 None None] MFA Rules not processed for user `fcb26a552de1498fb7f0012130fcda4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:18.976513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-22b27ba4-8aad-4b30-a569-52ab652c6122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:19.106828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1422/2832] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:19.119290 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9d09c-8fb4-4753-98f3-c6b538c51e61 service swift] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:19.121263 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bbf9d09c-8fb4-4753-98f3-c6b538c51e61 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:19.144598 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=100 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:19.198351 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9d09c-8fb4-4753-98f3-c6b538c51e61 service swift] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:19.275539 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7ce87-30dc-4af7-bc11-588b897a5a7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:19.276887 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7ce87-30dc-4af7-bc11-588b897a5a7f service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:19.277375 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7ce87-30dc-4af7-bc11-588b897a5a7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:19.277576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7ce87-30dc-4af7-bc11-588b897a5a7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:19.288514 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7ce87-30dc-4af7-bc11-588b897a5a7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:19.290101 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7ce87-30dc-4af7-bc11-588b897a5a7f service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:19.302687 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1411/2833] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:20:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:20:21.002178 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b27ba4-8aad-4b30-a569-52ab652c6122 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:21.003719 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-22b27ba4-8aad-4b30-a569-52ab652c6122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:21.077497 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b27ba4-8aad-4b30-a569-52ab652c6122 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:21.083394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b492e3-3e8c-453a-b7cd-815587850b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:21.083394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b492e3-3e8c-453a-b7cd-815587850b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:21.083394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b492e3-3e8c-453a-b7cd-815587850b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:21.083714 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b492e3-3e8c-453a-b7cd-815587850b1c admin admin] PATH_INFO: `/v3/users/ae6e9f34c1e0408bac7c252f9ecdd7e7` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:21.084853 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b492e3-3e8c-453a-b7cd-815587850b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae6e9f34c1e0408bac7c252f9ecdd7e7)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:21.086810 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b492e3-3e8c-453a-b7cd-815587850b1c admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:21.131855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:21.139210 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f5b492e3-3e8c-453a-b7cd-815587850b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae6e9f34c1e0408bac7c252f9ecdd7e7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:21.139210 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f5b492e3-3e8c-453a-b7cd-815587850b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae6e9f34c1e0408bac7c252f9ecdd7e7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:21.148148 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f5b492e3-3e8c-453a-b7cd-815587850b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae6e9f34c1e0408bac7c252f9ecdd7e7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:21.158893 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f5b492e3-3e8c-453a-b7cd-815587850b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae6e9f34c1e0408bac7c252f9ecdd7e7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:21.173278 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f5b492e3-3e8c-453a-b7cd-815587850b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae6e9f34c1e0408bac7c252f9ecdd7e7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:21.180943 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1423/2834] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:20:21 2022] DELETE /identity/v3/users/ae6e9f34c1e0408bac7c252f9ecdd7e7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:21.388720 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7ce87-30dc-4af7-bc11-588b897a5a7f service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:21.402662 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7ce87-30dc-4af7-bc11-588b897a5a7f service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:21.467449 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95f497-68c5-480c-b9db-084fc1546c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:21.468333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95f497-68c5-480c-b9db-084fc1546c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:21.469596 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95f497-68c5-480c-b9db-084fc1546c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:21.470133 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95f497-68c5-480c-b9db-084fc1546c30 admin admin] PATH_INFO: `/v3/projects/73a1d41bf5e24b54972ce29acb4b11a2` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:21.471468 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95f497-68c5-480c-b9db-084fc1546c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73a1d41bf5e24b54972ce29acb4b11a2)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:21.473406 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95f497-68c5-480c-b9db-084fc1546c30 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:21.525934 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7e95f497-68c5-480c-b9db-084fc1546c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73a1d41bf5e24b54972ce29acb4b11a2', 'request_id': 'req-7e95f497-68c5-480c-b9db-084fc1546c30'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:21.532495 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7e95f497-68c5-480c-b9db-084fc1546c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73a1d41bf5e24b54972ce29acb4b11a2', 'request_id': 'req-7e95f497-68c5-480c-b9db-084fc1546c30'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:21.539468 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7e95f497-68c5-480c-b9db-084fc1546c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73a1d41bf5e24b54972ce29acb4b11a2', 'request_id': 'req-7e95f497-68c5-480c-b9db-084fc1546c30'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:21.553727 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7e95f497-68c5-480c-b9db-084fc1546c30 admin admin] The token cache is being invalidate because project 73a1d41bf5e24b54972ce29acb4b11a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:20:21.554007 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7e95f497-68c5-480c-b9db-084fc1546c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:21.554697 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-7e95f497-68c5-480c-b9db-084fc1546c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:21.556392 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1412/2835] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:20:21 2022] DELETE /identity/v3/projects/73a1d41bf5e24b54972ce29acb4b11a2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:21.561481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dead84b-0f07-4fcd-a21a-41aeaef1f7c6 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:21.561813 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dead84b-0f07-4fcd-a21a-41aeaef1f7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:21.562099 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dead84b-0f07-4fcd-a21a-41aeaef1f7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:21.581425 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-8dead84b-0f07-4fcd-a21a-41aeaef1f7c6 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:21.582689 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8dead84b-0f07-4fcd-a21a-41aeaef1f7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:21.653327 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1424/2836] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:21.662897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5414d-17ff-4276-86eb-1039d2bdcdf2 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:21.663274 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5414d-17ff-4276-86eb-1039d2bdcdf2 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:21.663734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5414d-17ff-4276-86eb-1039d2bdcdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:21.676948 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:21.683645 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-62c5414d-17ff-4276-86eb-1039d2bdcdf2 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:21.685623 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-62c5414d-17ff-4276-86eb-1039d2bdcdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:21.694203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1413/2837] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:21.698668 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dead84b-0f07-4fcd-a21a-41aeaef1f7c6 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:21.709447 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dead84b-0f07-4fcd-a21a-41aeaef1f7c6 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:21.714026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a4869-8b27-4941-b3af-002eabed6af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:21.714680 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a4869-8b27-4941-b3af-002eabed6af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:21.714969 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a4869-8b27-4941-b3af-002eabed6af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:21.715247 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a4869-8b27-4941-b3af-002eabed6af5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:21.715971 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a4869-8b27-4941-b3af-002eabed6af5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:20:21.716275 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a4869-8b27-4941-b3af-002eabed6af5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:21.717949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a4869-8b27-4941-b3af-002eabed6af5 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:21.734543 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1425/2838] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:20:21.736387 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5414d-17ff-4276-86eb-1039d2bdcdf2 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:21.745872 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5414d-17ff-4276-86eb-1039d2bdcdf2 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:21.751594 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec5a22-a082-4ffb-bc0a-ce64553277b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:21.752259 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec5a22-a082-4ffb-bc0a-ce64553277b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:21.752550 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec5a22-a082-4ffb-bc0a-ce64553277b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:21.752836 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec5a22-a082-4ffb-bc0a-ce64553277b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:21.753534 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec5a22-a082-4ffb-bc0a-ce64553277b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:21.755492 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec5a22-a082-4ffb-bc0a-ce64553277b2 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:21.782653 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1414/2839] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:20:21 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:20:21.786907 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a4869-8b27-4941-b3af-002eabed6af5 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:21.798038 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a4869-8b27-4941-b3af-002eabed6af5 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:21.858332 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf6c15-2fe7-46eb-8e70-5a162e2aa555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:21.859037 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf6c15-2fe7-46eb-8e70-5a162e2aa555 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:21.859359 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf6c15-2fe7-46eb-8e70-5a162e2aa555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:21.859692 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf6c15-2fe7-46eb-8e70-5a162e2aa555 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:21.860555 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf6c15-2fe7-46eb-8e70-5a162e2aa555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:21.862592 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf6c15-2fe7-46eb-8e70-5a162e2aa555 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:21.884431 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1426/2840] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:20:21 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:20:21.888813 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec5a22-a082-4ffb-bc0a-ce64553277b2 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:21.899828 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec5a22-a082-4ffb-bc0a-ce64553277b2 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:21.904524 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26e414-a0af-46b7-bceb-daa6ac8d42eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:21.905183 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26e414-a0af-46b7-bceb-daa6ac8d42eb admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:21.905465 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26e414-a0af-46b7-bceb-daa6ac8d42eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:21.905782 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26e414-a0af-46b7-bceb-daa6ac8d42eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:21.906597 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26e414-a0af-46b7-bceb-daa6ac8d42eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:21.908125 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26e414-a0af-46b7-bceb-daa6ac8d42eb admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:21.918768 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1415/2841] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:20:21.923341 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf6c15-2fe7-46eb-8e70-5a162e2aa555 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:21.934125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf6c15-2fe7-46eb-8e70-5a162e2aa555 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:21.939370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70348f-66a2-477c-84bd-270320917b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:21.940044 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70348f-66a2-477c-84bd-270320917b81 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:21.940310 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70348f-66a2-477c-84bd-270320917b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:21.940587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70348f-66a2-477c-84bd-270320917b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:21.941315 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70348f-66a2-477c-84bd-270320917b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:21.942946 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70348f-66a2-477c-84bd-270320917b81 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:21.952898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1427/2842] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:20:21.957897 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26e414-a0af-46b7-bceb-daa6ac8d42eb admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:21.968156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26e414-a0af-46b7-bceb-daa6ac8d42eb admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:21.973309 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b976dd-56d6-4608-9feb-d560d27f097b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:21.974294 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b976dd-56d6-4608-9feb-d560d27f097b admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:21.974579 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b976dd-56d6-4608-9feb-d560d27f097b admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:21.974859 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b976dd-56d6-4608-9feb-d560d27f097b admin admin] PATH_INFO: `/v3/projects/b67f1e2ceac8444db336f6bfc240d92d/users/68c6a2170dff477593968572816d436b/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:21.990715 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b976dd-56d6-4608-9feb-d560d27f097b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b67f1e2ceac8444db336f6bfc240d92d, user_id=68c6a2170dff477593968572816d436b, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:21.993381 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b976dd-56d6-4608-9feb-d560d27f097b admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:22.006882 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1416/2843] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:20:21 2022] PUT /identity/v3/projects/b67f1e2ceac8444db336f6bfc240d92d/users/68c6a2170dff477593968572816d436b/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:22.017649 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd9280-1b3a-4392-a718-d0a645b5ec50 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:22.018206 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd9280-1b3a-4392-a718-d0a645b5ec50 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:22.018336 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd9280-1b3a-4392-a718-d0a645b5ec50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:22.045121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-96cd9280-1b3a-4392-a718-d0a645b5ec50 None None] MFA Rules not processed for user `68c6a2170dff477593968572816d436b`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:22.046360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-96cd9280-1b3a-4392-a718-d0a645b5ec50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:22.058571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:22.117225 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1428/2844] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:20:22.129144 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b976dd-56d6-4608-9feb-d560d27f097b admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:22.130883 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-55b976dd-56d6-4608-9feb-d560d27f097b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:22.191152 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b976dd-56d6-4608-9feb-d560d27f097b admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:22.194808 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf94a88-3839-4f21-a74e-388257618b05 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d69d99d980744fba12a6b38586e7bf3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:22.195452 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf94a88-3839-4f21-a74e-388257618b05 service glance] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:22.195736 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf94a88-3839-4f21-a74e-388257618b05 service glance] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:22.196008 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf94a88-3839-4f21-a74e-388257618b05 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:22.204750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf94a88-3839-4f21-a74e-388257618b05 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:22.206229 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf94a88-3839-4f21-a74e-388257618b05 service glance] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:22.215051 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1417/2845] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:20:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:20:22.710506 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd9280-1b3a-4392-a718-d0a645b5ec50 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:22.711976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-96cd9280-1b3a-4392-a718-d0a645b5ec50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:22.783312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd9280-1b3a-4392-a718-d0a645b5ec50 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:22.788112 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26ea19-ac92-4c9a-ba27-6e49ba29d29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:22.789024 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26ea19-ac92-4c9a-ba27-6e49ba29d29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:22.789307 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26ea19-ac92-4c9a-ba27-6e49ba29d29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:22.789588 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26ea19-ac92-4c9a-ba27-6e49ba29d29e admin admin] PATH_INFO: `/v3/users/fcb26a552de1498fb7f0012130fcda4c` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:22.790949 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26ea19-ac92-4c9a-ba27-6e49ba29d29e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb26a552de1498fb7f0012130fcda4c)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:22.792932 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26ea19-ac92-4c9a-ba27-6e49ba29d29e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:22.848725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-af26ea19-ac92-4c9a-ba27-6e49ba29d29e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb26a552de1498fb7f0012130fcda4c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:22.849328 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-af26ea19-ac92-4c9a-ba27-6e49ba29d29e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb26a552de1498fb7f0012130fcda4c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:22.858013 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-af26ea19-ac92-4c9a-ba27-6e49ba29d29e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb26a552de1498fb7f0012130fcda4c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:22.866218 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-af26ea19-ac92-4c9a-ba27-6e49ba29d29e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb26a552de1498fb7f0012130fcda4c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:22.883343 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-af26ea19-ac92-4c9a-ba27-6e49ba29d29e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb26a552de1498fb7f0012130fcda4c'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:22.892548 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1429/2846] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:20:22 2022] DELETE /identity/v3/users/fcb26a552de1498fb7f0012130fcda4c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:22.897215 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfb3ff-5d7d-41a6-b208-0e475bec6eda None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:22.897769 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfb3ff-5d7d-41a6-b208-0e475bec6eda None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:22.897924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfb3ff-5d7d-41a6-b208-0e475bec6eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:22.918270 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-85dfb3ff-5d7d-41a6-b208-0e475bec6eda None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:22.919642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-85dfb3ff-5d7d-41a6-b208-0e475bec6eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:22.983423 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1418/2847] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:22.993285 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26ea19-ac92-4c9a-ba27-6e49ba29d29e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:22.994779 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-af26ea19-ac92-4c9a-ba27-6e49ba29d29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:23.033469 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:23.061572 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26ea19-ac92-4c9a-ba27-6e49ba29d29e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:23.069349 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f5bd6-1511-49dd-a5e3-5705738f853f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:23.070056 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f5bd6-1511-49dd-a5e3-5705738f853f service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:23.070345 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f5bd6-1511-49dd-a5e3-5705738f853f service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:23.070658 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f5bd6-1511-49dd-a5e3-5705738f853f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:23.081820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f5bd6-1511-49dd-a5e3-5705738f853f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:23.083287 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f5bd6-1511-49dd-a5e3-5705738f853f service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:23.093542 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1430/2848] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:20:23.420065 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfb3ff-5d7d-41a6-b208-0e475bec6eda None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:23.421709 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-85dfb3ff-5d7d-41a6-b208-0e475bec6eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:23.438312 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfb3ff-5d7d-41a6-b208-0e475bec6eda None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:23.443582 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee73872-3f7d-4f49-a376-565579c0cbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:23.444458 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee73872-3f7d-4f49-a376-565579c0cbcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:23.444741 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee73872-3f7d-4f49-a376-565579c0cbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:23.445018 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee73872-3f7d-4f49-a376-565579c0cbcc admin admin] PATH_INFO: `/v3/projects/69a6a4423da24c85aa02f46f308fc6f0` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:23.446303 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee73872-3f7d-4f49-a376-565579c0cbcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=69a6a4423da24c85aa02f46f308fc6f0)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:23.448247 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee73872-3f7d-4f49-a376-565579c0cbcc admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:23.499687 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:23.508987 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2ee73872-3f7d-4f49-a376-565579c0cbcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69a6a4423da24c85aa02f46f308fc6f0', 'request_id': 'req-2ee73872-3f7d-4f49-a376-565579c0cbcc'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:23.516393 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2ee73872-3f7d-4f49-a376-565579c0cbcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69a6a4423da24c85aa02f46f308fc6f0', 'request_id': 'req-2ee73872-3f7d-4f49-a376-565579c0cbcc'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:23.523068 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2ee73872-3f7d-4f49-a376-565579c0cbcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69a6a4423da24c85aa02f46f308fc6f0', 'request_id': 'req-2ee73872-3f7d-4f49-a376-565579c0cbcc'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:23.537914 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2ee73872-3f7d-4f49-a376-565579c0cbcc admin admin] The token cache is being invalidate because project 69a6a4423da24c85aa02f46f308fc6f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:20:23.538205 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2ee73872-3f7d-4f49-a376-565579c0cbcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:23.538853 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-2ee73872-3f7d-4f49-a376-565579c0cbcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:23.540432 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1419/2849] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:20:23 2022] DELETE /identity/v3/projects/69a6a4423da24c85aa02f46f308fc6f0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:23.545712 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cb53c-97a8-43d3-89db-badb2725741b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:23.546026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cb53c-97a8-43d3-89db-badb2725741b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:23.546374 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cb53c-97a8-43d3-89db-badb2725741b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:23.569597 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-645cb53c-97a8-43d3-89db-badb2725741b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:23.571065 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-645cb53c-97a8-43d3-89db-badb2725741b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:23.645500 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1431/2850] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:23.654946 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369418cc-8d83-4a58-b092-5f130b2703eb None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:23.655304 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369418cc-8d83-4a58-b092-5f130b2703eb None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:23.655656 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369418cc-8d83-4a58-b092-5f130b2703eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:23.677187 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-369418cc-8d83-4a58-b092-5f130b2703eb None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:23.679102 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-369418cc-8d83-4a58-b092-5f130b2703eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:23.688113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1420/2851] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:20:23.696075 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cb53c-97a8-43d3-89db-badb2725741b None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:23.709151 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cb53c-97a8-43d3-89db-badb2725741b None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:23.715026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772da46f-e155-4286-af29-9746cd601601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:23.715946 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772da46f-e155-4286-af29-9746cd601601 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:23.716959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772da46f-e155-4286-af29-9746cd601601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:23.716959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772da46f-e155-4286-af29-9746cd601601 admin admin] PATH_INFO: `/v3/domains` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:23.719711 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772da46f-e155-4286-af29-9746cd601601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:20:23.719711 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772da46f-e155-4286-af29-9746cd601601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:23.720868 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772da46f-e155-4286-af29-9746cd601601 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:23.735167 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1432/2852] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:20:23.739889 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369418cc-8d83-4a58-b092-5f130b2703eb None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:23.771135 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369418cc-8d83-4a58-b092-5f130b2703eb None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:23.776295 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c32792-ae6b-4a05-af7a-6f7bbf9a354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:23.777094 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c32792-ae6b-4a05-af7a-6f7bbf9a354d admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:23.777440 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c32792-ae6b-4a05-af7a-6f7bbf9a354d admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:23.777848 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c32792-ae6b-4a05-af7a-6f7bbf9a354d admin admin] PATH_INFO: `/v3/projects` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:23.778755 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c32792-ae6b-4a05-af7a-6f7bbf9a354d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:23.781021 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c32792-ae6b-4a05-af7a-6f7bbf9a354d admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:23.817313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1421/2853] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:20:23 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:20:23.818691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772da46f-e155-4286-af29-9746cd601601 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:23.830603 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772da46f-e155-4286-af29-9746cd601601 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:23.904582 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d983b1-fb2a-419e-aa5e-46c6fcbd0721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:23.905262 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d983b1-fb2a-419e-aa5e-46c6fcbd0721 admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:23.905550 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d983b1-fb2a-419e-aa5e-46c6fcbd0721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:23.905867 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d983b1-fb2a-419e-aa5e-46c6fcbd0721 admin admin] PATH_INFO: `/v3/users` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:23.906831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d983b1-fb2a-419e-aa5e-46c6fcbd0721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:23.910051 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d983b1-fb2a-419e-aa5e-46c6fcbd0721 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:23.934033 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1433/2854] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:20:23 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 18 17:20:23.939406 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c32792-ae6b-4a05-af7a-6f7bbf9a354d admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:23.956319 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c32792-ae6b-4a05-af7a-6f7bbf9a354d admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:23.962664 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391eaac-8494-4539-9768-a67d0e9741e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:23.963397 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391eaac-8494-4539-9768-a67d0e9741e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:23.963753 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391eaac-8494-4539-9768-a67d0e9741e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:23.963995 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391eaac-8494-4539-9768-a67d0e9741e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:23.964847 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391eaac-8494-4539-9768-a67d0e9741e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:23.966490 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391eaac-8494-4539-9768-a67d0e9741e4 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:23.979705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1422/2855] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:20:23.984067 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d983b1-fb2a-419e-aa5e-46c6fcbd0721 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:23.996294 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d983b1-fb2a-419e-aa5e-46c6fcbd0721 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:24.002115 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473dc89-34ce-4328-b091-de083b7d0b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:24.002821 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473dc89-34ce-4328-b091-de083b7d0b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:24.003109 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473dc89-34ce-4328-b091-de083b7d0b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:24.003390 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473dc89-34ce-4328-b091-de083b7d0b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:24.004129 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473dc89-34ce-4328-b091-de083b7d0b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:24.005773 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473dc89-34ce-4328-b091-de083b7d0b60 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:24.016940 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1434/2856] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:20:24.021200 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391eaac-8494-4539-9768-a67d0e9741e4 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:24.032543 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391eaac-8494-4539-9768-a67d0e9741e4 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:24.037930 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b624e-8474-443d-b3f6-fbc2aeb28295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:24.038817 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b624e-8474-443d-b3f6-fbc2aeb28295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:24.039102 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b624e-8474-443d-b3f6-fbc2aeb28295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:24.039384 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b624e-8474-443d-b3f6-fbc2aeb28295 admin admin] PATH_INFO: `/v3/projects/746b5a83a469465cbd94f8f9dfa0db94/users/f654d7139eea497591637bf43fc418f5/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:24.056353 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b624e-8474-443d-b3f6-fbc2aeb28295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=746b5a83a469465cbd94f8f9dfa0db94, user_id=f654d7139eea497591637bf43fc418f5, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:24.059085 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b624e-8474-443d-b3f6-fbc2aeb28295 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:24.072854 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1423/2857] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:20:24 2022] PUT /identity/v3/projects/746b5a83a469465cbd94f8f9dfa0db94/users/f654d7139eea497591637bf43fc418f5/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:24.079727 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3d42f-abc7-4ce3-8824-3ad822b7c63b None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:24.080360 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3d42f-abc7-4ce3-8824-3ad822b7c63b None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:24.080599 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3d42f-abc7-4ce3-8824-3ad822b7c63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:24.100015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-cbd3d42f-abc7-4ce3-8824-3ad822b7c63b None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:24.101292 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-cbd3d42f-abc7-4ce3-8824-3ad822b7c63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:24.142458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:24.164969 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1435/2858] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 18 17:20:24.175743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b624e-8474-443d-b3f6-fbc2aeb28295 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:24.177569 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-5c0b624e-8474-443d-b3f6-fbc2aeb28295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:24.236522 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b624e-8474-443d-b3f6-fbc2aeb28295 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:24.240333 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dd487-f356-42e2-9aeb-cb4b7b35a20f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:24.240991 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dd487-f356-42e2-9aeb-cb4b7b35a20f service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:24.241278 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dd487-f356-42e2-9aeb-cb4b7b35a20f service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:24.241556 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dd487-f356-42e2-9aeb-cb4b7b35a20f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:24.251601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dd487-f356-42e2-9aeb-cb4b7b35a20f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:24.253050 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dd487-f356-42e2-9aeb-cb4b7b35a20f service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:24.263095 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1424/2859] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:20:24.928067 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f45be9-34e6-4d19-bc2a-952373e95c0c None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:24.928551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f45be9-34e6-4d19-bc2a-952373e95c0c None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:24.928952 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f45be9-34e6-4d19-bc2a-952373e95c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:24.964327 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f7f45be9-34e6-4d19-bc2a-952373e95c0c None None] MFA Rules not processed for user `f654d7139eea497591637bf43fc418f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:24.965852 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f7f45be9-34e6-4d19-bc2a-952373e95c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:25.072291 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1436/2860] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:25.083695 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dd487-f356-42e2-9aeb-cb4b7b35a20f service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:25.085328 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-d92dd487-f356-42e2-9aeb-cb4b7b35a20f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:25.163361 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dd487-f356-42e2-9aeb-cb4b7b35a20f service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:25.167140 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44b0af-595d-4b0c-a88e-e10b3d79eb33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:25.167798 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44b0af-595d-4b0c-a88e-e10b3d79eb33 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:25.168088 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44b0af-595d-4b0c-a88e-e10b3d79eb33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:25.168377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd44b0af-595d-4b0c-a88e-e10b3d79eb33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:25.178349 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44b0af-595d-4b0c-a88e-e10b3d79eb33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:25.181693 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd44b0af-595d-4b0c-a88e-e10b3d79eb33 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:25.191115 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1425/2861] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:20:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:20:26.194899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b086f8-08ae-466b-b8ce-cdd8a185c5a9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:26.195389 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b086f8-08ae-466b-b8ce-cdd8a185c5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:26.195498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b086f8-08ae-466b-b8ce-cdd8a185c5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:26.214101 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-e1b086f8-08ae-466b-b8ce-cdd8a185c5a9 None None] MFA Rules not processed for user `9692d55c8c924544a1bff62054731ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:26.215306 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-e1b086f8-08ae-466b-b8ce-cdd8a185c5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:26.271899 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1437/2862] 10.222.0.49 () {58 vars in 967 bytes} [Wed May 18 17:20:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:26.284284 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44b0af-595d-4b0c-a88e-e10b3d79eb33 service cinder] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:26.285743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-cd44b0af-595d-4b0c-a88e-e10b3d79eb33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:26.299958 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:26.359372 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd44b0af-595d-4b0c-a88e-e10b3d79eb33 service cinder] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:26.364574 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255be270-fcdd-42bb-a224-b2b827de7f4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b712c7f5fce54fe2a89d63863f3845f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:26.365441 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255be270-fcdd-42bb-a224-b2b827de7f4b service swift] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:26.365755 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255be270-fcdd-42bb-a224-b2b827de7f4b service swift] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:26.366037 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255be270-fcdd-42bb-a224-b2b827de7f4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:26.374388 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255be270-fcdd-42bb-a224-b2b827de7f4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:26.376713 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255be270-fcdd-42bb-a224-b2b827de7f4b service swift] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:26.384902 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1426/2863] 10.222.0.49 () {60 vars in 1384 bytes} [Wed May 18 17:20:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 18 17:20:26.595875 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a05a23-019f-4210-bd25-1e4ca6bbc75d None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:26.596264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a05a23-019f-4210-bd25-1e4ca6bbc75d None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:26.596552 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a05a23-019f-4210-bd25-1e4ca6bbc75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:26.616973 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-27a05a23-019f-4210-bd25-1e4ca6bbc75d None None] MFA Rules not processed for user `f654d7139eea497591637bf43fc418f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:20:26.618737 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-27a05a23-019f-4210-bd25-1e4ca6bbc75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:26.628585 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1438/2864] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:20:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:20:27.065130 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255be270-fcdd-42bb-a224-b2b827de7f4b service swift] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:27.075657 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255be270-fcdd-42bb-a224-b2b827de7f4b service swift] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:27.079508 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d641b9-da39-4631-a9e4-c8bd5484f2df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:27.080172 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d641b9-da39-4631-a9e4-c8bd5484f2df service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:27.080457 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d641b9-da39-4631-a9e4-c8bd5484f2df service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:27.080730 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d641b9-da39-4631-a9e4-c8bd5484f2df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:27.082572 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-76d641b9-da39-4631-a9e4-c8bd5484f2df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:27.092702 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d641b9-da39-4631-a9e4-c8bd5484f2df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:27.095252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d641b9-da39-4631-a9e4-c8bd5484f2df service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:27.105000 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1427/2865] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:20:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:20:32.609284 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a05a23-019f-4210-bd25-1e4ca6bbc75d None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:32.611104 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-27a05a23-019f-4210-bd25-1e4ca6bbc75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:32.623021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a05a23-019f-4210-bd25-1e4ca6bbc75d None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:32.627051 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95fd36-0b7f-4afe-add3-688c389dfee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:32.627702 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95fd36-0b7f-4afe-add3-688c389dfee9 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:32.627989 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95fd36-0b7f-4afe-add3-688c389dfee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:32.628268 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95fd36-0b7f-4afe-add3-688c389dfee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:32.630089 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-2a95fd36-0b7f-4afe-add3-688c389dfee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:32.643767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95fd36-0b7f-4afe-add3-688c389dfee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:32.645206 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95fd36-0b7f-4afe-add3-688c389dfee9 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:32.655325 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1439/2866] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:20:34.294166 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d641b9-da39-4631-a9e4-c8bd5484f2df service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:34.295993 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-76d641b9-da39-4631-a9e4-c8bd5484f2df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:34.319456 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d641b9-da39-4631-a9e4-c8bd5484f2df service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:34.324246 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262c888-fd99-4fd4-9967-e0cb36a15953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:34.325113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262c888-fd99-4fd4-9967-e0cb36a15953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:34.325577 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262c888-fd99-4fd4-9967-e0cb36a15953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:34.326125 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262c888-fd99-4fd4-9967-e0cb36a15953 admin admin] PATH_INFO: `/v3/users/6b0deb40045e47cba7ed81b1ae6b528d` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:34.328714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262c888-fd99-4fd4-9967-e0cb36a15953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b0deb40045e47cba7ed81b1ae6b528d)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:34.331025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262c888-fd99-4fd4-9967-e0cb36a15953 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:34.395786 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1262c888-fd99-4fd4-9967-e0cb36a15953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b0deb40045e47cba7ed81b1ae6b528d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:34.414797 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1262c888-fd99-4fd4-9967-e0cb36a15953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b0deb40045e47cba7ed81b1ae6b528d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:34.433741 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1262c888-fd99-4fd4-9967-e0cb36a15953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b0deb40045e47cba7ed81b1ae6b528d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:34.434571 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1262c888-fd99-4fd4-9967-e0cb36a15953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b0deb40045e47cba7ed81b1ae6b528d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:34.435314 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-1262c888-fd99-4fd4-9967-e0cb36a15953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b0deb40045e47cba7ed81b1ae6b528d'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:34.455714 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1428/2867] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:20:34 2022] DELETE /identity/v3/users/6b0deb40045e47cba7ed81b1ae6b528d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:34.637790 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95fd36-0b7f-4afe-add3-688c389dfee9 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:34.648571 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95fd36-0b7f-4afe-add3-688c389dfee9 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:34.702479 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=100 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:34.709236 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1f2c3-e004-4598-bec3-171970438704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:34.710156 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1f2c3-e004-4598-bec3-171970438704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:34.710442 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1f2c3-e004-4598-bec3-171970438704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:34.710716 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1f2c3-e004-4598-bec3-171970438704 admin admin] PATH_INFO: `/v3/projects/dd5a225077df40c6b99ae3e05740d44e` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:34.711956 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1f2c3-e004-4598-bec3-171970438704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5a225077df40c6b99ae3e05740d44e)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:34.713898 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1f2c3-e004-4598-bec3-171970438704 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:34.761955 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a4f1f2c3-e004-4598-bec3-171970438704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5a225077df40c6b99ae3e05740d44e', 'request_id': 'req-a4f1f2c3-e004-4598-bec3-171970438704'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:34.770911 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a4f1f2c3-e004-4598-bec3-171970438704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5a225077df40c6b99ae3e05740d44e', 'request_id': 'req-a4f1f2c3-e004-4598-bec3-171970438704'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:34.777503 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a4f1f2c3-e004-4598-bec3-171970438704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5a225077df40c6b99ae3e05740d44e', 'request_id': 'req-a4f1f2c3-e004-4598-bec3-171970438704'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:34.789892 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a4f1f2c3-e004-4598-bec3-171970438704 admin admin] The token cache is being invalidate because project dd5a225077df40c6b99ae3e05740d44e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:20:34.790203 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a4f1f2c3-e004-4598-bec3-171970438704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:34.790866 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a4f1f2c3-e004-4598-bec3-171970438704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:34.792422 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1440/2868] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:20:34 2022] DELETE /identity/v3/projects/dd5a225077df40c6b99ae3e05740d44e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:34.797338 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262c888-fd99-4fd4-9967-e0cb36a15953 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:34.799311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-1262c888-fd99-4fd4-9967-e0cb36a15953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:34.813172 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262c888-fd99-4fd4-9967-e0cb36a15953 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:34.871356 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79dcc9-08b4-4494-bc3f-ef6f01b12e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:34.872228 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79dcc9-08b4-4494-bc3f-ef6f01b12e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:34.872517 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79dcc9-08b4-4494-bc3f-ef6f01b12e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:34.872795 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79dcc9-08b4-4494-bc3f-ef6f01b12e7e admin admin] PATH_INFO: `/v3/users/a9af65e5c80443cba93526b47d20ba51` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:34.874018 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79dcc9-08b4-4494-bc3f-ef6f01b12e7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9af65e5c80443cba93526b47d20ba51)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:34.877009 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79dcc9-08b4-4494-bc3f-ef6f01b12e7e admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:34.878536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:34.931397 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bc79dcc9-08b4-4494-bc3f-ef6f01b12e7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9af65e5c80443cba93526b47d20ba51'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:34.939329 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bc79dcc9-08b4-4494-bc3f-ef6f01b12e7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9af65e5c80443cba93526b47d20ba51'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:34.951273 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bc79dcc9-08b4-4494-bc3f-ef6f01b12e7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9af65e5c80443cba93526b47d20ba51'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:34.951996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bc79dcc9-08b4-4494-bc3f-ef6f01b12e7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9af65e5c80443cba93526b47d20ba51'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:34.952603 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-bc79dcc9-08b4-4494-bc3f-ef6f01b12e7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9af65e5c80443cba93526b47d20ba51'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:34.965396 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1429/2869] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:20:34 2022] DELETE /identity/v3/users/a9af65e5c80443cba93526b47d20ba51 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:35.174908 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1f2c3-e004-4598-bec3-171970438704 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:20:35.176401 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-a4f1f2c3-e004-4598-bec3-171970438704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:20:35.202611 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1f2c3-e004-4598-bec3-171970438704 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:20:35.274966 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f9558-8a49-4c62-ad31-fd6f0cb3eaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:20:35.276253 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f9558-8a49-4c62-ad31-fd6f0cb3eaff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:20:35.276626 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f9558-8a49-4c62-ad31-fd6f0cb3eaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:20:35.276910 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f9558-8a49-4c62-ad31-fd6f0cb3eaff admin admin] PATH_INFO: `/v3/projects/0bc033640bb846018ee08c989d4da012` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:20:35.278182 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f9558-8a49-4c62-ad31-fd6f0cb3eaff admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc033640bb846018ee08c989d4da012)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:20:35.280164 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f9558-8a49-4c62-ad31-fd6f0cb3eaff admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:20:35.332877 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d08f9558-8a49-4c62-ad31-fd6f0cb3eaff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc033640bb846018ee08c989d4da012', 'request_id': 'req-d08f9558-8a49-4c62-ad31-fd6f0cb3eaff'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:35.341710 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d08f9558-8a49-4c62-ad31-fd6f0cb3eaff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc033640bb846018ee08c989d4da012', 'request_id': 'req-d08f9558-8a49-4c62-ad31-fd6f0cb3eaff'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:35.350134 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d08f9558-8a49-4c62-ad31-fd6f0cb3eaff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc033640bb846018ee08c989d4da012', 'request_id': 'req-d08f9558-8a49-4c62-ad31-fd6f0cb3eaff'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:35.361246 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d08f9558-8a49-4c62-ad31-fd6f0cb3eaff admin admin] The token cache is being invalidate because project 0bc033640bb846018ee08c989d4da012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:20:35.361535 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d08f9558-8a49-4c62-ad31-fd6f0cb3eaff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:35.362234 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-d08f9558-8a49-4c62-ad31-fd6f0cb3eaff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:20:35.363835 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1441/2870] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:20:35 2022] DELETE /identity/v3/projects/0bc033640bb846018ee08c989d4da012 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:20:44.961903 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:45.357557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=76,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:21:00.578924 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79dcc9-08b4-4494-bc3f-ef6f01b12e7e admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:21:00.586876 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-bc79dcc9-08b4-4494-bc3f-ef6f01b12e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:00.594643 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79dcc9-08b4-4494-bc3f-ef6f01b12e7e admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:21:00.650878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52107f-d007-491f-8952-328c1f51e8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:21:00.651745 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52107f-d007-491f-8952-328c1f51e8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:00.652034 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52107f-d007-491f-8952-328c1f51e8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:00.652311 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52107f-d007-491f-8952-328c1f51e8c0 admin admin] PATH_INFO: `/v3/users/68c6a2170dff477593968572816d436b` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:00.653506 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52107f-d007-491f-8952-328c1f51e8c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c6a2170dff477593968572816d436b)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:21:00.655456 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52107f-d007-491f-8952-328c1f51e8c0 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:21:00.700831 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fb52107f-d007-491f-8952-328c1f51e8c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c6a2170dff477593968572816d436b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:00.708308 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fb52107f-d007-491f-8952-328c1f51e8c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c6a2170dff477593968572816d436b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:00.720438 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fb52107f-d007-491f-8952-328c1f51e8c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c6a2170dff477593968572816d436b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:00.721176 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fb52107f-d007-491f-8952-328c1f51e8c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c6a2170dff477593968572816d436b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:00.721895 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-fb52107f-d007-491f-8952-328c1f51e8c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c6a2170dff477593968572816d436b'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:00.734922 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1430/2871] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:21:00 2022] DELETE /identity/v3/users/68c6a2170dff477593968572816d436b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:21:00.739522 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fbff9-8b0c-45b2-92b9-78be0e7aebd4 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:00.740017 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fbff9-8b0c-45b2-92b9-78be0e7aebd4 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:00.740126 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979fbff9-8b0c-45b2-92b9-78be0e7aebd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:00.758684 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-979fbff9-8b0c-45b2-92b9-78be0e7aebd4 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:21:00.759897 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-979fbff9-8b0c-45b2-92b9-78be0e7aebd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:00.821530 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1442/2872] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:21:00.832054 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52107f-d007-491f-8952-328c1f51e8c0 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:21:00.833473 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-fb52107f-d007-491f-8952-328c1f51e8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:00.891365 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52107f-d007-491f-8952-328c1f51e8c0 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:21:00.895029 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2091c-41ad-4b54-8ade-62fe77c8ceda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:21:00.895688 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2091c-41ad-4b54-8ade-62fe77c8ceda service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:00.895975 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2091c-41ad-4b54-8ade-62fe77c8ceda service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:00.896252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2091c-41ad-4b54-8ade-62fe77c8ceda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:00.905389 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2091c-41ad-4b54-8ade-62fe77c8ceda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:21:00.907074 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2091c-41ad-4b54-8ade-62fe77c8ceda service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:21:00.916590 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1431/2873] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:21:01.193905 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979fbff9-8b0c-45b2-92b9-78be0e7aebd4 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:21:01.195348 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-979fbff9-8b0c-45b2-92b9-78be0e7aebd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:01.207770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979fbff9-8b0c-45b2-92b9-78be0e7aebd4 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:21:01.213017 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087629bd-a6c9-41e0-b64e-a2caeeec5fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:21:01.213959 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087629bd-a6c9-41e0-b64e-a2caeeec5fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:01.214243 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087629bd-a6c9-41e0-b64e-a2caeeec5fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:01.215137 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087629bd-a6c9-41e0-b64e-a2caeeec5fe7 admin admin] PATH_INFO: `/v3/projects/b67f1e2ceac8444db336f6bfc240d92d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:01.216585 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087629bd-a6c9-41e0-b64e-a2caeeec5fe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b67f1e2ceac8444db336f6bfc240d92d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:21:01.218566 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087629bd-a6c9-41e0-b64e-a2caeeec5fe7 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:21:01.266630 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-087629bd-a6c9-41e0-b64e-a2caeeec5fe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b67f1e2ceac8444db336f6bfc240d92d', 'request_id': 'req-087629bd-a6c9-41e0-b64e-a2caeeec5fe7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:01.273837 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-087629bd-a6c9-41e0-b64e-a2caeeec5fe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b67f1e2ceac8444db336f6bfc240d92d', 'request_id': 'req-087629bd-a6c9-41e0-b64e-a2caeeec5fe7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:01.280271 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-087629bd-a6c9-41e0-b64e-a2caeeec5fe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b67f1e2ceac8444db336f6bfc240d92d', 'request_id': 'req-087629bd-a6c9-41e0-b64e-a2caeeec5fe7'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:01.290805 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-087629bd-a6c9-41e0-b64e-a2caeeec5fe7 admin admin] The token cache is being invalidate because project b67f1e2ceac8444db336f6bfc240d92d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:21:01.291094 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-087629bd-a6c9-41e0-b64e-a2caeeec5fe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:01.291738 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-087629bd-a6c9-41e0-b64e-a2caeeec5fe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:01.293291 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1443/2874] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:21:01 2022] DELETE /identity/v3/projects/b67f1e2ceac8444db336f6bfc240d92d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:21:01.298999 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04309f79-d2c2-4e0d-a6ac-63613862c8c5 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:01.299292 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04309f79-d2c2-4e0d-a6ac-63613862c8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:01.299573 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04309f79-d2c2-4e0d-a6ac-63613862c8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:01.318786 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-04309f79-d2c2-4e0d-a6ac-63613862c8c5 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:21:01.319996 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-04309f79-d2c2-4e0d-a6ac-63613862c8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:01.336661 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:21:01.382360 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1432/2875] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:21:01.390312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaff49-dd3f-4895-bd34-0e43366d8153 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:01.391058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaff49-dd3f-4895-bd34-0e43366d8153 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:01.391058 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaff49-dd3f-4895-bd34-0e43366d8153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:01.408887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-74aaff49-dd3f-4895-bd34-0e43366d8153 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:21:01.410119 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-74aaff49-dd3f-4895-bd34-0e43366d8153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:01.417909 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1444/2876] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:21:01.422979 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04309f79-d2c2-4e0d-a6ac-63613862c8c5 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:21:01.433071 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04309f79-d2c2-4e0d-a6ac-63613862c8c5 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:21:01.438175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41bb9d-8361-47d5-849e-6f1db16ed2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:21:01.438839 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41bb9d-8361-47d5-849e-6f1db16ed2cb admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:01.439124 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41bb9d-8361-47d5-849e-6f1db16ed2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:01.439405 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41bb9d-8361-47d5-849e-6f1db16ed2cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:01.440137 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41bb9d-8361-47d5-849e-6f1db16ed2cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 18 17:21:01.440444 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41bb9d-8361-47d5-849e-6f1db16ed2cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:21:01.442099 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41bb9d-8361-47d5-849e-6f1db16ed2cb admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:21:01.454057 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1433/2877] 10.222.0.49 () {58 vars in 1152 bytes} [Wed May 18 17:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 18 17:21:01.458433 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaff49-dd3f-4895-bd34-0e43366d8153 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:21:01.467705 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaff49-dd3f-4895-bd34-0e43366d8153 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:21:01.473521 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edd35d-85af-46bc-8a39-7bc50f4bc87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:21:01.474212 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edd35d-85af-46bc-8a39-7bc50f4bc87e admin admin] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:01.474527 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edd35d-85af-46bc-8a39-7bc50f4bc87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:01.474808 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edd35d-85af-46bc-8a39-7bc50f4bc87e admin admin] PATH_INFO: `/v3/projects` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:01.475495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edd35d-85af-46bc-8a39-7bc50f4bc87e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:21:01.477396 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edd35d-85af-46bc-8a39-7bc50f4bc87e admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:21:01.504328 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1445/2878] 10.222.0.49 () {60 vars in 1152 bytes} [Wed May 18 17:21:01 2022] POST /identity/v3/projects => generated 397 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:21:01.508674 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41bb9d-8361-47d5-849e-6f1db16ed2cb admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:21:01.518982 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41bb9d-8361-47d5-849e-6f1db16ed2cb admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:21:01.575642 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fd567-69f6-49ae-8694-9375bf610c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:21:01.576313 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fd567-69f6-49ae-8694-9375bf610c56 admin admin] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:01.576601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fd567-69f6-49ae-8694-9375bf610c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:01.576886 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fd567-69f6-49ae-8694-9375bf610c56 admin admin] PATH_INFO: `/v3/users` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:01.577589 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fd567-69f6-49ae-8694-9375bf610c56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:21:01.579573 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fd567-69f6-49ae-8694-9375bf610c56 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:21:01.601342 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1434/2879] 10.222.0.49 () {60 vars in 1143 bytes} [Wed May 18 17:21:01 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 18 17:21:01.605405 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edd35d-85af-46bc-8a39-7bc50f4bc87e admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:21:01.617312 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edd35d-85af-46bc-8a39-7bc50f4bc87e admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:21:01.622160 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b7f1a-d538-4e79-92b7-898dd9809c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:21:01.622831 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b7f1a-d538-4e79-92b7-898dd9809c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:01.623125 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b7f1a-d538-4e79-92b7-898dd9809c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:01.623403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b7f1a-d538-4e79-92b7-898dd9809c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:01.624210 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b7f1a-d538-4e79-92b7-898dd9809c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:21:01.626627 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b7f1a-d538-4e79-92b7-898dd9809c69 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:21:01.643136 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1446/2880] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:21:01.648069 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fd567-69f6-49ae-8694-9375bf610c56 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:21:01.659524 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fd567-69f6-49ae-8694-9375bf610c56 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:21:01.664279 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96754c70-688d-4a57-bbd9-8914c3bbacfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:21:01.664937 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96754c70-688d-4a57-bbd9-8914c3bbacfb admin admin] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:01.665227 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96754c70-688d-4a57-bbd9-8914c3bbacfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:01.665508 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96754c70-688d-4a57-bbd9-8914c3bbacfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:01.666273 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96754c70-688d-4a57-bbd9-8914c3bbacfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:21:01.667878 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96754c70-688d-4a57-bbd9-8914c3bbacfb admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:21:01.679128 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1435/2881] 10.222.0.49 () {58 vars in 1121 bytes} [Wed May 18 17:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 18 17:21:01.683524 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b7f1a-d538-4e79-92b7-898dd9809c69 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:21:01.694015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b7f1a-d538-4e79-92b7-898dd9809c69 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:21:01.698694 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c76ed-ed5e-45cd-b833-b521364966a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:21:01.699564 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c76ed-ed5e-45cd-b833-b521364966a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:01.699847 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c76ed-ed5e-45cd-b833-b521364966a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:01.700124 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c76ed-ed5e-45cd-b833-b521364966a0 admin admin] PATH_INFO: `/v3/projects/c8b3fea53d75425bab26fc01c44410f9/users/c1506a5db54946698e7e98e7cc012339/roles/bfec786c9ea74c4aaecf243a866539af` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:01.714792 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c76ed-ed5e-45cd-b833-b521364966a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b3fea53d75425bab26fc01c44410f9, user_id=c1506a5db54946698e7e98e7cc012339, role_id=bfec786c9ea74c4aaecf243a866539af)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:21:01.717456 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c76ed-ed5e-45cd-b833-b521364966a0 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:21:01.732557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1447/2882] 10.222.0.49 () {60 vars in 1482 bytes} [Wed May 18 17:21:01 2022] PUT /identity/v3/projects/c8b3fea53d75425bab26fc01c44410f9/users/c1506a5db54946698e7e98e7cc012339/roles/bfec786c9ea74c4aaecf243a866539af => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:21:01.744434 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32820f2-9dcc-4534-bc2e-30d5a8ce4eb3 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:01.744732 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32820f2-9dcc-4534-bc2e-30d5a8ce4eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:01.745020 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32820f2-9dcc-4534-bc2e-30d5a8ce4eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:01.771515 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-a32820f2-9dcc-4534-bc2e-30d5a8ce4eb3 None None] MFA Rules not processed for user `c1506a5db54946698e7e98e7cc012339`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:21:01.772750 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-a32820f2-9dcc-4534-bc2e-30d5a8ce4eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:01.842932 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1436/2883] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:21:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:21:01.854948 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c76ed-ed5e-45cd-b833-b521364966a0 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:21:01.856714 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-234c76ed-ed5e-45cd-b833-b521364966a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:01.878697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:21:01.916861 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c76ed-ed5e-45cd-b833-b521364966a0 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:21:01.920556 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e1a82-dc66-43cc-a435-46ee09c2819e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:21:01.921195 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e1a82-dc66-43cc-a435-46ee09c2819e service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:01.921544 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e1a82-dc66-43cc-a435-46ee09c2819e service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:01.921859 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e1a82-dc66-43cc-a435-46ee09c2819e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:01.930309 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e1a82-dc66-43cc-a435-46ee09c2819e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:21:01.931750 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e1a82-dc66-43cc-a435-46ee09c2819e service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:21:01.940709 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1448/2884] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:21:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:21:04.850802 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32820f2-9dcc-4534-bc2e-30d5a8ce4eb3 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:21:04.860743 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32820f2-9dcc-4534-bc2e-30d5a8ce4eb3 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:21:04.864318 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e73d76-a830-4e6d-a060-71027fecef09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:21:04.864959 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e73d76-a830-4e6d-a060-71027fecef09 service cinder] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:04.865245 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e73d76-a830-4e6d-a060-71027fecef09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:04.865525 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e73d76-a830-4e6d-a060-71027fecef09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:04.867332 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-99e73d76-a830-4e6d-a060-71027fecef09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:04.881516 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:21:04.942250 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e73d76-a830-4e6d-a060-71027fecef09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:21:04.943707 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e73d76-a830-4e6d-a060-71027fecef09 service cinder] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:21:04.955571 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1437/2885] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:21:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:21:11.936510 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=17 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:21:12.128893 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e1a82-dc66-43cc-a435-46ee09c2819e service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:21:12.199192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e1a82-dc66-43cc-a435-46ee09c2819e service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:21:12.204496 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a628674-f362-4964-8101-b3e1e701b3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:21:12.205397 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a628674-f362-4964-8101-b3e1e701b3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:12.205715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a628674-f362-4964-8101-b3e1e701b3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:12.206004 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a628674-f362-4964-8101-b3e1e701b3d3 admin admin] PATH_INFO: `/v3/users/c1506a5db54946698e7e98e7cc012339` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:12.207268 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a628674-f362-4964-8101-b3e1e701b3d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1506a5db54946698e7e98e7cc012339)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:21:12.209239 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a628674-f362-4964-8101-b3e1e701b3d3 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:21:12.262968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a628674-f362-4964-8101-b3e1e701b3d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1506a5db54946698e7e98e7cc012339'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:12.263650 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a628674-f362-4964-8101-b3e1e701b3d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1506a5db54946698e7e98e7cc012339'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:12.275329 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a628674-f362-4964-8101-b3e1e701b3d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1506a5db54946698e7e98e7cc012339'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:12.283753 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a628674-f362-4964-8101-b3e1e701b3d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1506a5db54946698e7e98e7cc012339'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:12.297152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a628674-f362-4964-8101-b3e1e701b3d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1506a5db54946698e7e98e7cc012339'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:12.303990 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1449/2886] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:21:12 2022] DELETE /identity/v3/users/c1506a5db54946698e7e98e7cc012339 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:21:12.308732 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15c886-11bc-433e-9b20-b61739d9a693 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:12.309267 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15c886-11bc-433e-9b20-b61739d9a693 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:12.309378 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15c886-11bc-433e-9b20-b61739d9a693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:12.330252 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-9b15c886-11bc-433e-9b20-b61739d9a693 None None] MFA Rules not processed for user `4f9da66f38394711b45d0352bd9b4158`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:21:12.331498 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9b15c886-11bc-433e-9b20-b61739d9a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:12.404612 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1438/2887] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:21:12.415774 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a628674-f362-4964-8101-b3e1e701b3d3 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:21:12.417353 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-6a628674-f362-4964-8101-b3e1e701b3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:12.484230 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a628674-f362-4964-8101-b3e1e701b3d3 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:21:12.489097 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e7dbc-9c6e-46ae-8a7c-5a10b16e1d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:21:12.489832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e7dbc-9c6e-46ae-8a7c-5a10b16e1d2c service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:12.490121 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e7dbc-9c6e-46ae-8a7c-5a10b16e1d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:12.490403 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e7dbc-9c6e-46ae-8a7c-5a10b16e1d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:12.501305 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e7dbc-9c6e-46ae-8a7c-5a10b16e1d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:21:12.502857 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e7dbc-9c6e-46ae-8a7c-5a10b16e1d2c service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:21:12.514152 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1450/2888] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:21:12.817275 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15c886-11bc-433e-9b20-b61739d9a693 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:21:12.818749 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9b15c886-11bc-433e-9b20-b61739d9a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:12.831963 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15c886-11bc-433e-9b20-b61739d9a693 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:21:12.836735 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b4823-e32f-43ff-bb62-8c4ea9039b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:21:12.837617 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b4823-e32f-43ff-bb62-8c4ea9039b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:12.837929 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b4823-e32f-43ff-bb62-8c4ea9039b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:12.838202 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b4823-e32f-43ff-bb62-8c4ea9039b39 admin admin] PATH_INFO: `/v3/projects/c8b3fea53d75425bab26fc01c44410f9` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:12.839432 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b4823-e32f-43ff-bb62-8c4ea9039b39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b3fea53d75425bab26fc01c44410f9)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:21:12.841385 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b4823-e32f-43ff-bb62-8c4ea9039b39 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:21:12.898525 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-237b4823-e32f-43ff-bb62-8c4ea9039b39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b3fea53d75425bab26fc01c44410f9', 'request_id': 'req-237b4823-e32f-43ff-bb62-8c4ea9039b39'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:12.907965 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-237b4823-e32f-43ff-bb62-8c4ea9039b39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b3fea53d75425bab26fc01c44410f9', 'request_id': 'req-237b4823-e32f-43ff-bb62-8c4ea9039b39'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:12.918944 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-237b4823-e32f-43ff-bb62-8c4ea9039b39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b3fea53d75425bab26fc01c44410f9', 'request_id': 'req-237b4823-e32f-43ff-bb62-8c4ea9039b39'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:12.935962 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-237b4823-e32f-43ff-bb62-8c4ea9039b39 admin admin] The token cache is being invalidate because project c8b3fea53d75425bab26fc01c44410f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:21:12.936251 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-237b4823-e32f-43ff-bb62-8c4ea9039b39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:12.937061 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-237b4823-e32f-43ff-bb62-8c4ea9039b39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:21:12.939668 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1439/2889] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:21:12 2022] DELETE /identity/v3/projects/c8b3fea53d75425bab26fc01c44410f9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:21:22.508945 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:21:22.932529 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:21:35.612379 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e7dbc-9c6e-46ae-8a7c-5a10b16e1d2c service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:21:35.613832 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-aa4e7dbc-9c6e-46ae-8a7c-5a10b16e1d2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:35.670281 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e7dbc-9c6e-46ae-8a7c-5a10b16e1d2c service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:21:35.718557 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8cccc-e8e2-474f-a3e4-d3782ee7eca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:21:35.719458 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8cccc-e8e2-474f-a3e4-d3782ee7eca0 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:35.719740 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8cccc-e8e2-474f-a3e4-d3782ee7eca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:35.720015 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8cccc-e8e2-474f-a3e4-d3782ee7eca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:35.721830 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-52d8cccc-e8e2-474f-a3e4-d3782ee7eca0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:35.792161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8cccc-e8e2-474f-a3e4-d3782ee7eca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:21:35.793512 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8cccc-e8e2-474f-a3e4-d3782ee7eca0 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:21:35.805354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1451/2890] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:21:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:21:45.800474 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=74 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:21:51.563583 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e984c4-10c7-4ae1-8d0d-1f03af0447e5 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:51.564173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e984c4-10c7-4ae1-8d0d-1f03af0447e5 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:51.564173 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e984c4-10c7-4ae1-8d0d-1f03af0447e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:51.583705 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-52e984c4-10c7-4ae1-8d0d-1f03af0447e5 None None] MFA Rules not processed for user `f654d7139eea497591637bf43fc418f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:21:51.584947 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-52e984c4-10c7-4ae1-8d0d-1f03af0447e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:51.645977 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1440/2891] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:21:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:21:52.239270 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8cccc-e8e2-474f-a3e4-d3782ee7eca0 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:21:52.240891 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-52d8cccc-e8e2-474f-a3e4-d3782ee7eca0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:52.321237 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8cccc-e8e2-474f-a3e4-d3782ee7eca0 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:21:52.326362 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6ce6c-3ce8-41d6-88aa-79b64a7fc6e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bebc8414d01a40c8ab34afa9b1312a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:21:52.327081 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6ce6c-3ce8-41d6-88aa-79b64a7fc6e5 service placement] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:52.327370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6ce6c-3ce8-41d6-88aa-79b64a7fc6e5 service placement] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:52.327370 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6ce6c-3ce8-41d6-88aa-79b64a7fc6e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:52.329763 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-54e6ce6c-3ce8-41d6-88aa-79b64a7fc6e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:52.342481 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6ce6c-3ce8-41d6-88aa-79b64a7fc6e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:21:52.344968 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6ce6c-3ce8-41d6-88aa-79b64a7fc6e5 service placement] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:21:52.356080 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1452/2892] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:21:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:21:54.142427 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e984c4-10c7-4ae1-8d0d-1f03af0447e5 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:21:54.144576 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-52e984c4-10c7-4ae1-8d0d-1f03af0447e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:54.211815 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e984c4-10c7-4ae1-8d0d-1f03af0447e5 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:21:54.215699 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a4326-9cd8-4812-b2c1-a6dc6172b811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:21:54.216377 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a4326-9cd8-4812-b2c1-a6dc6172b811 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:21:54.216663 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a4326-9cd8-4812-b2c1-a6dc6172b811 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:21:54.216944 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a4326-9cd8-4812-b2c1-a6dc6172b811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:21:54.219911 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-9e8a4326-9cd8-4812-b2c1-a6dc6172b811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:21:54.230571 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a4326-9cd8-4812-b2c1-a6dc6172b811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:21:54.232054 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a4326-9cd8-4812-b2c1-a6dc6172b811 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:21:54.242194 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1441/2893] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:21:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:22:02.351342 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=32 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:22:04.237602 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=51 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:22:56.923887 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6ce6c-3ce8-41d6-88aa-79b64a7fc6e5 service placement] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:22:56.925495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-54e6ce6c-3ce8-41d6-88aa-79b64a7fc6e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:22:57.010770 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6ce6c-3ce8-41d6-88aa-79b64a7fc6e5 service placement] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:22:57.015547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8293ed-8fc7-4966-94e3-92faf8678415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:22:57.016464 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8293ed-8fc7-4966-94e3-92faf8678415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:22:57.016754 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8293ed-8fc7-4966-94e3-92faf8678415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:22:57.017026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8293ed-8fc7-4966-94e3-92faf8678415 admin admin] PATH_INFO: `/v3/users/f654d7139eea497591637bf43fc418f5` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:22:57.018301 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8293ed-8fc7-4966-94e3-92faf8678415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f654d7139eea497591637bf43fc418f5)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:22:57.021280 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8293ed-8fc7-4966-94e3-92faf8678415 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:22:57.079522 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a8293ed-8fc7-4966-94e3-92faf8678415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f654d7139eea497591637bf43fc418f5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:22:57.080177 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a8293ed-8fc7-4966-94e3-92faf8678415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f654d7139eea497591637bf43fc418f5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:22:57.090691 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a8293ed-8fc7-4966-94e3-92faf8678415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f654d7139eea497591637bf43fc418f5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:22:57.099027 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a8293ed-8fc7-4966-94e3-92faf8678415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f654d7139eea497591637bf43fc418f5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:22:57.114264 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-6a8293ed-8fc7-4966-94e3-92faf8678415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f654d7139eea497591637bf43fc418f5'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:22:57.120456 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1453/2894] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:22:56 2022] DELETE /identity/v3/users/f654d7139eea497591637bf43fc418f5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:22:57.306023 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a4326-9cd8-4812-b2c1-a6dc6172b811 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:22:57.324062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a4326-9cd8-4812-b2c1-a6dc6172b811 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:22:57.388218 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b014e1-8823-4274-b03d-78bf9901ec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:22:57.389087 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b014e1-8823-4274-b03d-78bf9901ec67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:22:57.389371 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b014e1-8823-4274-b03d-78bf9901ec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:22:57.389649 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b014e1-8823-4274-b03d-78bf9901ec67 admin admin] PATH_INFO: `/v3/projects/746b5a83a469465cbd94f8f9dfa0db94` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:22:57.390931 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b014e1-8823-4274-b03d-78bf9901ec67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=746b5a83a469465cbd94f8f9dfa0db94)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:22:57.392856 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b014e1-8823-4274-b03d-78bf9901ec67 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:22:57.443561 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-28b014e1-8823-4274-b03d-78bf9901ec67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '746b5a83a469465cbd94f8f9dfa0db94', 'request_id': 'req-28b014e1-8823-4274-b03d-78bf9901ec67'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:22:57.449776 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-28b014e1-8823-4274-b03d-78bf9901ec67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '746b5a83a469465cbd94f8f9dfa0db94', 'request_id': 'req-28b014e1-8823-4274-b03d-78bf9901ec67'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:22:57.456497 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-28b014e1-8823-4274-b03d-78bf9901ec67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '746b5a83a469465cbd94f8f9dfa0db94', 'request_id': 'req-28b014e1-8823-4274-b03d-78bf9901ec67'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:22:57.470990 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-28b014e1-8823-4274-b03d-78bf9901ec67 admin admin] The token cache is being invalidate because project 746b5a83a469465cbd94f8f9dfa0db94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:22:57.471273 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-28b014e1-8823-4274-b03d-78bf9901ec67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:22:57.471919 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-28b014e1-8823-4274-b03d-78bf9901ec67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:22:57.473530 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1442/2895] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:22:57 2022] DELETE /identity/v3/projects/746b5a83a469465cbd94f8f9dfa0db94 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:23:07.116839 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:23:07.467367 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:23:31.279983 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b93934-45fc-4db9-9b22-ed1ef4d9dde9 None None] REQUEST_METHOD: `POST` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:23:31.280565 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b93934-45fc-4db9-9b22-ed1ef4d9dde9 None None] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:23:31.280979 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b93934-45fc-4db9-9b22-ed1ef4d9dde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:23:31.314767 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.auth.core [None req-f9b93934-45fc-4db9-9b22-ed1ef4d9dde9 None None] MFA Rules not processed for user `53394412ea1f463196acd85c7e11621c`. Rule list: `[]` (Enabled: `True`). {{(pid=80344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:23:31.316102 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f9b93934-45fc-4db9-9b22-ed1ef4d9dde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:23:31.387354 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1454/2896] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:23:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:23:41.378820 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=25 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:23:47.407706 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b014e1-8823-4274-b03d-78bf9901ec67 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:23:47.410402 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-28b014e1-8823-4274-b03d-78bf9901ec67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:23:47.521712 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b014e1-8823-4274-b03d-78bf9901ec67 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:23:47.528506 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c213cc-91b2-40ae-a1bd-db35e64a816f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:23:47.528506 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c213cc-91b2-40ae-a1bd-db35e64a816f service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:23:47.528506 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c213cc-91b2-40ae-a1bd-db35e64a816f service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:23:47.528965 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c213cc-91b2-40ae-a1bd-db35e64a816f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:23:47.530608 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f3c213cc-91b2-40ae-a1bd-db35e64a816f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:23:47.545197 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c213cc-91b2-40ae-a1bd-db35e64a816f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:23:47.546865 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c213cc-91b2-40ae-a1bd-db35e64a816f service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:23:47.559014 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1443/2897] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:23:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:23:52.425102 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b93934-45fc-4db9-9b22-ed1ef4d9dde9 None None] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:23:52.427156 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f9b93934-45fc-4db9-9b22-ed1ef4d9dde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:23:52.443586 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b93934-45fc-4db9-9b22-ed1ef4d9dde9 None None] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:23:52.449288 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b478e-690c-4f3f-bb98-c62cdd6525b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:23:52.449981 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b478e-690c-4f3f-bb98-c62cdd6525b9 service nova] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:23:52.450314 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b478e-690c-4f3f-bb98-c62cdd6525b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:23:52.450517 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b478e-690c-4f3f-bb98-c62cdd6525b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:23:52.453021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-491b478e-690c-4f3f-bb98-c62cdd6525b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:23:52.467339 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b478e-690c-4f3f-bb98-c62cdd6525b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:23:52.468976 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b478e-690c-4f3f-bb98-c62cdd6525b9 service nova] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:23:52.482162 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1455/2898] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:23:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:23:57.553877 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=34 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:24:02.476428 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:25:09.749632 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c213cc-91b2-40ae-a1bd-db35e64a816f service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:25:09.751116 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f3c213cc-91b2-40ae-a1bd-db35e64a816f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:25:09.824231 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c213cc-91b2-40ae-a1bd-db35e64a816f service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:25:09.829282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2f746-d53a-40fd-872a-42d618f27a13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bebc8414d01a40c8ab34afa9b1312a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:25:09.829959 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2f746-d53a-40fd-872a-42d618f27a13 service placement] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:25:09.830278 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2f746-d53a-40fd-872a-42d618f27a13 service placement] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:25:09.830557 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2f746-d53a-40fd-872a-42d618f27a13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:25:09.832347 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b6b2f746-d53a-40fd-872a-42d618f27a13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:25:09.844884 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2f746-d53a-40fd-872a-42d618f27a13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:25:09.846789 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2f746-d53a-40fd-872a-42d618f27a13 service placement] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:25:09.859084 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1444/2899] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:25:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:25:19.854291 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=32 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:25:41.375410 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b478e-690c-4f3f-bb98-c62cdd6525b9 service nova] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:25:41.376440 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-491b478e-690c-4f3f-bb98-c62cdd6525b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:25:41.436087 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b478e-690c-4f3f-bb98-c62cdd6525b9 service nova] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:25:41.439941 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca726bd-5830-44bd-9d09-0157ce7315f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '102a6c55061040129802a9739f43036a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:25:41.440587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca726bd-5830-44bd-9d09-0157ce7315f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:25:41.440869 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca726bd-5830-44bd-9d09-0157ce7315f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:25:41.441143 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca726bd-5830-44bd-9d09-0157ce7315f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:25:41.443023 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8ca726bd-5830-44bd-9d09-0157ce7315f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:25:41.454939 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca726bd-5830-44bd-9d09-0157ce7315f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:25:41.456394 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca726bd-5830-44bd-9d09-0157ce7315f0 service cinder] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:25:41.467260 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1456/2900] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:25:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:25:51.461648 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=26 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:25:51.521494 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fceed8-a6cd-4698-9688-f5790fff6a65 None None] REQUEST_METHOD: `POST` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:25:51.522062 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fceed8-a6cd-4698-9688-f5790fff6a65 None None] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:25:51.522175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fceed8-a6cd-4698-9688-f5790fff6a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:25:51.539013 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.auth.core [None req-31fceed8-a6cd-4698-9688-f5790fff6a65 None None] MFA Rules not processed for user `53394412ea1f463196acd85c7e11621c`. Rule list: `[]` (Enabled: `True`). {{(pid=80345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 18 17:25:51.540717 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-31fceed8-a6cd-4698-9688-f5790fff6a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:25:51.547569 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1445/2901] 10.222.0.49 () {58 vars in 957 bytes} [Wed May 18 17:25:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 18 17:25:51.870443 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca726bd-5830-44bd-9d09-0157ce7315f0 service cinder] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:25:51.871801 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-8ca726bd-5830-44bd-9d09-0157ce7315f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:25:51.928392 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca726bd-5830-44bd-9d09-0157ce7315f0 service cinder] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:25:51.932827 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399a1af-3358-4320-a83a-917e53b34f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:25:51.933467 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399a1af-3358-4320-a83a-917e53b34f14 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:25:51.933786 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399a1af-3358-4320-a83a-917e53b34f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:25:51.934064 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399a1af-3358-4320-a83a-917e53b34f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:25:51.935828 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4399a1af-3358-4320-a83a-917e53b34f14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:25:51.945291 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399a1af-3358-4320-a83a-917e53b34f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:25:51.946811 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399a1af-3358-4320-a83a-917e53b34f14 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:25:51.954725 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1457/2902] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:25:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:25:54.893430 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fceed8-a6cd-4698-9688-f5790fff6a65 None None] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:25:54.927785 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fceed8-a6cd-4698-9688-f5790fff6a65 None None] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:25:54.937345 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee3556-bf0a-4f30-9382-6da096d71d16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e3c0ef5ed943d183b064f383fc01f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:25:54.938147 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee3556-bf0a-4f30-9382-6da096d71d16 service nova] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:25:54.938507 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee3556-bf0a-4f30-9382-6da096d71d16 service nova] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:25:54.938906 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee3556-bf0a-4f30-9382-6da096d71d16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:25:54.941025 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-b5ee3556-bf0a-4f30-9382-6da096d71d16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:25:54.956773 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee3556-bf0a-4f30-9382-6da096d71d16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:25:54.958485 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee3556-bf0a-4f30-9382-6da096d71d16 service nova] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:25:54.972994 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1446/2903] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:25:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:26:01.951192 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=26 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:26:04.965810 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=9 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:26:05.277797 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399a1af-3358-4320-a83a-917e53b34f14 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:26:05.279295 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-4399a1af-3358-4320-a83a-917e53b34f14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:26:05.289672 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399a1af-3358-4320-a83a-917e53b34f14 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:26:05.293335 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9eb98-1b62-480c-a150-0c14578ce319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:26:05.293995 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9eb98-1b62-480c-a150-0c14578ce319 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:26:05.294273 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9eb98-1b62-480c-a150-0c14578ce319 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:26:05.294547 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9eb98-1b62-480c-a150-0c14578ce319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:26:05.296551 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-3cd9eb98-1b62-480c-a150-0c14578ce319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:26:05.310137 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9eb98-1b62-480c-a150-0c14578ce319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:26:05.311548 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9eb98-1b62-480c-a150-0c14578ce319 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:26:05.322715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1458/2904] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:26:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:26:09.121321 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee3556-bf0a-4f30-9382-6da096d71d16 service nova] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:26:09.130708 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee3556-bf0a-4f30-9382-6da096d71d16 service nova] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:26:09.134281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd39f2-23fd-4206-9469-b323bcba1ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:26:09.134922 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd39f2-23fd-4206-9469-b323bcba1ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:26:09.135201 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd39f2-23fd-4206-9469-b323bcba1ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:26:09.135474 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd39f2-23fd-4206-9469-b323bcba1ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:26:09.137856 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-57bd39f2-23fd-4206-9469-b323bcba1ee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:26:09.200113 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd39f2-23fd-4206-9469-b323bcba1ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:26:09.201558 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd39f2-23fd-4206-9469-b323bcba1ee5 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:26:09.211236 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1447/2905] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:26:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:26:15.317559 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=6 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:26:19.206918 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=30 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:26:58.507938 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9eb98-1b62-480c-a150-0c14578ce319 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:26:58.527864 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9eb98-1b62-480c-a150-0c14578ce319 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:26:58.532581 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729056a-bbd1-4881-9d9c-d9419fcb57f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:26:58.533226 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729056a-bbd1-4881-9d9c-d9419fcb57f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:26:58.533509 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729056a-bbd1-4881-9d9c-d9419fcb57f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:26:58.533817 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729056a-bbd1-4881-9d9c-d9419fcb57f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:26:58.535601 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-7729056a-bbd1-4881-9d9c-d9419fcb57f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:26:58.567697 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729056a-bbd1-4881-9d9c-d9419fcb57f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:26:58.569150 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729056a-bbd1-4881-9d9c-d9419fcb57f3 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:26:58.577590 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1459/2906] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:26:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:27:08.573808 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=19 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:28:12.627519 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd39f2-23fd-4206-9469-b323bcba1ee5 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:28:12.655406 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd39f2-23fd-4206-9469-b323bcba1ee5 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:28:12.659734 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07752d9-74fc-42aa-8405-3985a137dc86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:28:12.660400 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07752d9-74fc-42aa-8405-3985a137dc86 service neutron] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:28:12.660695 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07752d9-74fc-42aa-8405-3985a137dc86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:28:12.660979 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07752d9-74fc-42aa-8405-3985a137dc86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:28:12.662873 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f07752d9-74fc-42aa-8405-3985a137dc86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:28:12.718152 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07752d9-74fc-42aa-8405-3985a137dc86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:28:12.719602 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07752d9-74fc-42aa-8405-3985a137dc86 service neutron] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:28:12.741763 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1448/2907] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:28:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:28:22.739210 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=36 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:28:24.401495 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729056a-bbd1-4881-9d9c-d9419fcb57f3 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:28:24.421432 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729056a-bbd1-4881-9d9c-d9419fcb57f3 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:28:24.426459 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f12d2f-6812-4674-bdef-7488169ee8f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd35f21c5cc7c433882eb5fbe9a8072f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:28:24.427107 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f12d2f-6812-4674-bdef-7488169ee8f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:28:24.427423 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f12d2f-6812-4674-bdef-7488169ee8f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:28:24.427705 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f12d2f-6812-4674-bdef-7488169ee8f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:28:24.429715 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-b3f12d2f-6812-4674-bdef-7488169ee8f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:28:24.519379 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f12d2f-6812-4674-bdef-7488169ee8f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:28:24.520860 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f12d2f-6812-4674-bdef-7488169ee8f5 service neutron] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:28:24.541026 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1460/2908] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:28:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 18 17:28:30.952601 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07752d9-74fc-42aa-8405-3985a137dc86 service neutron] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:28:30.954670 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-f07752d9-74fc-42aa-8405-3985a137dc86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:28:30.968761 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07752d9-74fc-42aa-8405-3985a137dc86 service neutron] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:28:30.975224 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345c676-d110-46a8-b793-859b29944146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:28:30.976408 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345c676-d110-46a8-b793-859b29944146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:28:30.976877 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345c676-d110-46a8-b793-859b29944146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:28:30.977281 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345c676-d110-46a8-b793-859b29944146 admin admin] PATH_INFO: `/v3/users/53394412ea1f463196acd85c7e11621c` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:28:30.978838 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345c676-d110-46a8-b793-859b29944146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53394412ea1f463196acd85c7e11621c)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:28:30.981022 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345c676-d110-46a8-b793-859b29944146 admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:28:31.038421 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-3345c676-d110-46a8-b793-859b29944146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53394412ea1f463196acd85c7e11621c'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:31.046255 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-3345c676-d110-46a8-b793-859b29944146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53394412ea1f463196acd85c7e11621c'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:31.066203 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-3345c676-d110-46a8-b793-859b29944146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53394412ea1f463196acd85c7e11621c'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:31.067132 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-3345c676-d110-46a8-b793-859b29944146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53394412ea1f463196acd85c7e11621c'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:31.068183 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-3345c676-d110-46a8-b793-859b29944146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53394412ea1f463196acd85c7e11621c'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:31.086079 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1449/2909] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:28:30 2022] DELETE /identity/v3/users/53394412ea1f463196acd85c7e11621c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:28:31.278120 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f12d2f-6812-4674-bdef-7488169ee8f5 service neutron] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:28:31.293219 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f12d2f-6812-4674-bdef-7488169ee8f5 service neutron] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:28:31.368499 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075c8e3-0bd5-4b70-8b88-7ac4a1ebadb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:28:31.369381 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075c8e3-0bd5-4b70-8b88-7ac4a1ebadb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:28:31.369706 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075c8e3-0bd5-4b70-8b88-7ac4a1ebadb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:28:31.369974 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075c8e3-0bd5-4b70-8b88-7ac4a1ebadb4 admin admin] PATH_INFO: `/v3/projects/467c9f16c74546a68e59acbff2542cc2` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:28:31.371498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075c8e3-0bd5-4b70-8b88-7ac4a1ebadb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=467c9f16c74546a68e59acbff2542cc2)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:28:31.373446 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075c8e3-0bd5-4b70-8b88-7ac4a1ebadb4 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:28:31.428469 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f075c8e3-0bd5-4b70-8b88-7ac4a1ebadb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '467c9f16c74546a68e59acbff2542cc2', 'request_id': 'req-f075c8e3-0bd5-4b70-8b88-7ac4a1ebadb4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:31.438946 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f075c8e3-0bd5-4b70-8b88-7ac4a1ebadb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '467c9f16c74546a68e59acbff2542cc2', 'request_id': 'req-f075c8e3-0bd5-4b70-8b88-7ac4a1ebadb4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:31.442014 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:28:31.448604 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f075c8e3-0bd5-4b70-8b88-7ac4a1ebadb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '467c9f16c74546a68e59acbff2542cc2', 'request_id': 'req-f075c8e3-0bd5-4b70-8b88-7ac4a1ebadb4'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:31.465326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f075c8e3-0bd5-4b70-8b88-7ac4a1ebadb4 admin admin] The token cache is being invalidate because project 467c9f16c74546a68e59acbff2542cc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:28:31.465786 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f075c8e3-0bd5-4b70-8b88-7ac4a1ebadb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:31.466625 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-f075c8e3-0bd5-4b70-8b88-7ac4a1ebadb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:31.468326 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1461/2910] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:28:31 2022] DELETE /identity/v3/projects/467c9f16c74546a68e59acbff2542cc2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 18 17:28:31.473487 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345c676-d110-46a8-b793-859b29944146 admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:28:31.475175 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-3345c676-d110-46a8-b793-859b29944146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:28:31.490315 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345c676-d110-46a8-b793-859b29944146 admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:28:31.553346 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08b1ac-6fff-452f-b2da-7b9ab74be1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:28:31.554536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08b1ac-6fff-452f-b2da-7b9ab74be1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:28:31.554536 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08b1ac-6fff-452f-b2da-7b9ab74be1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:28:31.554751 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08b1ac-6fff-452f-b2da-7b9ab74be1ff admin admin] PATH_INFO: `/v3/users/bc074e5b10d74c129d1d0a33481a9b26` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:28:31.557028 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08b1ac-6fff-452f-b2da-7b9ab74be1ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc074e5b10d74c129d1d0a33481a9b26)` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:28:31.559145 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08b1ac-6fff-452f-b2da-7b9ab74be1ff admin admin] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:28:31.619835 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-6d08b1ac-6fff-452f-b2da-7b9ab74be1ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc074e5b10d74c129d1d0a33481a9b26'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:31.626916 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-6d08b1ac-6fff-452f-b2da-7b9ab74be1ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc074e5b10d74c129d1d0a33481a9b26'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:31.639827 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-6d08b1ac-6fff-452f-b2da-7b9ab74be1ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc074e5b10d74c129d1d0a33481a9b26'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:31.640583 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-6d08b1ac-6fff-452f-b2da-7b9ab74be1ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc074e5b10d74c129d1d0a33481a9b26'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:31.641213 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.notifications [None req-6d08b1ac-6fff-452f-b2da-7b9ab74be1ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc074e5b10d74c129d1d0a33481a9b26'} {{(pid=80345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:31.643587 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:28:31.662169 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1450/2911] 10.222.0.49 () {58 vars in 1223 bytes} [Wed May 18 17:28:31 2022] DELETE /identity/v3/users/bc074e5b10d74c129d1d0a33481a9b26 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:28:31.842016 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075c8e3-0bd5-4b70-8b88-7ac4a1ebadb4 admin admin] Authenticating user token {{(pid=80344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:28:31.843513 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.fernet_utils [None req-f075c8e3-0bd5-4b70-8b88-7ac4a1ebadb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:28:31.862021 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075c8e3-0bd5-4b70-8b88-7ac4a1ebadb4 admin admin] Validating token access rules against request {{(pid=80344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:28:31.926696 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea949e-6ba2-4865-b443-85a8117d0f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f9da66f38394711b45d0352bd9b4158', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76edbb694024faba6c3d4a9e9057ee3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:28:31.927587 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea949e-6ba2-4865-b443-85a8117d0f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:28:31.927877 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea949e-6ba2-4865-b443-85a8117d0f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:28:31.928161 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea949e-6ba2-4865-b443-85a8117d0f15 admin admin] PATH_INFO: `/v3/projects/2ae8219dbb294d1aafcba849c0574a7d` {{(pid=80344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:28:31.929416 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea949e-6ba2-4865-b443-85a8117d0f15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae8219dbb294d1aafcba849c0574a7d)` {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:28:31.931404 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea949e-6ba2-4865-b443-85a8117d0f15 admin admin] RBAC: Authorization granted {{(pid=80344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:28:31.982855 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a4ea949e-6ba2-4865-b443-85a8117d0f15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae8219dbb294d1aafcba849c0574a7d', 'request_id': 'req-a4ea949e-6ba2-4865-b443-85a8117d0f15'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:31.990583 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a4ea949e-6ba2-4865-b443-85a8117d0f15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae8219dbb294d1aafcba849c0574a7d', 'request_id': 'req-a4ea949e-6ba2-4865-b443-85a8117d0f15'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:31.997713 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a4ea949e-6ba2-4865-b443-85a8117d0f15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae8219dbb294d1aafcba849c0574a7d', 'request_id': 'req-a4ea949e-6ba2-4865-b443-85a8117d0f15'} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:32.009207 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a4ea949e-6ba2-4865-b443-85a8117d0f15 admin admin] The token cache is being invalidate because project 2ae8219dbb294d1aafcba849c0574a7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 18 17:28:32.009498 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a4ea949e-6ba2-4865-b443-85a8117d0f15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:32.010189 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG keystone.notifications [None req-a4ea949e-6ba2-4865-b443-85a8117d0f15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 18 17:28:32.012102 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: [pid: 80344|app: 0|req: 1462/2912] 10.222.0.49 () {58 vars in 1232 bytes} [Wed May 18 17:28:31 2022] DELETE /identity/v3/projects/2ae8219dbb294d1aafcba849c0574a7d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 18 17:28:41.654879 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:28:42.005927 dv-cinder-795785-11-iscsi devstack@keystone.service[80344]: DEBUG dbcounter [-] [80344] Writing DB stats keystone:SELECT=55,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:30:12.747891 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08b1ac-6fff-452f-b2da-7b9ab74be1ff admin admin] Authenticating user token {{(pid=80345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 18 17:30:12.749453 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-6d08b1ac-6fff-452f-b2da-7b9ab74be1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:30:12.840777 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08b1ac-6fff-452f-b2da-7b9ab74be1ff admin admin] Validating token access rules against request {{(pid=80345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 18 17:30:12.900561 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9bca2-d9ca-4595-853c-a7a0a8da3897 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bebc8414d01a40c8ab34afa9b1312a59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcd3afbb3e384cb2939647002c60bbba', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 18 17:30:12.903156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9bca2-d9ca-4595-853c-a7a0a8da3897 service placement] REQUEST_METHOD: `GET` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 18 17:30:12.903156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9bca2-d9ca-4595-853c-a7a0a8da3897 service placement] SCRIPT_NAME: `/identity` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 18 17:30:12.903156 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9bca2-d9ca-4595-853c-a7a0a8da3897 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 18 17:30:12.903554 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.fernet_utils [None req-51e9bca2-d9ca-4595-853c-a7a0a8da3897 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 18 17:30:12.915456 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9bca2-d9ca-4595-853c-a7a0a8da3897 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 18 17:30:12.917043 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9bca2-d9ca-4595-853c-a7a0a8da3897 service placement] RBAC: Authorization granted {{(pid=80345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 18 17:30:12.927282 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: [pid: 80345|app: 0|req: 1451/2913] 10.222.0.49 () {60 vars in 1365 bytes} [Wed May 18 17:30:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 18 17:30:22.922772 dv-cinder-795785-11-iscsi devstack@keystone.service[80345]: DEBUG dbcounter [-] [80345] Writing DB stats keystone:SELECT=67 {{(pid=80345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}